Jul 29 19:00:23.864538 ip-10-0-130-75 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 19:00:24.259061 ip-10-0-130-75 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:00:24.259061 ip-10-0-130-75 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 19:00:24.259061 ip-10-0-130-75 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:00:24.259061 ip-10-0-130-75 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 19:00:24.259061 ip-10-0-130-75 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:00:24.260635 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.260550    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 19:00:24.264935 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264920    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:00:24.264935 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264935    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264938    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264942    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264944    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264947    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264952    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264956    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264960    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264964    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264967    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264969    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264972    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264975    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264978    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264981    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264983    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264986    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264989    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264991    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:00:24.265000 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.264999    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265002    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265005    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265008    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265011    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265014    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265017    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265020    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265023    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265025    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265028    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265030    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265033    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265035    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265038    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265040    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265043    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265045    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265048    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265051    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:00:24.265467 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265053    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265056    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265059    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265062    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265067    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265070    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265073    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265076    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265079    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265082    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265085    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265087    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265090    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265093    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265095    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265098    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265101    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265104    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265106    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:00:24.265963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265109    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265111    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265114    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265117    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265120    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265122    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265125    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265127    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265130    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265133    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265135    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265138    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265141    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265144    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265147    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265149    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265152    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265154    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265157    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265160    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:00:24.266480 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265162    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265166    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265169    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265171    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265174    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265176    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265179    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265182    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265185    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265188    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265190    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265193    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265195    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265198    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265200    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265203    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265206    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265208    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265212    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265215    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:00:24.266966 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265917    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265923    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265926    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265929    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265931    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265935    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265939    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265942    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265944    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265947    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265950    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265953    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265955    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265958    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265960    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265963    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265965    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265968    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265971    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265974    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:00:24.267462 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265977    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.265996    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266000    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266003    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266006    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266009    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266013    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266016    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266018    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266021    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266023    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266026    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266029    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266032    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266036    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266040    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266043    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266046    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266050    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:00:24.267991 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266053    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266056    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266059    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266062    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266065    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266067    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266070    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266073    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266076    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266079    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266082    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266086    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266090    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266094    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266096    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266099    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266102    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266105    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266108    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:00:24.268472 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266110    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266113    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266116    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266119    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266121    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266124    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266127    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266130    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266132    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266135    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266138    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266141    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266143    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266147    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266149    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266152    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266155    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266157    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266160    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266162    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266165    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:00:24.268943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266168    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266170    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266173    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266176    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266179    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266181    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266184    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266186    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266189    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266192    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266196    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266199    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266202    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266205    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266208    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266211    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266214    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266216    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266219    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:00:24.269476 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266221    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266596    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266600    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266603    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266607    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266617    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266620    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266623    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266625    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266628    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266631    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266634    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266637    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266639    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266642    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266645    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266647    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266651    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266653    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266656    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:00:24.269945 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266659    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266662    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266665    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266667    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266670    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266673    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266675    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266678    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266680    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266683    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266685    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266688    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266690    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266693    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266695    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266698    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266700    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266703    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266711    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266714    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:00:24.270446 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266717    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266719    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266722    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266724    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266727    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266730    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266733    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266735    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266738    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266742    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266744    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266747    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266750    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266753    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266755    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266758    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266760    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266763    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266765    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266768    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:00:24.270950 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266771    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266773    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266776    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266780    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266784    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266787    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266790    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266792    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266795    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266798    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266801    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266811    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266814    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266817    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266819    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266823    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266825    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266829    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266832    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266834    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:00:24.271479 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266837    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266839    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266842    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266844    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266847    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266849    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266852    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266854    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266857    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266859    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266862    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266864    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266867    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266869    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266872    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266874    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266878    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266881    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266884    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:00:24.271963 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.266886    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.266956    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.266963    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.266969    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.266974    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.266979    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.266983    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.266987    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.266991    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.266994    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.266997    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267000    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267003    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267006    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267009    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267012    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267015    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267018    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267020    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267025    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267028    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267031    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267034    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267037    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 19:00:24.272441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267041    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267043    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267047    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267050    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267053    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267056    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267059    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267062    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267065    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267069    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267072    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267075    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267078    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267080    2563 flags.go:64] FLAG: --enable-server="true"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267084    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267087    2563 flags.go:64] FLAG: --event-burst="100"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267091    2563 flags.go:64] FLAG: --event-qps="50"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267094    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267097    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267100    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267103    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267106    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267109    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267112    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267115    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 19:00:24.273012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267118    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267121    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267123    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267126    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267129    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267132    2563 flags.go:64] FLAG: --feature-gates=""
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267135    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267138    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267141    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267145    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267148    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267151    2563 flags.go:64] FLAG: --help="false"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267154    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-130-75.ec2.internal"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267157    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267160    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267162    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267166    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267169    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267172    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267175    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267178    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267183    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267187    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267190    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 19:00:24.273846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267193    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267196    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267199    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267202    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267205    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267207    2563 flags.go:64] FLAG: --lock-file=""
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267210    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267213    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267217    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267222    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267225    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267227    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267230    2563 flags.go:64] FLAG: --logging-format="text"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267246    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267249    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267252    2563 flags.go:64] FLAG: --manifest-url=""
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267257    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267261    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267264    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267268    2563 flags.go:64] FLAG: --max-pods="110"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267271    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267274    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267277    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267280    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267283    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 19:00:24.274899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267286    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267289    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267297    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267300    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267304    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267307    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267311    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267316    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267319    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267322    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267325    2563 flags.go:64] FLAG: --port="10250"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267328    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267331    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08133e8598238e264"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267334    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267337    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267340    2563 flags.go:64] FLAG: --register-node="true"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267343    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267347    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267350    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267352    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267355    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267359    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267362    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267366    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267369    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 19:00:24.276024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267372    2563 flags.go:64] FLAG: --runonce="false"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267375    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267378    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267381    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267384    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267387    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267390    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267393    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267396    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267399    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267401    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267404    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267410    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267413    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267416    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267419    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267424    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267427    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267430    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267435    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267437    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267440    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267443    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267446    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267449    2563 flags.go:64] FLAG: --v="2"
Jul 29 19:00:24.277121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267453    2563 flags.go:64] FLAG: --version="false"
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267457    2563 flags.go:64] FLAG: --vmodule=""
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267461    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267464    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267597    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267604    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267607    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267610    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267614    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267617    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267620    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267622    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267625    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267628    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267630    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267633    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267635    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267638    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267641    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267645    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:00:24.278130 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267647    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267650    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267653    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267655    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267658    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267661    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267663    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267666    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267669    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267671    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267674    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267677    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267679    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267682    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267684    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267687    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267690    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267694    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267696    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267699    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:00:24.278895 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267702    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267705    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267708    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267711    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267713    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267716    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267719    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267722    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267724    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267727    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267729    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267734    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267736    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267739    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267741    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267744    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267749    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267752    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267755    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:00:24.279747 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267758    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267761    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267763    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267766    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267770    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267774    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267776    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267779    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267781    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267784    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267788    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267791    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267794    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267796    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267799    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267801    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267804    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267806    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267809    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:00:24.280273 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267812    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267814    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267817    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267819    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267822    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267826    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267828    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267831    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267834    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267836    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267839    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267842    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267845    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267847    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267850    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267853    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267855    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267858    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267861    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267863    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:00:24.280876 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267866    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267868    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267871    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267875    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.267878    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.267883    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.276248    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.276266    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.276295    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.276308    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276397    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276405    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276419    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276424    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276430    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:00:24.281465 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276434    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276439    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276443    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276448    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276453    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276457    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276462    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276474    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276478    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276485    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276491    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276496    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276500    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276505    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276509    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276513    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276518    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276522    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276531    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:00:24.281841 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276536    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276541    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276545    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276550    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276554    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276559    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276563    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276567    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276571    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276575    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276580    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276584    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276588    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276592    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276596    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276601    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276605    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276609    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276613    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276617    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:00:24.282373 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276621    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276633    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276638    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276642    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276646    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276650    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276655    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276659    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276663    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276668    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276672    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276676    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276680    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276685    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276689    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276693    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276697    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276702    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276707    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276711    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:00:24.282882 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276715    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276720    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276724    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276728    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276733    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276737    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276741    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276745    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276749    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276754    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276758    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276762    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276769    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276774    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276789    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276795    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276800    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276805    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276810    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276815    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:00:24.283431 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276819    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:00:24.284051 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276824    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:00:24.284051 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276828    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:00:24.284051 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276832    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:00:24.284051 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276837    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:00:24.284051 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276841    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:00:24.284051 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276845    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:00:24.284051 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276849    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:00:24.284051 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276854    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:00:24.284051 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276869    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:00:24.284051 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276875    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:00:24.284051 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276879    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:00:24.284051 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276884    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:00:24.284051 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276888    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:00:24.284051 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.276892    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.276900    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277135    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277142    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277146    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277150    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277154    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277159    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277163    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277168    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277172    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277176    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277180    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277192    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277197    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:00:24.284437 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277201    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277205    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277209    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277213    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277218    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277223    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277227    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277231    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277251    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277255    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277259    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277263    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277267    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277271    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277275    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277279    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277282    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277286    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277290    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:00:24.285073 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277293    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277297    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277301    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277305    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277308    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277312    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277316    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277320    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277324    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277328    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277331    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277335    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277347    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277352    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277356    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277360    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277364    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277368    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277373    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:00:24.285654 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277377    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277381    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277386    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277390    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277394    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277399    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277404    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277408    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277412    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277416    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277422    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277427    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277432    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277436    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277440    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277446    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277452    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277457    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277461    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277465    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:00:24.286177 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277469    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277473    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277477    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277481    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277486    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277490    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277501    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277505    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277509    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277513    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277517    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277521    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277526    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277530    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277535    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277539    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277543    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277547    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277552    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:00:24.286716 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277558    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:00:24.287249 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277563    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:00:24.287249 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277568    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:00:24.287249 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277573    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:00:24.287249 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277577    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:00:24.287249 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277581    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:00:24.287249 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277586    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:00:24.287249 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277591    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:00:24.287249 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:24.277595    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:00:24.287249 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.277602    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:00:24.287249 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.277782    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 19:00:24.287249 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.280461    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 19:00:24.287249 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.281874    2563 server.go:1019] "Starting client certificate rotation"
Jul 29 19:00:24.287249 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.281977    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 19:00:24.287249 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.282019    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 19:00:24.287610 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.286620    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 19:00:24.291844 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.291826    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 19:00:24.305127 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.305108    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 29 19:00:24.307704 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.307687    2563 log.go:25] "Validated CRI v1 image API"
Jul 29 19:00:24.308587 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.308572    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 19:00:24.310880 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.310858    2563 fs.go:135] Filesystem UUIDs: map[20c81ec6-18de-487f-acc3-078e1536af9c:/dev/nvme0n1p3 6efa370d-b629-4afd-bcdc-f507776e5564:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 29 19:00:24.310961 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.310878    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 19:00:24.312126 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.312112    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 19:00:24.316363 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.316259    2563 manager.go:216] Machine: {Timestamp:2026-07-29 19:00:24.315785356 +0000 UTC m=+0.335269587 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097711 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28969d1091cc5f659f85121c7081eb SystemUUID:ec28969d-1091-cc5f-659f-85121c7081eb BootID:a6606338-9030-487c-be4c-669d8e2280c9 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:11:05:04:97:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:11:05:04:97:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:75:26:6f:96:5b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 19:00:24.316363 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.316356    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 19:00:24.316472 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.316455    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 19:00:24.318639 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.318618    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 19:00:24.318768 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.318643    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-75.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 19:00:24.319453 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.319443    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 19:00:24.319488 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.319457    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 19:00:24.319488 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.319470    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 19:00:24.319488 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.319481    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 19:00:24.321433 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.321422    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 19:00:24.324820 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.324808    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 19:00:24.324971 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.324961    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 19:00:24.325004 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.324991    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 19:00:24.325036 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.325023    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 19:00:24.325065 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.325038    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 19:00:24.325110 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.325100    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 29 19:00:24.325146 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.325117    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 19:00:24.325568 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.325556    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 19:00:24.325636 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.325574    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 19:00:24.327749 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.327732    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 19:00:24.329850 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.329812    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 19:00:24.329936 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.329867    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 19:00:24.330047 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.330028    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-95ptr"
Jul 29 19:00:24.330579 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.330565    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 19:00:24.330630 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.330587    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 19:00:24.330630 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.330597    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 19:00:24.330630 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.330614    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 19:00:24.330630 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.330626    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 19:00:24.330783 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.330634    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 19:00:24.331214 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.331198    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 19:00:24.331289 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.331217    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 19:00:24.331289 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.331230    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 19:00:24.331289 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.331253    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 19:00:24.331289 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.331268    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 19:00:24.331440 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.331314    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 19:00:24.332284 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.332269    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 19:00:24.332347 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.332286    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 19:00:24.335032 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.335014    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-75.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 19:00:24.335093 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:24.335076    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-75.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 19:00:24.335245 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:24.335210    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 19:00:24.335874 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.335862    2563 server.go:1268] "Started kubelet"
Jul 29 19:00:24.335964 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.335941    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 19:00:24.336019 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.335950    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 19:00:24.336019 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.335985    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 19:00:24.336683 ip-10-0-130-75 systemd[1]: Started Kubernetes Kubelet.
Jul 29 19:00:24.337275 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.337163    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-95ptr"
Jul 29 19:00:24.337838 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.337784    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 19:00:24.338149 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.338134    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 19:00:24.341606 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:24.341587    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 19:00:24.342877 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:24.341950    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-75.ec2.internal.18c6d7d7d7b441db  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-75.ec2.internal,UID:ip-10-0-130-75.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-75.ec2.internal,},FirstTimestamp:2026-07-29 19:00:24.335835611 +0000 UTC m=+0.355319842,LastTimestamp:2026-07-29 19:00:24.335835611 +0000 UTC m=+0.355319842,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-75.ec2.internal,}"
Jul 29 19:00:24.345966 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.345953    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 19:00:24.346027 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.345999    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 19:00:24.346090 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:24.346073    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found"
Jul 29 19:00:24.346572 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.346554    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 19:00:24.346572 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.346575    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 19:00:24.346696 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.346685    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 19:00:24.346696 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.346693    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 19:00:24.346803 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.346735    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 19:00:24.346883 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.346869    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 19:00:24.346883 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.346881    2563 factory.go:55] Registering systemd factory
Jul 29 19:00:24.346975 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.346887    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 29 19:00:24.347108 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.347098    2563 factory.go:153] Registering CRI-O factory
Jul 29 19:00:24.347108 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.347109    2563 factory.go:223] Registration of the crio container factory successfully
Jul 29 19:00:24.347191 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.347127    2563 factory.go:103] Registering Raw factory
Jul 29 19:00:24.347191 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.347140    2563 manager.go:1196] Started watching for new ooms in manager
Jul 29 19:00:24.348045 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.348032    2563 manager.go:349] Starting recovery of all containers
Jul 29 19:00:24.348975 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.348955    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:00:24.351642 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:24.351620    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-75.ec2.internal\" not found" node="ip-10-0-130-75.ec2.internal"
Jul 29 19:00:24.354936 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.354900    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 19:00:24.359944 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.359935    2563 manager.go:354] Recovery completed
Jul 29 19:00:24.366165 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.366151    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:00:24.367856 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.367841    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:00:24.367931 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.367866    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:00:24.367931 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.367880    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:00:24.368415 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.368401    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 19:00:24.368415 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.368413    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 19:00:24.368520 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.368419    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:00:24.368520 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.368429    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 19:00:24.369086 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.369071    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:00:24.369143 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.369101    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:00:24.369143 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.369111    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:00:24.369706 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.369694    2563 policy_none.go:49] "None policy: Start"
Jul 29 19:00:24.369781 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.369709    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 19:00:24.369781 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.369719    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 19:00:24.370755 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.370740    2563 policy_none.go:47] "Start"
Jul 29 19:00:24.425991 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.425818    2563 manager.go:337] "Starting Device Plugin manager"
Jul 29 19:00:24.426119 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:24.426018    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 19:00:24.426119 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.426031    2563 server.go:87] "Starting device plugin registration server"
Jul 29 19:00:24.426323 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.426310    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 19:00:24.426382 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.426325    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 19:00:24.426442 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.426414    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 19:00:24.426519 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.426503    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 19:00:24.426519 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:24.426519    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 19:00:24.427037 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:24.427016    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 19:00:24.427123 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:24.427073    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-75.ec2.internal\" not found"
Jul 29 19:00:25.657930 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.657907    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 19:00:25.659042 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.657944    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 19:00:25.659042 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.657970    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 19:00:25.659042 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:25.658014    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 19:00:25.660797 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.660770    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:00:25.701839 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.701796    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:00:25.702581 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.702562    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:00:25.702669 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.702598    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:00:25.702669 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.702608    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:00:25.702669 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.702632    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.711287 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.711273    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.711344 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:25.711294    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-75.ec2.internal\": node \"ip-10-0-130-75.ec2.internal\" not found"
Jul 29 19:00:25.726389 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:25.726371    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found"
Jul 29 19:00:25.758786 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.758753    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal"]
Jul 29 19:00:25.758866 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.758821    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:00:25.760180 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.760165    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:00:25.760251 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.760195    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:00:25.760251 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.760205    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:00:25.761527 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.761515    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:00:25.761665 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.761638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.761705 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.761667    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:00:25.762227 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.762215    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:00:25.762227 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.762233    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:00:25.762332 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.762242    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:00:25.762332 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.762252    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:00:25.762332 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.762285    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:00:25.762332 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.762295    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:00:25.763439 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.763415    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.763531 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.763444    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:00:25.764141 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.764127    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:00:25.764220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.764153    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:00:25.764220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.764166    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:00:25.792605 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:25.792581    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-75.ec2.internal\" not found" node="ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.796810 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:25.796794    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-75.ec2.internal\" not found" node="ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.823531 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.823512    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/632792feb0225915f638d426896756da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal\" (UID: \"632792feb0225915f638d426896756da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.823610 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.823534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/632792feb0225915f638d426896756da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal\" (UID: \"632792feb0225915f638d426896756da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.823610 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.823552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfe6536f353a8e0145bc66b1c5423231-config\") pod \"kube-apiserver-proxy-ip-10-0-130-75.ec2.internal\" (UID: \"cfe6536f353a8e0145bc66b1c5423231\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.826615 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:25.826602    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found"
Jul 29 19:00:25.924356 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.924332    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/632792feb0225915f638d426896756da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal\" (UID: \"632792feb0225915f638d426896756da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.924453 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.924359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/632792feb0225915f638d426896756da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal\" (UID: \"632792feb0225915f638d426896756da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.924453 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.924377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfe6536f353a8e0145bc66b1c5423231-config\") pod \"kube-apiserver-proxy-ip-10-0-130-75.ec2.internal\" (UID: \"cfe6536f353a8e0145bc66b1c5423231\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.924453 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.924425    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/632792feb0225915f638d426896756da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal\" (UID: \"632792feb0225915f638d426896756da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.924453 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.924434    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/632792feb0225915f638d426896756da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal\" (UID: \"632792feb0225915f638d426896756da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.924586 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:25.924476    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfe6536f353a8e0145bc66b1c5423231-config\") pod \"kube-apiserver-proxy-ip-10-0-130-75.ec2.internal\" (UID: \"cfe6536f353a8e0145bc66b1c5423231\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:25.927447 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:25.927430    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found"
Jul 29 19:00:26.028173 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:26.028119    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found"
Jul 29 19:00:26.095326 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:26.095299    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:26.100588 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:26.100571    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:26.128923 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:26.128898    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found"
Jul 29 19:00:26.229360 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:26.229337    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found"
Jul 29 19:00:26.329837 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:26.329781    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found"
Jul 29 19:00:26.430428 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:26.430403    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found"
Jul 29 19:00:26.456572 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:26.456551    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 19:00:26.456929 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:26.456679    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 19:00:26.456929 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:26.456706    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 19:00:26.515802 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:26.515773    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 18:55:25 +0000 UTC" deadline="2028-03-18 07:03:06.19406331 +0000 UTC"
Jul 29 19:00:26.515802 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:26.515798    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14340h2m39.678268216s"
Jul 29 19:00:26.530864 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:26.530842    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found"
Jul 29 19:00:26.631949 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:26.631922    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found"
Jul 29 19:00:26.663871 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:26.663850    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:00:26.674418 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:26.674393    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod632792feb0225915f638d426896756da.slice/crio-7bd2394e801844ae5eae5618ce03d06f1473f1637956a924349cad66557bb106 WatchSource:0}: Error finding container 7bd2394e801844ae5eae5618ce03d06f1473f1637956a924349cad66557bb106: Status 404 returned error can't find the container with id 7bd2394e801844ae5eae5618ce03d06f1473f1637956a924349cad66557bb106
Jul 29 19:00:26.674898 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:26.674878    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe6536f353a8e0145bc66b1c5423231.slice/crio-c85357defaea651da6afe07a1124e42b417b1fd87b420266660a3ac04a8f491c WatchSource:0}: Error finding container c85357defaea651da6afe07a1124e42b417b1fd87b420266660a3ac04a8f491c: Status 404 returned error can't find the container with id c85357defaea651da6afe07a1124e42b417b1fd87b420266660a3ac04a8f491c
Jul 29 19:00:26.678854 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:26.678842    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:00:26.709759 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:26.709737    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:00:26.721952 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:26.721930    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:26.733084 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:26.733064    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 19:00:26.734319 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:26.734307    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal"
Jul 29 19:00:26.740672 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:26.740660    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 19:00:27.501635 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.501604    2563 apiserver.go:52] "Watching apiserver"
Jul 29 19:00:27.515100 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.515070    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 19:00:27.515518 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.515480    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-mklk5","openshift-multus/multus-additional-cni-plugins-4spp7","openshift-network-operator/iptables-alerter-8qskb","openshift-ovn-kubernetes/ovnkube-node-p796x","kube-system/global-pull-secret-syncer-kld88","kube-system/konnectivity-agent-4x2jv","kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal","openshift-cluster-node-tuning-operator/tuned-5cgwc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal","openshift-multus/multus-ztmqn","openshift-multus/network-metrics-daemon-ts6wm","openshift-network-diagnostics/network-check-target-ljwdk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn","openshift-dns/node-resolver-8w67g"]
Jul 29 19:00:27.517246 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.517219    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.518461 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.518440    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.519857 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.519837    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 19:00:27.520248 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.520227    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 19:00:27.520497 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.520468    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-66c5q\""
Jul 29 19:00:27.520572 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.520557    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8qskb"
Jul 29 19:00:27.520663 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.520649    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 19:00:27.520879 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.520862    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 19:00:27.521117 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.521101    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 19:00:27.521191 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.521171    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 19:00:27.521395 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.521376    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 19:00:27.521462 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.521406    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 19:00:27.521619 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.521602    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dkkdc\""
Jul 29 19:00:27.523413 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.523391    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:00:27.523563 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.523543    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.523723 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.523705    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 19:00:27.523982 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.523965    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 19:00:27.524280 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.524259    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-94z5l\""
Jul 29 19:00:27.524903 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.524883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:27.525009 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:27.524967    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:27.526096 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.526073    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 19:00:27.526369 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.526351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4x2jv"
Jul 29 19:00:27.527180 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.527162    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 19:00:27.527644 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.527625    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 19:00:27.528009 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.527805    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 19:00:27.528009 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.527982    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 19:00:27.529034 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.528258    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7kp4n\""
Jul 29 19:00:27.529034 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.528481    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8w67g"
Jul 29 19:00:27.529034 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.528902    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 19:00:27.529370 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.529349    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 19:00:27.529463 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.529422    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 19:00:27.529567 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.529521    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2n7lp\""
Jul 29 19:00:27.530311 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.530292    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.531258 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.531191    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 19:00:27.531380 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.531267    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vzf4x\""
Jul 29 19:00:27.531690 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.531669    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 19:00:27.531972 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.531956    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.532563 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532543    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:00:27.532635 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-run-multus-certs\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.532635 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532545    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 19:00:27.532635 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532610    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tv2tn\""
Jul 29 19:00:27.532635 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70a20398-cb08-4874-b693-faf517438ad0-env-overrides\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.532760 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70a20398-cb08-4874-b693-faf517438ad0-ovn-node-metrics-cert\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.532760 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l28r7\" (UniqueName: \"kubernetes.io/projected/70a20398-cb08-4874-b693-faf517438ad0-kube-api-access-l28r7\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.532760 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532705    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zl7n\" (UniqueName: \"kubernetes.io/projected/b190db6f-5f45-4637-ad4b-6894c2178c41-kube-api-access-9zl7n\") pod \"iptables-alerter-8qskb\" (UID: \"b190db6f-5f45-4637-ad4b-6894c2178c41\") " pod="openshift-network-operator/iptables-alerter-8qskb"
Jul 29 19:00:27.532760 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-run-systemd\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.532881 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532772    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-node-log\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.532881 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-run-netns\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.532881 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-var-lib-cni-multus\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.532881 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532851    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 19:00:27.532881 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-etc-selinux\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.533062 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-kubelet\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533062 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.532905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-multus-cni-dir\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.533062 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533009    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-multus-socket-dir-parent\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.533062 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-multus-conf-dir\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.533188 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5643a1b8-f921-4bc4-862c-354928e54407-multus-daemon-config\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.533188 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-socket-dir\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.533188 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-sys-fs\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.533188 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533154    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-etc-openvswitch\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533188 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5643a1b8-f921-4bc4-862c-354928e54407-cni-binary-copy\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.533360 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-var-lib-cni-bin\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.533360 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533229    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-var-lib-kubelet\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.533360 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-etc-kubernetes\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.533360 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.533360 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-systemd-units\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533360 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533355    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-run-netns\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533618 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-cni-bin\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533618 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-run-openvswitch\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533618 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533455    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-log-socket\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533618 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-cni-netd\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533618 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533524    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70a20398-cb08-4874-b693-faf517438ad0-ovnkube-script-lib\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533618 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-os-release\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.533618 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgkgn\" (UniqueName: \"kubernetes.io/projected/5643a1b8-f921-4bc4-862c-354928e54407-kube-api-access-xgkgn\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.533618 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-registration-dir\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.533968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-device-dir\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.533968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-slash\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-run-ovn\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533680    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mklk5"
Jul 29 19:00:27.533968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533722    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-run-ovn-kubernetes\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70a20398-cb08-4874-b693-faf517438ad0-ovnkube-config\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-run-k8s-cni-cncf-io\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.533968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mcpt\" (UniqueName: \"kubernetes.io/projected/d5807496-f027-48d9-9f4b-72ac56c2c89e-kube-api-access-5mcpt\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.533968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b190db6f-5f45-4637-ad4b-6894c2178c41-iptables-alerter-script\") pod \"iptables-alerter-8qskb\" (UID: \"b190db6f-5f45-4637-ad4b-6894c2178c41\") " pod="openshift-network-operator/iptables-alerter-8qskb"
Jul 29 19:00:27.533968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b190db6f-5f45-4637-ad4b-6894c2178c41-host-slash\") pod \"iptables-alerter-8qskb\" (UID: \"b190db6f-5f45-4637-ad4b-6894c2178c41\") " pod="openshift-network-operator/iptables-alerter-8qskb"
Jul 29 19:00:27.533968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533907    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-var-lib-openvswitch\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533932    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.533968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-system-cni-dir\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.534466 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.533983    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-cnibin\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.534466 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.534022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-hostroot\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.534688 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.534673    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 19:00:27.534977 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.534913    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 19:00:27.535391 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.535225    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mnmnv\""
Jul 29 19:00:27.535523 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.535504    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:27.536225 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:27.536184    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:27.537294 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.537272    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jmbcz\""
Jul 29 19:00:27.537788 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.537767    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 19:00:27.538346 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.538324    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 19:00:27.539422 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.539298    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:27.539422 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.539326    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 19:00:27.539422 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:27.539371    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:27.557346 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.557321    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hhzpf"
Jul 29 19:00:27.564045 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.564023    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hhzpf"
Jul 29 19:00:27.622963 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.622942    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 19:00:27.635083 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-etc-openvswitch\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.635212 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52668d46-bc7a-467b-b228-1739e7837240-dbus\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:27.635212 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-sys\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.635212 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635123    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:27.635212 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635180    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5643a1b8-f921-4bc4-862c-354928e54407-cni-binary-copy\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.635416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-etc-openvswitch\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.635416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-var-lib-cni-bin\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.635416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-etc-kubernetes\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.635416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-run-netns\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.635416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-etc-kubernetes\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.635416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635293    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-cni-bin\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.635416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/09767a94-1353-451e-81e2-bc2b3c443aef-serviceca\") pod \"node-ca-mklk5\" (UID: \"09767a94-1353-451e-81e2-bc2b3c443aef\") " pod="openshift-image-registry/node-ca-mklk5"
Jul 29 19:00:27.635416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635317    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-run-netns\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.635416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qlpl\" (UniqueName: \"kubernetes.io/projected/c1f37fb3-f377-4226-b541-29e42c89c50b-kube-api-access-9qlpl\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:27.635416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70a20398-cb08-4874-b693-faf517438ad0-ovnkube-script-lib\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.635416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635364    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-var-lib-cni-bin\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.635416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2641c276-30f3-4887-8935-5baecd3a3ef7-hosts-file\") pod \"node-resolver-8w67g\" (UID: \"2641c276-30f3-4887-8935-5baecd3a3ef7\") " pod="openshift-dns/node-resolver-8w67g"
Jul 29 19:00:27.635416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-tuned\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-os-release\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635408    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-cni-bin\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgkgn\" (UniqueName: \"kubernetes.io/projected/5643a1b8-f921-4bc4-862c-354928e54407-kube-api-access-xgkgn\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-slash\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-run-ovn-kubernetes\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635528    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-os-release\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-kubernetes\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635594    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-var-lib-kubelet\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635625    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-tmp\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635651    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-run-k8s-cni-cncf-io\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b190db6f-5f45-4637-ad4b-6894c2178c41-iptables-alerter-script\") pod \"iptables-alerter-8qskb\" (UID: \"b190db6f-5f45-4637-ad4b-6894c2178c41\") " pod="openshift-network-operator/iptables-alerter-8qskb"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-var-lib-openvswitch\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70a20398-cb08-4874-b693-faf517438ad0-ovn-node-metrics-cert\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635761    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5643a1b8-f921-4bc4-862c-354928e54407-cni-binary-copy\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.636082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635837    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70a20398-cb08-4874-b693-faf517438ad0-ovnkube-script-lib\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52668d46-bc7a-467b-b228-1739e7837240-kubelet-config\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-slash\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635886    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635890    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-var-lib-openvswitch\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635894    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-run-ovn-kubernetes\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmx8z\" (UniqueName: \"kubernetes.io/projected/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-kube-api-access-zmx8z\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635924    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-run-k8s-cni-cncf-io\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635947    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-system-cni-dir\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.635979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-cnibin\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636007    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-system-cni-dir\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-run-multus-certs\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-cnibin\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636072    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70a20398-cb08-4874-b693-faf517438ad0-env-overrides\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l28r7\" (UniqueName: \"kubernetes.io/projected/70a20398-cb08-4874-b693-faf517438ad0-kube-api-access-l28r7\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636136    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.636779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-run-multus-certs\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-systemd\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-run-systemd\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636212    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636252    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-run-systemd\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636280    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-run\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-kubelet\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636392    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p74x\" (UniqueName: \"kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x\") pod \"network-check-target-ljwdk\" (UID: \"5891e0ee-ef9f-4b22-8f93-295c5356bee1\") " pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636390    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b190db6f-5f45-4637-ad4b-6894c2178c41-iptables-alerter-script\") pod \"iptables-alerter-8qskb\" (UID: \"b190db6f-5f45-4637-ad4b-6894c2178c41\") " pod="openshift-network-operator/iptables-alerter-8qskb"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-sysconfig\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70a20398-cb08-4874-b693-faf517438ad0-env-overrides\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-kubelet\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636514    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-multus-cni-dir\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-multus-socket-dir-parent\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-multus-conf-dir\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.637548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-sys-fs\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-lib-modules\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-var-lib-kubelet\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636657    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-multus-conf-dir\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-systemd-units\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636713    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-multus-socket-dir-parent\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636719    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-cni-netd\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636731    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-sys-fs\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636733    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-multus-cni-dir\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2641c276-30f3-4887-8935-5baecd3a3ef7-tmp-dir\") pod \"node-resolver-8w67g\" (UID: \"2641c276-30f3-4887-8935-5baecd3a3ef7\") " pod="openshift-dns/node-resolver-8w67g"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636772    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-var-lib-kubelet\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636747    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-systemd-units\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-sysctl-conf\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636789    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-host-cni-netd\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-run-openvswitch\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.638265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-log-socket\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636891    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-run-openvswitch\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-os-release\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636930    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-log-socket\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.636966    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-registration-dir\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-device-dir\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-run-ovn\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637036    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-registration-dir\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637052    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-run-ovn\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-device-dir\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70a20398-cb08-4874-b693-faf517438ad0-ovnkube-config\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-modprobe-d\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637186    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-sysctl-d\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mcpt\" (UniqueName: \"kubernetes.io/projected/d5807496-f027-48d9-9f4b-72ac56c2c89e-kube-api-access-5mcpt\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b190db6f-5f45-4637-ad4b-6894c2178c41-host-slash\") pod \"iptables-alerter-8qskb\" (UID: \"b190db6f-5f45-4637-ad4b-6894c2178c41\") " pod="openshift-network-operator/iptables-alerter-8qskb"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637350    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-cnibin\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637376    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dswdp\" (UniqueName: \"kubernetes.io/projected/2641c276-30f3-4887-8935-5baecd3a3ef7-kube-api-access-dswdp\") pod \"node-resolver-8w67g\" (UID: \"2641c276-30f3-4887-8935-5baecd3a3ef7\") " pod="openshift-dns/node-resolver-8w67g"
Jul 29 19:00:27.638825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-hostroot\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637410    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b190db6f-5f45-4637-ad4b-6894c2178c41-host-slash\") pod \"iptables-alerter-8qskb\" (UID: \"b190db6f-5f45-4637-ad4b-6894c2178c41\") " pod="openshift-network-operator/iptables-alerter-8qskb"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637427    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zl7n\" (UniqueName: \"kubernetes.io/projected/b190db6f-5f45-4637-ad4b-6894c2178c41-kube-api-access-9zl7n\") pod \"iptables-alerter-8qskb\" (UID: \"b190db6f-5f45-4637-ad4b-6894c2178c41\") " pod="openshift-network-operator/iptables-alerter-8qskb"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-node-log\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/028e766d-fc88-4f58-a69e-7c02dff9a90a-agent-certs\") pod \"konnectivity-agent-4x2jv\" (UID: \"028e766d-fc88-4f58-a69e-7c02dff9a90a\") " pod="kube-system/konnectivity-agent-4x2jv"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-hostroot\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-host\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637549    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70a20398-cb08-4874-b693-faf517438ad0-node-log\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637571    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-run-netns\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-var-lib-cni-multus\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70a20398-cb08-4874-b693-faf517438ad0-ovnkube-config\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-etc-selinux\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-run-netns\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637683    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5643a1b8-f921-4bc4-862c-354928e54407-host-var-lib-cni-multus\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/028e766d-fc88-4f58-a69e-7c02dff9a90a-konnectivity-ca\") pod \"konnectivity-agent-4x2jv\" (UID: \"028e766d-fc88-4f58-a69e-7c02dff9a90a\") " pod="kube-system/konnectivity-agent-4x2jv"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-system-cni-dir\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637755    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrfmh\" (UniqueName: \"kubernetes.io/projected/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-kube-api-access-hrfmh\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.639509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637760    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-etc-selinux\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.640360 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09767a94-1353-451e-81e2-bc2b3c443aef-host\") pod \"node-ca-mklk5\" (UID: \"09767a94-1353-451e-81e2-bc2b3c443aef\") " pod="openshift-image-registry/node-ca-mklk5"
Jul 29 19:00:27.640360 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcjhb\" (UniqueName: \"kubernetes.io/projected/09767a94-1353-451e-81e2-bc2b3c443aef-kube-api-access-gcjhb\") pod \"node-ca-mklk5\" (UID: \"09767a94-1353-451e-81e2-bc2b3c443aef\") " pod="openshift-image-registry/node-ca-mklk5"
Jul 29 19:00:27.640360 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5643a1b8-f921-4bc4-862c-354928e54407-multus-daemon-config\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.640360 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.637887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-socket-dir\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.640360 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.638006    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5807496-f027-48d9-9f4b-72ac56c2c89e-socket-dir\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.640360 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.638904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5643a1b8-f921-4bc4-862c-354928e54407-multus-daemon-config\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.640360 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.639791    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70a20398-cb08-4874-b693-faf517438ad0-ovn-node-metrics-cert\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.643484 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.643462    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgkgn\" (UniqueName: \"kubernetes.io/projected/5643a1b8-f921-4bc4-862c-354928e54407-kube-api-access-xgkgn\") pod \"multus-ztmqn\" (UID: \"5643a1b8-f921-4bc4-862c-354928e54407\") " pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.644818 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.644799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mcpt\" (UniqueName: \"kubernetes.io/projected/d5807496-f027-48d9-9f4b-72ac56c2c89e-kube-api-access-5mcpt\") pod \"aws-ebs-csi-driver-node-jh9bn\" (UID: \"d5807496-f027-48d9-9f4b-72ac56c2c89e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.645317 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.645297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zl7n\" (UniqueName: \"kubernetes.io/projected/b190db6f-5f45-4637-ad4b-6894c2178c41-kube-api-access-9zl7n\") pod \"iptables-alerter-8qskb\" (UID: \"b190db6f-5f45-4637-ad4b-6894c2178c41\") " pod="openshift-network-operator/iptables-alerter-8qskb"
Jul 29 19:00:27.645411 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.645327    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l28r7\" (UniqueName: \"kubernetes.io/projected/70a20398-cb08-4874-b693-faf517438ad0-kube-api-access-l28r7\") pod \"ovnkube-node-p796x\" (UID: \"70a20398-cb08-4874-b693-faf517438ad0\") " pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.662903 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.662855    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" event={"ID":"632792feb0225915f638d426896756da","Type":"ContainerStarted","Data":"7bd2394e801844ae5eae5618ce03d06f1473f1637956a924349cad66557bb106"}
Jul 29 19:00:27.664399 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.664357    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal" event={"ID":"cfe6536f353a8e0145bc66b1c5423231","Type":"ContainerStarted","Data":"c85357defaea651da6afe07a1124e42b417b1fd87b420266660a3ac04a8f491c"}
Jul 29 19:00:27.738367 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.738367 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-kubernetes\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.738580 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-var-lib-kubelet\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.738580 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-tmp\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.738580 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.738580 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52668d46-bc7a-467b-b228-1739e7837240-kubelet-config\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:27.738580 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmx8z\" (UniqueName: \"kubernetes.io/projected/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-kube-api-access-zmx8z\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.738580 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.738580 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-kubernetes\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.738580 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738505    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-systemd\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.738580 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738529    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52668d46-bc7a-467b-b228-1739e7837240-kubelet-config\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:27.738580 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.738580 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738561    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.738580 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-run\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p74x\" (UniqueName: \"kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x\") pod \"network-check-target-ljwdk\" (UID: \"5891e0ee-ef9f-4b22-8f93-295c5356bee1\") " pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-sysconfig\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-lib-modules\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-var-lib-kubelet\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738738    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2641c276-30f3-4887-8935-5baecd3a3ef7-tmp-dir\") pod \"node-resolver-8w67g\" (UID: \"2641c276-30f3-4887-8935-5baecd3a3ef7\") " pod="openshift-dns/node-resolver-8w67g"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-sysctl-conf\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738553    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-systemd\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-run\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738823    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-sysconfig\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:27.738839    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-os-release\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:27.738906    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret podName:52668d46-bc7a-467b-b228-1739e7837240 nodeName:}" failed. No retries permitted until 2026-07-29 19:00:28.238887982 +0000 UTC m=+3.083617934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret") pod "global-pull-secret-syncer-kld88" (UID: "52668d46-bc7a-467b-b228-1739e7837240") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738905    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-sysctl-conf\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-modprobe-d\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738933    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-os-release\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.739220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738944    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-sysctl-d\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.738965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-cnibin\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739015    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-cnibin\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739035    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-lib-modules\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739164    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-modprobe-d\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dswdp\" (UniqueName: \"kubernetes.io/projected/2641c276-30f3-4887-8935-5baecd3a3ef7-kube-api-access-dswdp\") pod \"node-resolver-8w67g\" (UID: \"2641c276-30f3-4887-8935-5baecd3a3ef7\") " pod="openshift-dns/node-resolver-8w67g"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739208    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/028e766d-fc88-4f58-a69e-7c02dff9a90a-agent-certs\") pod \"konnectivity-agent-4x2jv\" (UID: \"028e766d-fc88-4f58-a69e-7c02dff9a90a\") " pod="kube-system/konnectivity-agent-4x2jv"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739229    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-sysctl-d\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-host\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/028e766d-fc88-4f58-a69e-7c02dff9a90a-konnectivity-ca\") pod \"konnectivity-agent-4x2jv\" (UID: \"028e766d-fc88-4f58-a69e-7c02dff9a90a\") " pod="kube-system/konnectivity-agent-4x2jv"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739314    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-system-cni-dir\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739346    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-host\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrfmh\" (UniqueName: \"kubernetes.io/projected/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-kube-api-access-hrfmh\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739363    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2641c276-30f3-4887-8935-5baecd3a3ef7-tmp-dir\") pod \"node-resolver-8w67g\" (UID: \"2641c276-30f3-4887-8935-5baecd3a3ef7\") " pod="openshift-dns/node-resolver-8w67g"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09767a94-1353-451e-81e2-bc2b3c443aef-host\") pod \"node-ca-mklk5\" (UID: \"09767a94-1353-451e-81e2-bc2b3c443aef\") " pod="openshift-image-registry/node-ca-mklk5"
Jul 29 19:00:27.740043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739387    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-system-cni-dir\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcjhb\" (UniqueName: \"kubernetes.io/projected/09767a94-1353-451e-81e2-bc2b3c443aef-kube-api-access-gcjhb\") pod \"node-ca-mklk5\" (UID: \"09767a94-1353-451e-81e2-bc2b3c443aef\") " pod="openshift-image-registry/node-ca-mklk5"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739436    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52668d46-bc7a-467b-b228-1739e7837240-dbus\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739442    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09767a94-1353-451e-81e2-bc2b3c443aef-host\") pod \"node-ca-mklk5\" (UID: \"09767a94-1353-451e-81e2-bc2b3c443aef\") " pod="openshift-image-registry/node-ca-mklk5"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-sys\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739504    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52668d46-bc7a-467b-b228-1739e7837240-dbus\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739525    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/09767a94-1353-451e-81e2-bc2b3c443aef-serviceca\") pod \"node-ca-mklk5\" (UID: \"09767a94-1353-451e-81e2-bc2b3c443aef\") " pod="openshift-image-registry/node-ca-mklk5"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-sys\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739572    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qlpl\" (UniqueName: \"kubernetes.io/projected/c1f37fb3-f377-4226-b541-29e42c89c50b-kube-api-access-9qlpl\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2641c276-30f3-4887-8935-5baecd3a3ef7-hosts-file\") pod \"node-resolver-8w67g\" (UID: \"2641c276-30f3-4887-8935-5baecd3a3ef7\") " pod="openshift-dns/node-resolver-8w67g"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739630    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-tuned\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:27.739640    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:27.739697    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs podName:c1f37fb3-f377-4226-b541-29e42c89c50b nodeName:}" failed. No retries permitted until 2026-07-29 19:00:28.239681837 +0000 UTC m=+3.084411787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs") pod "network-metrics-daemon-ts6wm" (UID: "c1f37fb3-f377-4226-b541-29e42c89c50b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739752    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2641c276-30f3-4887-8935-5baecd3a3ef7-hosts-file\") pod \"node-resolver-8w67g\" (UID: \"2641c276-30f3-4887-8935-5baecd3a3ef7\") " pod="openshift-dns/node-resolver-8w67g"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.739904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/028e766d-fc88-4f58-a69e-7c02dff9a90a-konnectivity-ca\") pod \"konnectivity-agent-4x2jv\" (UID: \"028e766d-fc88-4f58-a69e-7c02dff9a90a\") " pod="kube-system/konnectivity-agent-4x2jv"
Jul 29 19:00:27.740876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.740026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/09767a94-1353-451e-81e2-bc2b3c443aef-serviceca\") pod \"node-ca-mklk5\" (UID: \"09767a94-1353-451e-81e2-bc2b3c443aef\") " pod="openshift-image-registry/node-ca-mklk5"
Jul 29 19:00:27.741692 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.741674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-tmp\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.741847 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.741832    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-etc-tuned\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.742194 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.742173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/028e766d-fc88-4f58-a69e-7c02dff9a90a-agent-certs\") pod \"konnectivity-agent-4x2jv\" (UID: \"028e766d-fc88-4f58-a69e-7c02dff9a90a\") " pod="kube-system/konnectivity-agent-4x2jv"
Jul 29 19:00:27.744746 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:27.744729    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:00:27.744746 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:27.744748    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:00:27.744867 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:27.744775    2563 projected.go:196] Error preparing data for projected volume kube-api-access-6p74x for pod openshift-network-diagnostics/network-check-target-ljwdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:00:27.744867 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:27.744856    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x podName:5891e0ee-ef9f-4b22-8f93-295c5356bee1 nodeName:}" failed. No retries permitted until 2026-07-29 19:00:28.244825701 +0000 UTC m=+3.089555665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6p74x" (UniqueName: "kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x") pod "network-check-target-ljwdk" (UID: "5891e0ee-ef9f-4b22-8f93-295c5356bee1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:00:27.747552 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.747524    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmx8z\" (UniqueName: \"kubernetes.io/projected/8e7aa574-8ddf-4744-91c6-1cc797a51e3b-kube-api-access-zmx8z\") pod \"tuned-5cgwc\" (UID: \"8e7aa574-8ddf-4744-91c6-1cc797a51e3b\") " pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.747882 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.747857    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qlpl\" (UniqueName: \"kubernetes.io/projected/c1f37fb3-f377-4226-b541-29e42c89c50b-kube-api-access-9qlpl\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:27.748274 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.748257    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcjhb\" (UniqueName: \"kubernetes.io/projected/09767a94-1353-451e-81e2-bc2b3c443aef-kube-api-access-gcjhb\") pod \"node-ca-mklk5\" (UID: \"09767a94-1353-451e-81e2-bc2b3c443aef\") " pod="openshift-image-registry/node-ca-mklk5"
Jul 29 19:00:27.748537 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.748519    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrfmh\" (UniqueName: \"kubernetes.io/projected/098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1-kube-api-access-hrfmh\") pod \"multus-additional-cni-plugins-4spp7\" (UID: \"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1\") " pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.748799 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.748779    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dswdp\" (UniqueName: \"kubernetes.io/projected/2641c276-30f3-4887-8935-5baecd3a3ef7-kube-api-access-dswdp\") pod \"node-resolver-8w67g\" (UID: \"2641c276-30f3-4887-8935-5baecd3a3ef7\") " pod="openshift-dns/node-resolver-8w67g"
Jul 29 19:00:27.831556 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.831475    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ztmqn"
Jul 29 19:00:27.844730 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.844702    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn"
Jul 29 19:00:27.853426 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.853405    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8qskb"
Jul 29 19:00:27.861108 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.861086    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:27.868803 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.868784    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4x2jv"
Jul 29 19:00:27.879906 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.879876    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:00:27.883960 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.883940    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8w67g"
Jul 29 19:00:27.890759 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.890742    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5cgwc"
Jul 29 19:00:27.898061 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.898041    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4spp7"
Jul 29 19:00:27.902442 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.902424    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mklk5"
Jul 29 19:00:27.977893 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:27.977865    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:00:28.243236 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.243156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:28.243236 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.243210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:28.243443 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:28.243307    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:00:28.243443 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:28.243385    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs podName:c1f37fb3-f377-4226-b541-29e42c89c50b nodeName:}" failed. No retries permitted until 2026-07-29 19:00:29.243354996 +0000 UTC m=+4.088084947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs") pod "network-metrics-daemon-ts6wm" (UID: "c1f37fb3-f377-4226-b541-29e42c89c50b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:00:28.243443 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:28.243307    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:00:28.243597 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:28.243449    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret podName:52668d46-bc7a-467b-b228-1739e7837240 nodeName:}" failed. No retries permitted until 2026-07-29 19:00:29.243435873 +0000 UTC m=+4.088165823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret") pod "global-pull-secret-syncer-kld88" (UID: "52668d46-bc7a-467b-b228-1739e7837240") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:00:28.343685 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.343648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p74x\" (UniqueName: \"kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x\") pod \"network-check-target-ljwdk\" (UID: \"5891e0ee-ef9f-4b22-8f93-295c5356bee1\") " pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:28.343844 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:28.343808    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:00:28.343844 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:28.343828    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:00:28.343844 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:28.343839    2563 projected.go:196] Error preparing data for projected volume kube-api-access-6p74x for pod openshift-network-diagnostics/network-check-target-ljwdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:00:28.343975 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:28.343899    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x podName:5891e0ee-ef9f-4b22-8f93-295c5356bee1 nodeName:}" failed. No retries permitted until 2026-07-29 19:00:29.343882789 +0000 UTC m=+4.188612741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6p74x" (UniqueName: "kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x") pod "network-check-target-ljwdk" (UID: "5891e0ee-ef9f-4b22-8f93-295c5356bee1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:00:28.557330 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:28.557304    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5807496_f027_48d9_9f4b_72ac56c2c89e.slice/crio-b05fb4b2dec7fea353d41b8fe6d9c3851e2271aa6d882cea66263cbee379f65f WatchSource:0}: Error finding container b05fb4b2dec7fea353d41b8fe6d9c3851e2271aa6d882cea66263cbee379f65f: Status 404 returned error can't find the container with id b05fb4b2dec7fea353d41b8fe6d9c3851e2271aa6d882cea66263cbee379f65f
Jul 29 19:00:28.559114 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:28.559087    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2641c276_30f3_4887_8935_5baecd3a3ef7.slice/crio-9423d15425c20300ce279e61bf38b09469558c1b0d3dfce40cf0efdc23deedf7 WatchSource:0}: Error finding container 9423d15425c20300ce279e61bf38b09469558c1b0d3dfce40cf0efdc23deedf7: Status 404 returned error can't find the container with id 9423d15425c20300ce279e61bf38b09469558c1b0d3dfce40cf0efdc23deedf7
Jul 29 19:00:28.560384 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:28.560252    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb190db6f_5f45_4637_ad4b_6894c2178c41.slice/crio-0b83b96c3d4f956efbc170b26d3f52ef33f9ba05ff42fa73a2643bca2606c82e WatchSource:0}: Error finding container 0b83b96c3d4f956efbc170b26d3f52ef33f9ba05ff42fa73a2643bca2606c82e: Status 404 returned error can't find the container with id 0b83b96c3d4f956efbc170b26d3f52ef33f9ba05ff42fa73a2643bca2606c82e
Jul 29 19:00:28.561802 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:28.561778    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a20398_cb08_4874_b693_faf517438ad0.slice/crio-ae71222babeac532f5c68cbb53b4d9b9a706ed13485643f4646e60705089e250 WatchSource:0}: Error finding container ae71222babeac532f5c68cbb53b4d9b9a706ed13485643f4646e60705089e250: Status 404 returned error can't find the container with id ae71222babeac532f5c68cbb53b4d9b9a706ed13485643f4646e60705089e250
Jul 29 19:00:28.563928 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:28.563849    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028e766d_fc88_4f58_a69e_7c02dff9a90a.slice/crio-62017ae5b472d25e65313d8714a53229105c980b0cd5dcab1de37966a322a9dd WatchSource:0}: Error finding container 62017ae5b472d25e65313d8714a53229105c980b0cd5dcab1de37966a322a9dd: Status 404 returned error can't find the container with id 62017ae5b472d25e65313d8714a53229105c980b0cd5dcab1de37966a322a9dd
Jul 29 19:00:28.564943 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:28.564773    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098ca0c9_b3ac_4b0a_a9a1_2c457a3ec5e1.slice/crio-a068de992ea863e1f06ea60148bee3a589aef21687ceb931ed84187a747751b6 WatchSource:0}: Error finding container a068de992ea863e1f06ea60148bee3a589aef21687ceb931ed84187a747751b6: Status 404 returned error can't find the container with id a068de992ea863e1f06ea60148bee3a589aef21687ceb931ed84187a747751b6
Jul 29 19:00:28.565813 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:28.565758    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09767a94_1353_451e_81e2_bc2b3c443aef.slice/crio-648cf0894ee5f02535cb217cda1ee2b071b11ce036c28918c77d19281e15a358 WatchSource:0}: Error finding container 648cf0894ee5f02535cb217cda1ee2b071b11ce036c28918c77d19281e15a358: Status 404 returned error can't find the container with id 648cf0894ee5f02535cb217cda1ee2b071b11ce036c28918c77d19281e15a358
Jul 29 19:00:28.565884 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.565838    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 18:55:27 +0000 UTC" deadline="2028-04-18 10:10:53.860692128 +0000 UTC"
Jul 29 19:00:28.565884 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.565866    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15087h10m25.294830385s"
Jul 29 19:00:28.567101 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:28.567077    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e7aa574_8ddf_4744_91c6_1cc797a51e3b.slice/crio-193a8ddadcfd861e91bde9fd922240220b0074abd501f3c95991b4eac66bdebf WatchSource:0}: Error finding container 193a8ddadcfd861e91bde9fd922240220b0074abd501f3c95991b4eac66bdebf: Status 404 returned error can't find the container with id 193a8ddadcfd861e91bde9fd922240220b0074abd501f3c95991b4eac66bdebf
Jul 29 19:00:28.568333 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:00:28.568222    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5643a1b8_f921_4bc4_862c_354928e54407.slice/crio-34d3a6a6f99982eaa820cc9bdb57279d5ead24a2d68775a7d51c01f2cabe0f4e WatchSource:0}: Error finding container 34d3a6a6f99982eaa820cc9bdb57279d5ead24a2d68775a7d51c01f2cabe0f4e: Status 404 returned error can't find the container with id 34d3a6a6f99982eaa820cc9bdb57279d5ead24a2d68775a7d51c01f2cabe0f4e
Jul 29 19:00:28.659005 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.658961    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:28.659137 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:28.659096    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:28.659137 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.659117    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:28.659249 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:28.659232    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:28.669303 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.669277    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p796x" event={"ID":"70a20398-cb08-4874-b693-faf517438ad0","Type":"ContainerStarted","Data":"ae71222babeac532f5c68cbb53b4d9b9a706ed13485643f4646e60705089e250"}
Jul 29 19:00:28.670428 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.670389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8qskb" event={"ID":"b190db6f-5f45-4637-ad4b-6894c2178c41","Type":"ContainerStarted","Data":"0b83b96c3d4f956efbc170b26d3f52ef33f9ba05ff42fa73a2643bca2606c82e"}
Jul 29 19:00:28.671571 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.671522    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8w67g" event={"ID":"2641c276-30f3-4887-8935-5baecd3a3ef7","Type":"ContainerStarted","Data":"9423d15425c20300ce279e61bf38b09469558c1b0d3dfce40cf0efdc23deedf7"}
Jul 29 19:00:28.672757 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.672735    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn" event={"ID":"d5807496-f027-48d9-9f4b-72ac56c2c89e","Type":"ContainerStarted","Data":"b05fb4b2dec7fea353d41b8fe6d9c3851e2271aa6d882cea66263cbee379f65f"}
Jul 29 19:00:28.673751 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.673729    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5cgwc" event={"ID":"8e7aa574-8ddf-4744-91c6-1cc797a51e3b","Type":"ContainerStarted","Data":"193a8ddadcfd861e91bde9fd922240220b0074abd501f3c95991b4eac66bdebf"}
Jul 29 19:00:28.674879 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.674847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4spp7" event={"ID":"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1","Type":"ContainerStarted","Data":"a068de992ea863e1f06ea60148bee3a589aef21687ceb931ed84187a747751b6"}
Jul 29 19:00:28.675845 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.675827    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4x2jv" event={"ID":"028e766d-fc88-4f58-a69e-7c02dff9a90a","Type":"ContainerStarted","Data":"62017ae5b472d25e65313d8714a53229105c980b0cd5dcab1de37966a322a9dd"}
Jul 29 19:00:28.677802 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.677612    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal" event={"ID":"cfe6536f353a8e0145bc66b1c5423231","Type":"ContainerStarted","Data":"1bc2e013cab471e2e22c93e743a2266aa8b83d01f87a498ccf11311605e0b185"}
Jul 29 19:00:28.681674 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.681556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ztmqn" event={"ID":"5643a1b8-f921-4bc4-862c-354928e54407","Type":"ContainerStarted","Data":"34d3a6a6f99982eaa820cc9bdb57279d5ead24a2d68775a7d51c01f2cabe0f4e"}
Jul 29 19:00:28.682652 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:28.682628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mklk5" event={"ID":"09767a94-1353-451e-81e2-bc2b3c443aef","Type":"ContainerStarted","Data":"648cf0894ee5f02535cb217cda1ee2b071b11ce036c28918c77d19281e15a358"}
Jul 29 19:00:29.252256 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:29.251728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:29.252256 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:29.251817    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:29.252256 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:29.251965    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:00:29.252256 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:29.252049    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs podName:c1f37fb3-f377-4226-b541-29e42c89c50b nodeName:}" failed. No retries permitted until 2026-07-29 19:00:31.252027589 +0000 UTC m=+6.096757544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs") pod "network-metrics-daemon-ts6wm" (UID: "c1f37fb3-f377-4226-b541-29e42c89c50b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:00:29.252626 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:29.252403    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:00:29.252626 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:29.252440    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret podName:52668d46-bc7a-467b-b228-1739e7837240 nodeName:}" failed. No retries permitted until 2026-07-29 19:00:31.252429952 +0000 UTC m=+6.097159903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret") pod "global-pull-secret-syncer-kld88" (UID: "52668d46-bc7a-467b-b228-1739e7837240") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:00:29.353100 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:29.353064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p74x\" (UniqueName: \"kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x\") pod \"network-check-target-ljwdk\" (UID: \"5891e0ee-ef9f-4b22-8f93-295c5356bee1\") " pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:29.353280 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:29.353227    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:00:29.353280 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:29.353248    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:00:29.353280 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:29.353261    2563 projected.go:196] Error preparing data for projected volume kube-api-access-6p74x for pod openshift-network-diagnostics/network-check-target-ljwdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:00:29.353430 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:29.353319    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x podName:5891e0ee-ef9f-4b22-8f93-295c5356bee1 nodeName:}" failed. No retries permitted until 2026-07-29 19:00:31.353301276 +0000 UTC m=+6.198031248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6p74x" (UniqueName: "kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x") pod "network-check-target-ljwdk" (UID: "5891e0ee-ef9f-4b22-8f93-295c5356bee1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:00:29.566932 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:29.566820    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 18:55:27 +0000 UTC" deadline="2027-12-28 20:34:52.949019917 +0000 UTC"
Jul 29 19:00:29.566932 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:29.566883    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12409h34m23.382140739s"
Jul 29 19:00:29.661067 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:29.661029    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:29.661236 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:29.661160    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:29.705356 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:29.704165    2563 generic.go:356] "Generic (PLEG): container finished" podID="632792feb0225915f638d426896756da" containerID="6046da21b10854f600491524b4a43524454d4fead2aadf957a403579c28c5b31" exitCode=0
Jul 29 19:00:29.705356 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:29.705124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" event={"ID":"632792feb0225915f638d426896756da","Type":"ContainerDied","Data":"6046da21b10854f600491524b4a43524454d4fead2aadf957a403579c28c5b31"}
Jul 29 19:00:29.724287 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:29.724222    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal" podStartSLOduration=3.724203788 podStartE2EDuration="3.724203788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:00:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:00:28.692219809 +0000 UTC m=+3.536949780" watchObservedRunningTime="2026-07-29 19:00:29.724203788 +0000 UTC m=+4.568933741"
Jul 29 19:00:30.658705 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:30.658671    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:30.659185 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:30.658828    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:30.659185 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:30.658919    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:30.659185 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:30.659010    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:30.731940 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:30.731904    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" event={"ID":"632792feb0225915f638d426896756da","Type":"ContainerStarted","Data":"a10ee13036afa0e928e9af2a2c3e13466901c2a3558a0abd998c531d6928344a"}
Jul 29 19:00:31.268827 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:31.268791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:31.269012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:31.268863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:31.269012 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:31.269003    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:00:31.269133 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:31.269067    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret podName:52668d46-bc7a-467b-b228-1739e7837240 nodeName:}" failed. No retries permitted until 2026-07-29 19:00:35.269048531 +0000 UTC m=+10.113778704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret") pod "global-pull-secret-syncer-kld88" (UID: "52668d46-bc7a-467b-b228-1739e7837240") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:00:31.269196 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:31.269135    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:00:31.269196 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:31.269168    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs podName:c1f37fb3-f377-4226-b541-29e42c89c50b nodeName:}" failed. No retries permitted until 2026-07-29 19:00:35.269157883 +0000 UTC m=+10.113887848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs") pod "network-metrics-daemon-ts6wm" (UID: "c1f37fb3-f377-4226-b541-29e42c89c50b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:00:31.370796 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:31.370204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p74x\" (UniqueName: \"kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x\") pod \"network-check-target-ljwdk\" (UID: \"5891e0ee-ef9f-4b22-8f93-295c5356bee1\") " pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:31.370796 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:31.370372    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:00:31.370796 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:31.370391    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:00:31.370796 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:31.370404    2563 projected.go:196] Error preparing data for projected volume kube-api-access-6p74x for pod openshift-network-diagnostics/network-check-target-ljwdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:00:31.370796 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:31.370461    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x podName:5891e0ee-ef9f-4b22-8f93-295c5356bee1 nodeName:}" failed. No retries permitted until 2026-07-29 19:00:35.370442458 +0000 UTC m=+10.215172414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6p74x" (UniqueName: "kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x") pod "network-check-target-ljwdk" (UID: "5891e0ee-ef9f-4b22-8f93-295c5356bee1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:00:31.659241 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:31.659066    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:31.659241 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:31.659195    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:32.658669 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:32.658635    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:32.658843 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:32.658751    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:32.659282 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:32.659094    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:32.659282 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:32.659211    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:33.658734 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:33.658698    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:33.658920 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:33.658829    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:34.659780 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:34.659125    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:34.659780 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:34.659272    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:34.659780 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:34.659641    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:34.659780 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:34.659732    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:35.304605 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:35.304487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:35.304605 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:35.304547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:35.304862 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:35.304654    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:00:35.304862 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:35.304659    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:00:35.304862 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:35.304716    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs podName:c1f37fb3-f377-4226-b541-29e42c89c50b nodeName:}" failed. No retries permitted until 2026-07-29 19:00:43.304696569 +0000 UTC m=+18.149426520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs") pod "network-metrics-daemon-ts6wm" (UID: "c1f37fb3-f377-4226-b541-29e42c89c50b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:00:35.304862 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:35.304736    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret podName:52668d46-bc7a-467b-b228-1739e7837240 nodeName:}" failed. No retries permitted until 2026-07-29 19:00:43.30472609 +0000 UTC m=+18.149456041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret") pod "global-pull-secret-syncer-kld88" (UID: "52668d46-bc7a-467b-b228-1739e7837240") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:00:35.405850 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:35.405382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p74x\" (UniqueName: \"kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x\") pod \"network-check-target-ljwdk\" (UID: \"5891e0ee-ef9f-4b22-8f93-295c5356bee1\") " pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:35.405850 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:35.405570    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:00:35.405850 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:35.405595    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:00:35.405850 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:35.405610    2563 projected.go:196] Error preparing data for projected volume kube-api-access-6p74x for pod openshift-network-diagnostics/network-check-target-ljwdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:00:35.405850 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:35.405670    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x podName:5891e0ee-ef9f-4b22-8f93-295c5356bee1 nodeName:}" failed. No retries permitted until 2026-07-29 19:00:43.405651156 +0000 UTC m=+18.250381129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6p74x" (UniqueName: "kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x") pod "network-check-target-ljwdk" (UID: "5891e0ee-ef9f-4b22-8f93-295c5356bee1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:00:35.660205 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:35.659653    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:35.660205 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:35.659775    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:36.658237 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:36.658200    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:36.658419 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:36.658343    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:36.658536 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:36.658515    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:36.658638 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:36.658618    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:37.658877 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:37.658827    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:37.659330 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:37.658947    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:38.658623 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:38.658591    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:38.658797 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:38.658717    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:38.658797 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:38.658775    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:38.658911 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:38.658892    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:39.658805 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:39.658773    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:39.658967 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:39.658916    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:40.658584 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:40.658551    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:40.658774 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:40.658683    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:40.658774 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:40.658743    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:40.658895 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:40.658881    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:41.659149 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:41.659118    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:41.659563 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:41.659233    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:42.658594 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:42.658560    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:42.658594 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:42.658590    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:42.658870 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:42.658702    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:42.658870 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:42.658835    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:43.368258 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:43.368231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:43.368651 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:43.368292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:43.368651 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:43.368388    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:00:43.368651 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:43.368446    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs podName:c1f37fb3-f377-4226-b541-29e42c89c50b nodeName:}" failed. No retries permitted until 2026-07-29 19:00:59.368432277 +0000 UTC m=+34.213162231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs") pod "network-metrics-daemon-ts6wm" (UID: "c1f37fb3-f377-4226-b541-29e42c89c50b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:00:43.368651 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:43.368388    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:00:43.368651 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:43.368520    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret podName:52668d46-bc7a-467b-b228-1739e7837240 nodeName:}" failed. No retries permitted until 2026-07-29 19:00:59.368507865 +0000 UTC m=+34.213237816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret") pod "global-pull-secret-syncer-kld88" (UID: "52668d46-bc7a-467b-b228-1739e7837240") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:00:43.469428 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:43.469396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p74x\" (UniqueName: \"kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x\") pod \"network-check-target-ljwdk\" (UID: \"5891e0ee-ef9f-4b22-8f93-295c5356bee1\") " pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:43.469581 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:43.469536    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:00:43.469581 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:43.469557    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:00:43.469581 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:43.469569    2563 projected.go:196] Error preparing data for projected volume kube-api-access-6p74x for pod openshift-network-diagnostics/network-check-target-ljwdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:00:43.469710 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:43.469629    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x podName:5891e0ee-ef9f-4b22-8f93-295c5356bee1 nodeName:}" failed. No retries permitted until 2026-07-29 19:00:59.469613138 +0000 UTC m=+34.314343088 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6p74x" (UniqueName: "kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x") pod "network-check-target-ljwdk" (UID: "5891e0ee-ef9f-4b22-8f93-295c5356bee1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:00:43.658671 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:43.658594    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:43.658831 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:43.658724    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:44.658784 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:44.658750    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:44.659287 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:44.658750    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:44.659287 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:44.658887    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:44.659287 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:44.658964    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:45.659816 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:45.659779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:45.660300 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:45.659886    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:46.659261 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:46.659223    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:46.659261 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:46.659259    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:46.659506 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:46.659362    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:46.659506 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:46.659482    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:47.659515 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.659213    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:47.660133 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:47.659599    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:47.766244 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.766216    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8w67g" event={"ID":"2641c276-30f3-4887-8935-5baecd3a3ef7","Type":"ContainerStarted","Data":"b501060f0dfe2ea0f4241ad8eb35d320dbc0f25a4b37d8ea48a856b9838310bb"}
Jul 29 19:00:47.767636 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.767602    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn" event={"ID":"d5807496-f027-48d9-9f4b-72ac56c2c89e","Type":"ContainerStarted","Data":"440608e70d4c217385879e246ae19a6adf6d81396e8aa002536966c325c11274"}
Jul 29 19:00:47.768979 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.768961    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5cgwc" event={"ID":"8e7aa574-8ddf-4744-91c6-1cc797a51e3b","Type":"ContainerStarted","Data":"2673bc8fc79c0c1f04d0a774c002b46ae7cae499175dfffc06ec5d3dbe97eae1"}
Jul 29 19:00:47.770621 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.770595    2563 generic.go:356] "Generic (PLEG): container finished" podID="098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1" containerID="2f5deffbaa582d69f2502b3f2c804eecae72d6bbd5f05316a907661ca863044d" exitCode=0
Jul 29 19:00:47.770730 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.770675    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4spp7" event={"ID":"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1","Type":"ContainerDied","Data":"2f5deffbaa582d69f2502b3f2c804eecae72d6bbd5f05316a907661ca863044d"}
Jul 29 19:00:47.772106 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.772085    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4x2jv" event={"ID":"028e766d-fc88-4f58-a69e-7c02dff9a90a","Type":"ContainerStarted","Data":"3978b147952d51576194913c68f4ff1144158b18839f69ed7b5cf227ff0ef39c"}
Jul 29 19:00:47.773447 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.773431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ztmqn" event={"ID":"5643a1b8-f921-4bc4-862c-354928e54407","Type":"ContainerStarted","Data":"be9bdfe18937d5ad8330b8e04fd20452871a8cbdc3c992e093e7eb022bc12741"}
Jul 29 19:00:47.774754 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.774737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mklk5" event={"ID":"09767a94-1353-451e-81e2-bc2b3c443aef","Type":"ContainerStarted","Data":"b573f27cd06b142e1f47beef1ef40a43814d0807d23054c1fe631084d5ba99c5"}
Jul 29 19:00:47.777083 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.777065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p796x" event={"ID":"70a20398-cb08-4874-b693-faf517438ad0","Type":"ContainerStarted","Data":"1eca33db67abc3de988411675af1ff3680569b9588a7d393286b0a6190ba326f"}
Jul 29 19:00:47.777155 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.777113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p796x" event={"ID":"70a20398-cb08-4874-b693-faf517438ad0","Type":"ContainerStarted","Data":"818d31e02ecdd932b8feb2e2db38f19aa5749a80b86efccd3040e813395b6129"}
Jul 29 19:00:47.777155 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.777146    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p796x" event={"ID":"70a20398-cb08-4874-b693-faf517438ad0","Type":"ContainerStarted","Data":"fecebd68c2b2d8cfc9dc4914f786ee45d42207941e7783d558e2ec23d22cf554"}
Jul 29 19:00:47.777225 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.777173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p796x" event={"ID":"70a20398-cb08-4874-b693-faf517438ad0","Type":"ContainerStarted","Data":"05bd8d1eef888e48145ff9a2b866fcf7ab037782e1e867c6ae63745c07228150"}
Jul 29 19:00:47.780495 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.780457    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" podStartSLOduration=21.780446903 podStartE2EDuration="21.780446903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:00:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:00:30.747876346 +0000 UTC m=+5.592606321" watchObservedRunningTime="2026-07-29 19:00:47.780446903 +0000 UTC m=+22.625176875"
Jul 29 19:00:47.780704 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.780686    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8w67g" podStartSLOduration=4.102565817 podStartE2EDuration="22.780681106s" totalImagesPullingTime="18.678115289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:00:47.780278183 +0000 UTC m=+22.625008157" watchObservedRunningTime="2026-07-29 19:00:47.780681106 +0000 UTC m=+22.625411078"
Jul 29 19:00:47.796311 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.796271    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ztmqn" podStartSLOduration=4.046907604 podStartE2EDuration="22.796256371s" totalImagesPullingTime="18.749348767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:00:47.7961176 +0000 UTC m=+22.640847573" watchObservedRunningTime="2026-07-29 19:00:47.796256371 +0000 UTC m=+22.640986344"
Jul 29 19:00:47.809359 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.809323    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4x2jv" podStartSLOduration=8.145439978 podStartE2EDuration="22.809313288s" totalImagesPullingTime="14.66387331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:00:47.808975555 +0000 UTC m=+22.653705528" watchObservedRunningTime="2026-07-29 19:00:47.809313288 +0000 UTC m=+22.654043260"
Jul 29 19:00:47.824702 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.824668    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5cgwc" podStartSLOduration=4.154338081 podStartE2EDuration="22.824657924s" totalImagesPullingTime="18.670319843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:00:47.824348223 +0000 UTC m=+22.669078193" watchObservedRunningTime="2026-07-29 19:00:47.824657924 +0000 UTC m=+22.669387897"
Jul 29 19:00:47.859822 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:47.859785    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mklk5" podStartSLOduration=4.189401892 podStartE2EDuration="22.859772607s" totalImagesPullingTime="18.670370715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:00:47.859568457 +0000 UTC m=+22.704298430" watchObservedRunningTime="2026-07-29 19:00:47.859772607 +0000 UTC m=+22.704502578"
Jul 29 19:00:48.658882 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:48.658802    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:48.658882 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:48.658844    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:48.659181 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:48.658948    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:48.659181 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:48.659068    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:48.782040 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:48.782005    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p796x" event={"ID":"70a20398-cb08-4874-b693-faf517438ad0","Type":"ContainerStarted","Data":"0d8818a1ae264ebb0d5ee2d7e626e92d8951cf6e6cec3465e2afd6f494839cba"}
Jul 29 19:00:48.782468 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:48.782087    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p796x" event={"ID":"70a20398-cb08-4874-b693-faf517438ad0","Type":"ContainerStarted","Data":"4b1a39d938d7b50a37bb7ff798c068a61baee790c5d071b6a30d2e604e004324"}
Jul 29 19:00:48.783432 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:48.783407    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8qskb" event={"ID":"b190db6f-5f45-4637-ad4b-6894c2178c41","Type":"ContainerStarted","Data":"710c57de5d75b2e1657ed2c892bc94de2ef7767d110e54fb9ac2c0e78fffcf9b"}
Jul 29 19:00:48.799364 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:48.799317    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8qskb" podStartSLOduration=5.123340643 podStartE2EDuration="23.799299082s" totalImagesPullingTime="18.675958439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:00:48.798558792 +0000 UTC m=+23.643288766" watchObservedRunningTime="2026-07-29 19:00:48.799299082 +0000 UTC m=+23.644029054"
Jul 29 19:00:49.575435 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:49.575407    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4x2jv"
Jul 29 19:00:49.575958 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:49.575939    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4x2jv"
Jul 29 19:00:49.592139 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:49.592106    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 19:00:49.613073 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:49.612908    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T19:00:49.592125942Z","UUID":"d739037c-d9ca-488c-bff7-8e23a584cd91","Handler":null,"Name":"","Endpoint":""}
Jul 29 19:00:49.614436 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:49.614408    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 19:00:49.614518 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:49.614446    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 19:00:49.658159 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:49.658135    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:49.658266 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:49.658243    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:49.787544 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:49.787460    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn" event={"ID":"d5807496-f027-48d9-9f4b-72ac56c2c89e","Type":"ContainerStarted","Data":"f0749b27b5e8bb0af71e3adf1bafc969d21c660065fa171f3770916cd6a47a42"}
Jul 29 19:00:49.787963 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:49.787637    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4x2jv"
Jul 29 19:00:49.788267 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:49.788249    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4x2jv"
Jul 29 19:00:50.659071 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:50.659035    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:50.659246 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:50.659038    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:50.659246 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:50.659145    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:50.659367 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:50.659233    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:50.795553 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:50.795512    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p796x" event={"ID":"70a20398-cb08-4874-b693-faf517438ad0","Type":"ContainerStarted","Data":"c3af7493c3a7ad9f28cc3ccd5bd3729da470696ccb7ef4588ea631d817556d5d"}
Jul 29 19:00:51.659177 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:51.658955    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:51.659359 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:51.659283    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:52.659047 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:52.658859    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:52.659802 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:52.658869    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:52.659802 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:52.659136    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:52.659802 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:52.659204    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:52.803292 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:52.803258    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p796x" event={"ID":"70a20398-cb08-4874-b693-faf517438ad0","Type":"ContainerStarted","Data":"760f5530ef652e19501074b64f3ffdfb7a62f32da6a237e664cdc6da24af81fc"}
Jul 29 19:00:52.803495 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:52.803476    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:52.805111 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:52.805087    2563 generic.go:356] "Generic (PLEG): container finished" podID="098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1" containerID="0a25da37ede03794a9e4b91a2be324f56def11b95c733b24cf004320974b2df0" exitCode=0
Jul 29 19:00:52.805208 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:52.805118    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4spp7" event={"ID":"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1","Type":"ContainerDied","Data":"0a25da37ede03794a9e4b91a2be324f56def11b95c733b24cf004320974b2df0"}
Jul 29 19:00:52.818932 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:52.818881    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:52.829705 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:52.829669    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p796x" podStartSLOduration=9.084441872 podStartE2EDuration="27.829657738s" totalImagesPullingTime="18.745215866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:00:52.829556939 +0000 UTC m=+27.674286911" watchObservedRunningTime="2026-07-29 19:00:52.829657738 +0000 UTC m=+27.674387709"
Jul 29 19:00:53.658247 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:53.658220    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:53.658424 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:53.658324    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:53.810854 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:53.810487    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn" event={"ID":"d5807496-f027-48d9-9f4b-72ac56c2c89e","Type":"ContainerStarted","Data":"7905bb0a90ffd1e63df0c5a3bfb393d077e31c4815d966331423f348f7b1fd7e"}
Jul 29 19:00:53.811551 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:53.811411    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:53.811551 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:53.811491    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:53.827713 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:53.827644    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:00:53.831611 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:53.831563    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jh9bn" podStartSLOduration=4.745999715 podStartE2EDuration="28.831550603s" totalImagesPullingTime="24.085550888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:00:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:00:53.831066783 +0000 UTC m=+28.675796755" watchObservedRunningTime="2026-07-29 19:00:53.831550603 +0000 UTC m=+28.676280610"
Jul 29 19:00:54.000869 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:54.000823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:00:54.101554 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:54.101476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:00:54.481097 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:54.481014    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ts6wm"]
Jul 29 19:00:54.481247 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:54.481157    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:54.481314 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:54.481273    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:54.487309 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:54.487279    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kld88"]
Jul 29 19:00:54.487476 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:54.487444    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:54.487573 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:54.487551    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:54.488002 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:54.487975    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ljwdk"]
Jul 29 19:00:54.488100 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:54.488083    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:54.488181 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:54.488164    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:54.814829 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:54.814751    2563 generic.go:356] "Generic (PLEG): container finished" podID="098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1" containerID="4732ef69c7f5fa0e121203e822ceeb553e25eb826992a35f30bdb592257d4849" exitCode=0
Jul 29 19:00:54.814829 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:54.814813    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4spp7" event={"ID":"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1","Type":"ContainerDied","Data":"4732ef69c7f5fa0e121203e822ceeb553e25eb826992a35f30bdb592257d4849"}
Jul 29 19:00:56.659327 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:56.659113    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:56.659750 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:56.659157    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:56.659750 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:56.659356    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:56.659750 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:56.659466    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:56.659750 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:56.659179    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:56.659750 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:56.659590    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:56.820759 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:56.820719    2563 generic.go:356] "Generic (PLEG): container finished" podID="098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1" containerID="af5424c393b2f27009a9d63a26bb84df0a63d8f03c8a0757b67eecb6973293d5" exitCode=0
Jul 29 19:00:56.820888 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:56.820774    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4spp7" event={"ID":"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1","Type":"ContainerDied","Data":"af5424c393b2f27009a9d63a26bb84df0a63d8f03c8a0757b67eecb6973293d5"}
Jul 29 19:00:57.408324 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:57.408252    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:00:57.491006 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:57.490973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:00:57.543609 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:57.543575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:00:57.870729 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:57.870659    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:00:57.972709 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:57.972682    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:00:58.453154 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:58.453122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:00:58.658807 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:58.658730    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:58.658961 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:58.658862    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:58.658961 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:58.658881    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwdk" podUID="5891e0ee-ef9f-4b22-8f93-295c5356bee1"
Jul 29 19:00:58.658961 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:58.658950    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kld88" podUID="52668d46-bc7a-467b-b228-1739e7837240"
Jul 29 19:00:58.659142 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:58.659007    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:58.659142 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:58.659075    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:00:58.825533 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:58.825505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:00:58.874782 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:58.874741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:00:59.384605 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:59.384573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:00:59.384811 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:59.384615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:00:59.384811 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:59.384698    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:00:59.384811 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:59.384746    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret podName:52668d46-bc7a-467b-b228-1739e7837240 nodeName:}" failed. No retries permitted until 2026-07-29 19:01:31.384731997 +0000 UTC m=+66.229461947 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret") pod "global-pull-secret-syncer-kld88" (UID: "52668d46-bc7a-467b-b228-1739e7837240") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:00:59.384811 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:59.384759    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:00:59.384811 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:59.384806    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs podName:c1f37fb3-f377-4226-b541-29e42c89c50b nodeName:}" failed. No retries permitted until 2026-07-29 19:01:31.384791771 +0000 UTC m=+66.229521721 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs") pod "network-metrics-daemon-ts6wm" (UID: "c1f37fb3-f377-4226-b541-29e42c89c50b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:00:59.398089 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:59.398063    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:00:59.485348 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:59.485321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p74x\" (UniqueName: \"kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x\") pod \"network-check-target-ljwdk\" (UID: \"5891e0ee-ef9f-4b22-8f93-295c5356bee1\") " pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:00:59.485467 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:59.485455    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:00:59.485511 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:59.485471    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:00:59.485511 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:59.485480    2563 projected.go:196] Error preparing data for projected volume kube-api-access-6p74x for pod openshift-network-diagnostics/network-check-target-ljwdk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:00:59.485572 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:00:59.485526    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x podName:5891e0ee-ef9f-4b22-8f93-295c5356bee1 nodeName:}" failed. No retries permitted until 2026-07-29 19:01:31.485511813 +0000 UTC m=+66.330241764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6p74x" (UniqueName: "kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x") pod "network-check-target-ljwdk" (UID: "5891e0ee-ef9f-4b22-8f93-295c5356bee1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:00:59.498876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:59.498852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:00:59.999864 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:59.999791    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeReady"
Jul 29 19:01:00.000443 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:00:59.999936    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 19:01:00.041851 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.041820    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f8mw5"]
Jul 29 19:01:00.043767 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.043739    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:00.045024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.044973    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hnc98"]
Jul 29 19:01:00.046216 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.046198    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7dnhc\""
Jul 29 19:01:00.046469 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.046456    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 19:01:00.046550 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.046517    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 19:01:00.046652 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.046638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hnc98"
Jul 29 19:01:00.050244 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.050090    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 19:01:00.050244 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.050106    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2wk54\""
Jul 29 19:01:00.050244 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.050129    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 19:01:00.050244 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.050097    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 19:01:00.059419 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.059399    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f8mw5"]
Jul 29 19:01:00.059567 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.059555    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hnc98"]
Jul 29 19:01:00.164999 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.164953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:00.191475 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.191445    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwfs7\" (UniqueName: \"kubernetes.io/projected/b7e65e6f-91cd-4f99-a3c8-24370c517877-kube-api-access-kwfs7\") pod \"ingress-canary-hnc98\" (UID: \"b7e65e6f-91cd-4f99-a3c8-24370c517877\") " pod="openshift-ingress-canary/ingress-canary-hnc98"
Jul 29 19:01:00.191634 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.191499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7e65e6f-91cd-4f99-a3c8-24370c517877-cert\") pod \"ingress-canary-hnc98\" (UID: \"b7e65e6f-91cd-4f99-a3c8-24370c517877\") " pod="openshift-ingress-canary/ingress-canary-hnc98"
Jul 29 19:01:00.191634 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.191599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q96dz\" (UniqueName: \"kubernetes.io/projected/bf416666-de96-435e-a000-b4fa34920d59-kube-api-access-q96dz\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:00.191739 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.191646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf416666-de96-435e-a000-b4fa34920d59-tmp-dir\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:00.191739 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.191678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf416666-de96-435e-a000-b4fa34920d59-config-volume\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:00.191739 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.191704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:00.292296 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.292228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwfs7\" (UniqueName: \"kubernetes.io/projected/b7e65e6f-91cd-4f99-a3c8-24370c517877-kube-api-access-kwfs7\") pod \"ingress-canary-hnc98\" (UID: \"b7e65e6f-91cd-4f99-a3c8-24370c517877\") " pod="openshift-ingress-canary/ingress-canary-hnc98"
Jul 29 19:01:00.292296 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.292268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7e65e6f-91cd-4f99-a3c8-24370c517877-cert\") pod \"ingress-canary-hnc98\" (UID: \"b7e65e6f-91cd-4f99-a3c8-24370c517877\") " pod="openshift-ingress-canary/ingress-canary-hnc98"
Jul 29 19:01:00.292498 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.292317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q96dz\" (UniqueName: \"kubernetes.io/projected/bf416666-de96-435e-a000-b4fa34920d59-kube-api-access-q96dz\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:00.292498 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.292355    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf416666-de96-435e-a000-b4fa34920d59-tmp-dir\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:00.292498 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.292382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf416666-de96-435e-a000-b4fa34920d59-config-volume\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:00.292498 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.292403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:00.292498 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:00.292495    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:01:00.292735 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:00.292553    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls podName:bf416666-de96-435e-a000-b4fa34920d59 nodeName:}" failed. No retries permitted until 2026-07-29 19:01:00.792533475 +0000 UTC m=+35.637263444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls") pod "dns-default-f8mw5" (UID: "bf416666-de96-435e-a000-b4fa34920d59") : secret "dns-default-metrics-tls" not found
Jul 29 19:01:00.293319 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.293299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf416666-de96-435e-a000-b4fa34920d59-tmp-dir\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:00.293642 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.293618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf416666-de96-435e-a000-b4fa34920d59-config-volume\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:00.297042 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.297018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7e65e6f-91cd-4f99-a3c8-24370c517877-cert\") pod \"ingress-canary-hnc98\" (UID: \"b7e65e6f-91cd-4f99-a3c8-24370c517877\") " pod="openshift-ingress-canary/ingress-canary-hnc98"
Jul 29 19:01:00.301115 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.301092    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q96dz\" (UniqueName: \"kubernetes.io/projected/bf416666-de96-435e-a000-b4fa34920d59-kube-api-access-q96dz\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:00.301666 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.301648    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwfs7\" (UniqueName: \"kubernetes.io/projected/b7e65e6f-91cd-4f99-a3c8-24370c517877-kube-api-access-kwfs7\") pod \"ingress-canary-hnc98\" (UID: \"b7e65e6f-91cd-4f99-a3c8-24370c517877\") " pod="openshift-ingress-canary/ingress-canary-hnc98"
Jul 29 19:01:00.363707 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.363680    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hnc98"
Jul 29 19:01:00.413650 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.413381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:00.521634 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.521488    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hnc98"]
Jul 29 19:01:00.526304 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:01:00.526277    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e65e6f_91cd_4f99_a3c8_24370c517877.slice/crio-9e1552f0959ad4c6487334541ee2b6b5605976024a0b7663c2aca179077ff0b5 WatchSource:0}: Error finding container 9e1552f0959ad4c6487334541ee2b6b5605976024a0b7663c2aca179077ff0b5: Status 404 returned error can't find the container with id 9e1552f0959ad4c6487334541ee2b6b5605976024a0b7663c2aca179077ff0b5
Jul 29 19:01:00.658417 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.658324    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:01:00.658417 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.658323    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:01:00.658624 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.658421    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:01:00.660879 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.660858    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 19:01:00.661233 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.661217    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 19:01:00.662266 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.662250    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 19:01:00.662837 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.662709    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qh2tz\""
Jul 29 19:01:00.662837 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.662716    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 19:01:00.662837 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.662745    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qs6c5\""
Jul 29 19:01:00.795844 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.795809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:00.796028 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:00.795921    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:01:00.796028 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:00.795984    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls podName:bf416666-de96-435e-a000-b4fa34920d59 nodeName:}" failed. No retries permitted until 2026-07-29 19:01:01.795964768 +0000 UTC m=+36.640694725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls") pod "dns-default-f8mw5" (UID: "bf416666-de96-435e-a000-b4fa34920d59") : secret "dns-default-metrics-tls" not found
Jul 29 19:01:00.830954 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:00.830920    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hnc98" event={"ID":"b7e65e6f-91cd-4f99-a3c8-24370c517877","Type":"ContainerStarted","Data":"9e1552f0959ad4c6487334541ee2b6b5605976024a0b7663c2aca179077ff0b5"}
Jul 29 19:01:01.803287 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:01.803244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:01.803766 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:01.803477    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:01:01.803766 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:01.803551    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls podName:bf416666-de96-435e-a000-b4fa34920d59 nodeName:}" failed. No retries permitted until 2026-07-29 19:01:03.803530502 +0000 UTC m=+38.648260460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls") pod "dns-default-f8mw5" (UID: "bf416666-de96-435e-a000-b4fa34920d59") : secret "dns-default-metrics-tls" not found
Jul 29 19:01:02.609727 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:02.609686    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:02.675167 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:02.675130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:03.820766 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:03.820734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:03.821192 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:03.820910    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:01:03.821192 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:03.821004    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls podName:bf416666-de96-435e-a000-b4fa34920d59 nodeName:}" failed. No retries permitted until 2026-07-29 19:01:07.820964917 +0000 UTC m=+42.665694881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls") pod "dns-default-f8mw5" (UID: "bf416666-de96-435e-a000-b4fa34920d59") : secret "dns-default-metrics-tls" not found
Jul 29 19:01:04.843966 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:04.843741    2563 generic.go:356] "Generic (PLEG): container finished" podID="098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1" containerID="71c6d2a3f6231f8cfd5141f0016cf857c14070503150ab5c85d021cdcf54b1bf" exitCode=0
Jul 29 19:01:04.843966 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:04.843812    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4spp7" event={"ID":"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1","Type":"ContainerDied","Data":"71c6d2a3f6231f8cfd5141f0016cf857c14070503150ab5c85d021cdcf54b1bf"}
Jul 29 19:01:04.845595 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:04.845569    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hnc98" event={"ID":"b7e65e6f-91cd-4f99-a3c8-24370c517877","Type":"ContainerStarted","Data":"5bbf6b0aaf935a469d629da039f847bfa85ae19377d818eee699eaa360b2f1b7"}
Jul 29 19:01:04.882502 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:04.882453    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hnc98" podStartSLOduration=0.972615997 podStartE2EDuration="4.882436314s" totalImagesPullingTime="3.909820317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:01:04.881418634 +0000 UTC m=+39.726148607" watchObservedRunningTime="2026-07-29 19:01:04.882436314 +0000 UTC m=+39.727166286"
Jul 29 19:01:05.012277 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:05.012251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:05.062142 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:05.062112    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:05.850261 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:05.850226    2563 generic.go:356] "Generic (PLEG): container finished" podID="098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1" containerID="b0e7b92fc89503d77153387d8989bc1a43a21f5083ccd9ddaeb5ec121e2ffabd" exitCode=0
Jul 29 19:01:05.850627 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:05.850305    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4spp7" event={"ID":"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1","Type":"ContainerDied","Data":"b0e7b92fc89503d77153387d8989bc1a43a21f5083ccd9ddaeb5ec121e2ffabd"}
Jul 29 19:01:06.856088 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:06.856055    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4spp7" event={"ID":"098ca0c9-b3ac-4b0a-a9a1-2c457a3ec5e1","Type":"ContainerStarted","Data":"c797a3b967ca9b1ef7265200812bc4cad3973e2769f7ab43c19bec3247253463"}
Jul 29 19:01:06.878086 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:06.878043    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4spp7" podStartSLOduration=8.455315841 podStartE2EDuration="41.878028831s" totalImagesPullingTime="33.42271299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:00:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:01:06.876742162 +0000 UTC m=+41.721472134" watchObservedRunningTime="2026-07-29 19:01:06.878028831 +0000 UTC m=+41.722758802"
Jul 29 19:01:07.089912 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:07.089860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:07.292822 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:07.292795    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:07.848356 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:07.848323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:07.848519 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:07.848433    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:01:07.848519 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:07.848486    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls podName:bf416666-de96-435e-a000-b4fa34920d59 nodeName:}" failed. No retries permitted until 2026-07-29 19:01:15.848472814 +0000 UTC m=+50.693202765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls") pod "dns-default-f8mw5" (UID: "bf416666-de96-435e-a000-b4fa34920d59") : secret "dns-default-metrics-tls" not found
Jul 29 19:01:09.655765 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:09.655738    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:09.715339 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:09.715296    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:13.968367 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:13.968334    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:14.074809 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:14.074779    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:15.900392 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:15.900358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:15.900767 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:15.900496    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:01:15.900767 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:15.900548    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls podName:bf416666-de96-435e-a000-b4fa34920d59 nodeName:}" failed. No retries permitted until 2026-07-29 19:01:31.900534267 +0000 UTC m=+66.745264221 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls") pod "dns-default-f8mw5" (UID: "bf416666-de96-435e-a000-b4fa34920d59") : secret "dns-default-metrics-tls" not found
Jul 29 19:01:17.553340 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:17.553295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:17.655120 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:17.655084    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:19.841124 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:19.841092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:19.894651 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:19.894618    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:25.830481 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:25.830456    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p796x"
Jul 29 19:01:25.979136 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:25.979094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:26.078725 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:26.078702    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:31.395158 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.395104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:01:31.395158 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.395169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:01:31.400101 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.400077    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 19:01:31.400213 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.400103    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 19:01:31.406265 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:31.406245    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 19:01:31.406351 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:31.406330    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs podName:c1f37fb3-f377-4226-b541-29e42c89c50b nodeName:}" failed. No retries permitted until 2026-07-29 19:02:35.406308135 +0000 UTC m=+130.251038094 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs") pod "network-metrics-daemon-ts6wm" (UID: "c1f37fb3-f377-4226-b541-29e42c89c50b") : secret "metrics-daemon-secret" not found
Jul 29 19:01:31.409863 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.409847    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52668d46-bc7a-467b-b228-1739e7837240-original-pull-secret\") pod \"global-pull-secret-syncer-kld88\" (UID: \"52668d46-bc7a-467b-b228-1739e7837240\") " pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:01:31.496006 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.495968    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p74x\" (UniqueName: \"kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x\") pod \"network-check-target-ljwdk\" (UID: \"5891e0ee-ef9f-4b22-8f93-295c5356bee1\") " pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:01:31.498921 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.498906    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 19:01:31.509052 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.509033    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 19:01:31.519147 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.519129    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p74x\" (UniqueName: \"kubernetes.io/projected/5891e0ee-ef9f-4b22-8f93-295c5356bee1-kube-api-access-6p74x\") pod \"network-check-target-ljwdk\" (UID: \"5891e0ee-ef9f-4b22-8f93-295c5356bee1\") " pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:01:31.571149 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.571117    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kld88"
Jul 29 19:01:31.587664 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.587640    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qs6c5\""
Jul 29 19:01:31.595454 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.595435    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:01:31.701184 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.701155    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kld88"]
Jul 29 19:01:31.704316 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:01:31.704282    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52668d46_bc7a_467b_b228_1739e7837240.slice/crio-0926e624f3e0aec674425f4fb3ab00c748fe959038a6ee84dc92b718df1242d7 WatchSource:0}: Error finding container 0926e624f3e0aec674425f4fb3ab00c748fe959038a6ee84dc92b718df1242d7: Status 404 returned error can't find the container with id 0926e624f3e0aec674425f4fb3ab00c748fe959038a6ee84dc92b718df1242d7
Jul 29 19:01:31.718603 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.718571    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ljwdk"]
Jul 29 19:01:31.721505 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:01:31.721479    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5891e0ee_ef9f_4b22_8f93_295c5356bee1.slice/crio-1364722fd0058381401b87ef389c6c5359ce893e393202643659d311f149021d WatchSource:0}: Error finding container 1364722fd0058381401b87ef389c6c5359ce893e393202643659d311f149021d: Status 404 returned error can't find the container with id 1364722fd0058381401b87ef389c6c5359ce893e393202643659d311f149021d
Jul 29 19:01:31.915142 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.915111    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ljwdk" event={"ID":"5891e0ee-ef9f-4b22-8f93-295c5356bee1","Type":"ContainerStarted","Data":"1364722fd0058381401b87ef389c6c5359ce893e393202643659d311f149021d"}
Jul 29 19:01:31.916166 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:31.916145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kld88" event={"ID":"52668d46-bc7a-467b-b228-1739e7837240","Type":"ContainerStarted","Data":"0926e624f3e0aec674425f4fb3ab00c748fe959038a6ee84dc92b718df1242d7"}
Jul 29 19:01:32.000216 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:32.000189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:01:32.000320 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:32.000309    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:01:32.000367 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:01:32.000357    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls podName:bf416666-de96-435e-a000-b4fa34920d59 nodeName:}" failed. No retries permitted until 2026-07-29 19:02:04.000343672 +0000 UTC m=+98.845073634 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls") pod "dns-default-f8mw5" (UID: "bf416666-de96-435e-a000-b4fa34920d59") : secret "dns-default-metrics-tls" not found
Jul 29 19:01:35.487896 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:35.487847    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:35.591162 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:35.591126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:35.689557 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:35.689521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:01:36.930639 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:36.930600    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kld88" event={"ID":"52668d46-bc7a-467b-b228-1739e7837240","Type":"ContainerStarted","Data":"f2bb22f1cabff91b6d960c98b76199d8e489de8fdc8304787e3dcfbb11f374f6"}
Jul 29 19:01:36.946203 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:36.946151    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kld88" podStartSLOduration=67.777684008 podStartE2EDuration="1m11.946132139s" totalImagesPullingTime="4.168448131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:01:36.944788116 +0000 UTC m=+71.789518088" watchObservedRunningTime="2026-07-29 19:01:36.946132139 +0000 UTC m=+71.790862114"
Jul 29 19:01:38.937223 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:38.937181    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ljwdk" event={"ID":"5891e0ee-ef9f-4b22-8f93-295c5356bee1","Type":"ContainerStarted","Data":"af4c6b21a9e081b92f57aa59f8e7447d3e932fd633b9d718f256aea4ee3cb05a"}
Jul 29 19:01:38.937593 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:38.937313    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:01:38.952364 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:01:38.952319    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ljwdk" podStartSLOduration=67.498704467 podStartE2EDuration="1m13.952304743s" totalImagesPullingTime="6.453600276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:01:38.952267542 +0000 UTC m=+73.796997514" watchObservedRunningTime="2026-07-29 19:01:38.952304743 +0000 UTC m=+73.797034720"
Jul 29 19:02:04.100333 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:04.100298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:02:04.100670 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:02:04.100428    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:02:04.100670 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:02:04.100481    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls podName:bf416666-de96-435e-a000-b4fa34920d59 nodeName:}" failed. No retries permitted until 2026-07-29 19:03:08.100466089 +0000 UTC m=+162.945196038 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls") pod "dns-default-f8mw5" (UID: "bf416666-de96-435e-a000-b4fa34920d59") : secret "dns-default-metrics-tls" not found
Jul 29 19:02:06.892603 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:06.892567    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m"]
Jul 29 19:02:06.926296 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:06.926270    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m"
Jul 29 19:02:06.926436 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:06.926269    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"]
Jul 29 19:02:06.930191 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:06.930168    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 19:02:06.930191 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:06.930184    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-smkkw\""
Jul 29 19:02:06.930403 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:06.930183    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 29 19:02:06.930403 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:06.930224    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 19:02:06.930403 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:06.930228    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 19:02:06.939633 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:06.939607    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m"]
Jul 29 19:02:06.939633 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:06.939635    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"]
Jul 29 19:02:06.939767 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:06.939702    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:02:06.942107 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:06.942090    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 29 19:02:07.019619 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.019599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnbd2\" (UniqueName: \"kubernetes.io/projected/3fc51d82-ad14-4691-978c-d588dea6f7f8-kube-api-access-nnbd2\") pod \"managed-serviceaccount-addon-agent-5b6fb9856d-p824m\" (UID: \"3fc51d82-ad14-4691-978c-d588dea6f7f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m"
Jul 29 19:02:07.019738 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.019626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56019f92-8001-4f88-9a1c-3f1f9be65b41-tmp\") pod \"klusterlet-addon-workmgr-69996858fc-6dd6z\" (UID: \"56019f92-8001-4f88-9a1c-3f1f9be65b41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:02:07.019738 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.019652    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6psjj\" (UniqueName: \"kubernetes.io/projected/56019f92-8001-4f88-9a1c-3f1f9be65b41-kube-api-access-6psjj\") pod \"klusterlet-addon-workmgr-69996858fc-6dd6z\" (UID: \"56019f92-8001-4f88-9a1c-3f1f9be65b41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:02:07.019738 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.019671    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/56019f92-8001-4f88-9a1c-3f1f9be65b41-klusterlet-config\") pod \"klusterlet-addon-workmgr-69996858fc-6dd6z\" (UID: \"56019f92-8001-4f88-9a1c-3f1f9be65b41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:02:07.019869 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.019745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3fc51d82-ad14-4691-978c-d588dea6f7f8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b6fb9856d-p824m\" (UID: \"3fc51d82-ad14-4691-978c-d588dea6f7f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m"
Jul 29 19:02:07.120384 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.120362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnbd2\" (UniqueName: \"kubernetes.io/projected/3fc51d82-ad14-4691-978c-d588dea6f7f8-kube-api-access-nnbd2\") pod \"managed-serviceaccount-addon-agent-5b6fb9856d-p824m\" (UID: \"3fc51d82-ad14-4691-978c-d588dea6f7f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m"
Jul 29 19:02:07.120508 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.120395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56019f92-8001-4f88-9a1c-3f1f9be65b41-tmp\") pod \"klusterlet-addon-workmgr-69996858fc-6dd6z\" (UID: \"56019f92-8001-4f88-9a1c-3f1f9be65b41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:02:07.120508 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.120419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6psjj\" (UniqueName: \"kubernetes.io/projected/56019f92-8001-4f88-9a1c-3f1f9be65b41-kube-api-access-6psjj\") pod \"klusterlet-addon-workmgr-69996858fc-6dd6z\" (UID: \"56019f92-8001-4f88-9a1c-3f1f9be65b41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:02:07.120620 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.120522    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/56019f92-8001-4f88-9a1c-3f1f9be65b41-klusterlet-config\") pod \"klusterlet-addon-workmgr-69996858fc-6dd6z\" (UID: \"56019f92-8001-4f88-9a1c-3f1f9be65b41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:02:07.120620 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.120565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3fc51d82-ad14-4691-978c-d588dea6f7f8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b6fb9856d-p824m\" (UID: \"3fc51d82-ad14-4691-978c-d588dea6f7f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m"
Jul 29 19:02:07.120719 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.120705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56019f92-8001-4f88-9a1c-3f1f9be65b41-tmp\") pod \"klusterlet-addon-workmgr-69996858fc-6dd6z\" (UID: \"56019f92-8001-4f88-9a1c-3f1f9be65b41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:02:07.123022 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.122986    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3fc51d82-ad14-4691-978c-d588dea6f7f8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b6fb9856d-p824m\" (UID: \"3fc51d82-ad14-4691-978c-d588dea6f7f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m"
Jul 29 19:02:07.123105 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.123055    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/56019f92-8001-4f88-9a1c-3f1f9be65b41-klusterlet-config\") pod \"klusterlet-addon-workmgr-69996858fc-6dd6z\" (UID: \"56019f92-8001-4f88-9a1c-3f1f9be65b41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:02:07.128736 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.128718    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnbd2\" (UniqueName: \"kubernetes.io/projected/3fc51d82-ad14-4691-978c-d588dea6f7f8-kube-api-access-nnbd2\") pod \"managed-serviceaccount-addon-agent-5b6fb9856d-p824m\" (UID: \"3fc51d82-ad14-4691-978c-d588dea6f7f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m"
Jul 29 19:02:07.128823 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.128753    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6psjj\" (UniqueName: \"kubernetes.io/projected/56019f92-8001-4f88-9a1c-3f1f9be65b41-kube-api-access-6psjj\") pod \"klusterlet-addon-workmgr-69996858fc-6dd6z\" (UID: \"56019f92-8001-4f88-9a1c-3f1f9be65b41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:02:07.246796 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.246772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m"
Jul 29 19:02:07.253907 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.253883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:02:07.396470 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.396439    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m"]
Jul 29 19:02:07.408476 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:07.408447    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"]
Jul 29 19:02:07.417579 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:02:07.417550    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fc51d82_ad14_4691_978c_d588dea6f7f8.slice/crio-7302ae70ee77d6b9aac4aaf5647b9fab35aa6c7d6f36381808e453c8e83b2e99 WatchSource:0}: Error finding container 7302ae70ee77d6b9aac4aaf5647b9fab35aa6c7d6f36381808e453c8e83b2e99: Status 404 returned error can't find the container with id 7302ae70ee77d6b9aac4aaf5647b9fab35aa6c7d6f36381808e453c8e83b2e99
Jul 29 19:02:07.418050 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:02:07.418036    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56019f92_8001_4f88_9a1c_3f1f9be65b41.slice/crio-14a52caf0731642d5c3aa07cf1cd8c9443caecb03403521ba91d3e15f135bc6b WatchSource:0}: Error finding container 14a52caf0731642d5c3aa07cf1cd8c9443caecb03403521ba91d3e15f135bc6b: Status 404 returned error can't find the container with id 14a52caf0731642d5c3aa07cf1cd8c9443caecb03403521ba91d3e15f135bc6b
Jul 29 19:02:08.006167 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:08.006135    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z" event={"ID":"56019f92-8001-4f88-9a1c-3f1f9be65b41","Type":"ContainerStarted","Data":"14a52caf0731642d5c3aa07cf1cd8c9443caecb03403521ba91d3e15f135bc6b"}
Jul 29 19:02:08.007143 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:08.007109    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m" event={"ID":"3fc51d82-ad14-4691-978c-d588dea6f7f8","Type":"ContainerStarted","Data":"7302ae70ee77d6b9aac4aaf5647b9fab35aa6c7d6f36381808e453c8e83b2e99"}
Jul 29 19:02:09.943150 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:09.943083    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ljwdk"
Jul 29 19:02:11.232485 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:11.232442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:02:11.297277 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:11.297235    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:02:12.020967 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:12.020925    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z" event={"ID":"56019f92-8001-4f88-9a1c-3f1f9be65b41","Type":"ContainerStarted","Data":"e281d982795b1ce4f0b053f54c4e889f88d1674228e82291c49f1e112eeec38e"}
Jul 29 19:02:12.021153 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:12.021135    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:02:12.022540 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:12.022507    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m" event={"ID":"3fc51d82-ad14-4691-978c-d588dea6f7f8","Type":"ContainerStarted","Data":"2f005a77babbde6a33b7d42e33a8b50375246a496d47dbb84b71b230a797861e"}
Jul 29 19:02:12.022854 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:12.022837    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:02:12.038504 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:12.038458    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z" podStartSLOduration=1.844167176 podStartE2EDuration="6.038441078s" totalImagesPullingTime="4.194273902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:02:12.038303534 +0000 UTC m=+106.883033505" watchObservedRunningTime="2026-07-29 19:02:12.038441078 +0000 UTC m=+106.883171051"
Jul 29 19:02:12.068201 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:12.068163    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m" podStartSLOduration=1.885824809 podStartE2EDuration="6.068151809s" totalImagesPullingTime="4.182327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:02:12.067854002 +0000 UTC m=+106.912583974" watchObservedRunningTime="2026-07-29 19:02:12.068151809 +0000 UTC m=+106.912881780"
Jul 29 19:02:35.410231 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:02:35.410181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:02:35.410673 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:02:35.410340    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 19:02:35.410673 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:02:35.410419    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs podName:c1f37fb3-f377-4226-b541-29e42c89c50b nodeName:}" failed. No retries permitted until 2026-07-29 19:04:37.410400644 +0000 UTC m=+252.255130594 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs") pod "network-metrics-daemon-ts6wm" (UID: "c1f37fb3-f377-4226-b541-29e42c89c50b") : secret "metrics-daemon-secret" not found
Jul 29 19:03:03.058008 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:03:03.057942    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f8mw5" podUID="bf416666-de96-435e-a000-b4fa34920d59"
Jul 29 19:03:03.141318 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:03:03.141292    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:03:03.678801 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:03:03.678766    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:03:08.123803 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:03:08.123751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:03:08.124350 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:03:08.123927    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:03:08.124350 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:03:08.124052    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls podName:bf416666-de96-435e-a000-b4fa34920d59 nodeName:}" failed. No retries permitted until 2026-07-29 19:05:10.124026801 +0000 UTC m=+284.968756751 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls") pod "dns-default-f8mw5" (UID: "bf416666-de96-435e-a000-b4fa34920d59") : secret "dns-default-metrics-tls" not found
Jul 29 19:03:14.658955 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:03:14.658898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:04:11.361148 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:11.361116    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:12.022260 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:12.022159    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z" podUID="56019f92-8001-4f88-9a1c-3f1f9be65b41" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused"
Jul 29 19:04:12.302872 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:12.302801    2563 generic.go:356] "Generic (PLEG): container finished" podID="56019f92-8001-4f88-9a1c-3f1f9be65b41" containerID="e281d982795b1ce4f0b053f54c4e889f88d1674228e82291c49f1e112eeec38e" exitCode=1
Jul 29 19:04:12.302872 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:12.302860    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z" event={"ID":"56019f92-8001-4f88-9a1c-3f1f9be65b41","Type":"ContainerDied","Data":"e281d982795b1ce4f0b053f54c4e889f88d1674228e82291c49f1e112eeec38e"}
Jul 29 19:04:12.303228 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:12.303208    2563 scope.go:117] "RemoveContainer" containerID="e281d982795b1ce4f0b053f54c4e889f88d1674228e82291c49f1e112eeec38e"
Jul 29 19:04:12.304368 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:12.304337    2563 generic.go:356] "Generic (PLEG): container finished" podID="3fc51d82-ad14-4691-978c-d588dea6f7f8" containerID="2f005a77babbde6a33b7d42e33a8b50375246a496d47dbb84b71b230a797861e" exitCode=255
Jul 29 19:04:12.304472 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:12.304409    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m" event={"ID":"3fc51d82-ad14-4691-978c-d588dea6f7f8","Type":"ContainerDied","Data":"2f005a77babbde6a33b7d42e33a8b50375246a496d47dbb84b71b230a797861e"}
Jul 29 19:04:12.310320 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:12.310305    2563 scope.go:117] "RemoveContainer" containerID="2f005a77babbde6a33b7d42e33a8b50375246a496d47dbb84b71b230a797861e"
Jul 29 19:04:13.310442 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:13.310409    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z" event={"ID":"56019f92-8001-4f88-9a1c-3f1f9be65b41","Type":"ContainerStarted","Data":"a4c0da11636570a109278b951bfc630ba7159c9e992e99db5efbd9a562c460c6"}
Jul 29 19:04:13.310901 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:13.310666    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:04:13.311336 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:13.311312    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69996858fc-6dd6z"
Jul 29 19:04:13.312218 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:13.312197    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b6fb9856d-p824m" event={"ID":"3fc51d82-ad14-4691-978c-d588dea6f7f8","Type":"ContainerStarted","Data":"19b0b077710699ec4698111e31cbba7c067ac05d6a6248433912cacf3f7530dc"}
Jul 29 19:04:37.488647 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:37.488608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:04:37.489161 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:37.488765    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 19:04:37.489161 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:37.488832    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs podName:c1f37fb3-f377-4226-b541-29e42c89c50b nodeName:}" failed. No retries permitted until 2026-07-29 19:06:39.488816407 +0000 UTC m=+374.333546360 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs") pod "network-metrics-daemon-ts6wm" (UID: "c1f37fb3-f377-4226-b541-29e42c89c50b") : secret "metrics-daemon-secret" not found
Jul 29 19:04:39.466962 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.466930    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b8dd8f79f-j8jln"]
Jul 29 19:04:39.469720 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.469704    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:39.472284 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.472264    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 29 19:04:39.473062 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.473048    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 19:04:39.473649 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.473634    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lzdtv\""
Jul 29 19:04:39.473649 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.473643    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 29 19:04:39.473756 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.473688    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 29 19:04:39.474337 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.474320    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 19:04:39.474399 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.474320    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 29 19:04:39.487922 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.487900    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b8dd8f79f-j8jln"]
Jul 29 19:04:39.501100 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.501070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:39.501194 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.501107    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:39.501194 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.501130    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-default-certificate\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:39.501307 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.501203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8wps\" (UniqueName: \"kubernetes.io/projected/1172b25f-71d3-458d-8043-da0b367e9fb7-kube-api-access-k8wps\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:39.501307 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.501288    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-stats-auth\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:39.601826 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.601789    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-default-certificate\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:39.601968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.601850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8wps\" (UniqueName: \"kubernetes.io/projected/1172b25f-71d3-458d-8043-da0b367e9fb7-kube-api-access-k8wps\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:39.601968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.601870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-stats-auth\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:39.601968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.601894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:39.601968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.601908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:39.602207 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:39.602007    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 19:04:39.602207 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:39.602060    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs podName:1172b25f-71d3-458d-8043-da0b367e9fb7 nodeName:}" failed. No retries permitted until 2026-07-29 19:04:40.102046179 +0000 UTC m=+254.946776129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs") pod "router-default-6b8dd8f79f-j8jln" (UID: "1172b25f-71d3-458d-8043-da0b367e9fb7") : secret "router-metrics-certs-default" not found
Jul 29 19:04:39.602207 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:39.602104    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle podName:1172b25f-71d3-458d-8043-da0b367e9fb7 nodeName:}" failed. No retries permitted until 2026-07-29 19:04:40.102082105 +0000 UTC m=+254.946812069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle") pod "router-default-6b8dd8f79f-j8jln" (UID: "1172b25f-71d3-458d-8043-da0b367e9fb7") : configmap references non-existent config key: service-ca.crt
Jul 29 19:04:39.604483 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.604461    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-stats-auth\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:39.604534 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.604461    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-default-certificate\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:39.613330 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.613303    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8wps\" (UniqueName: \"kubernetes.io/projected/1172b25f-71d3-458d-8043-da0b367e9fb7-kube-api-access-k8wps\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:39.712195 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.712168    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:39.770596 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:39.770535    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:40.106582 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:40.106500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:40.106582 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:40.106531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:40.106735 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:40.106634    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 19:04:40.106735 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:40.106697    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle podName:1172b25f-71d3-458d-8043-da0b367e9fb7 nodeName:}" failed. No retries permitted until 2026-07-29 19:04:41.106673205 +0000 UTC m=+255.951403156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle") pod "router-default-6b8dd8f79f-j8jln" (UID: "1172b25f-71d3-458d-8043-da0b367e9fb7") : configmap references non-existent config key: service-ca.crt
Jul 29 19:04:40.106735 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:40.106726    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs podName:1172b25f-71d3-458d-8043-da0b367e9fb7 nodeName:}" failed. No retries permitted until 2026-07-29 19:04:41.106715876 +0000 UTC m=+255.951445827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs") pod "router-default-6b8dd8f79f-j8jln" (UID: "1172b25f-71d3-458d-8043-da0b367e9fb7") : secret "router-metrics-certs-default" not found
Jul 29 19:04:41.113036 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:41.112967    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:41.113036 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:41.113035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:41.113446 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:41.113130    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle podName:1172b25f-71d3-458d-8043-da0b367e9fb7 nodeName:}" failed. No retries permitted until 2026-07-29 19:04:43.113112134 +0000 UTC m=+257.957842084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle") pod "router-default-6b8dd8f79f-j8jln" (UID: "1172b25f-71d3-458d-8043-da0b367e9fb7") : configmap references non-existent config key: service-ca.crt
Jul 29 19:04:41.113446 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:41.113136    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 19:04:41.113446 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:41.113170    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs podName:1172b25f-71d3-458d-8043-da0b367e9fb7 nodeName:}" failed. No retries permitted until 2026-07-29 19:04:43.113163097 +0000 UTC m=+257.957893047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs") pod "router-default-6b8dd8f79f-j8jln" (UID: "1172b25f-71d3-458d-8043-da0b367e9fb7") : secret "router-metrics-certs-default" not found
Jul 29 19:04:42.001954 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:42.001921    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:42.194452 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:42.194421    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:43.128700 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:43.128665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:43.128700 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:43.128701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:43.129065 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:43.128787    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 19:04:43.129065 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:43.128826    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle podName:1172b25f-71d3-458d-8043-da0b367e9fb7 nodeName:}" failed. No retries permitted until 2026-07-29 19:04:47.128809001 +0000 UTC m=+261.973538951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle") pod "router-default-6b8dd8f79f-j8jln" (UID: "1172b25f-71d3-458d-8043-da0b367e9fb7") : configmap references non-existent config key: service-ca.crt
Jul 29 19:04:43.129065 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:43.128850    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs podName:1172b25f-71d3-458d-8043-da0b367e9fb7 nodeName:}" failed. No retries permitted until 2026-07-29 19:04:47.128843266 +0000 UTC m=+261.973573217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs") pod "router-default-6b8dd8f79f-j8jln" (UID: "1172b25f-71d3-458d-8043-da0b367e9fb7") : secret "router-metrics-certs-default" not found
Jul 29 19:04:45.269056 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.269025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:45.353293 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.353267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:45.368801 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.368773    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qc2w8"]
Jul 29 19:04:45.372116 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.372102    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:45.374457 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.374430    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 19:04:45.374618 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.374590    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 19:04:45.375752 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.375730    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4lxqb\""
Jul 29 19:04:45.375853 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.375760    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 19:04:45.375853 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.375781    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 19:04:45.381722 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.381702    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qc2w8"]
Jul 29 19:04:45.421143 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.421124    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:45.442405 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.442387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:45.442483 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.442412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s42c\" (UniqueName: \"kubernetes.io/projected/2f631933-134e-4f16-9006-c1d944e83e8a-kube-api-access-4s42c\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:45.442483 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.442475    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f631933-134e-4f16-9006-c1d944e83e8a-crio-socket\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:45.442562 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.442549    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:45.442600 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.442577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f631933-134e-4f16-9006-c1d944e83e8a-data-volume\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:45.543288 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.543209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f631933-134e-4f16-9006-c1d944e83e8a-crio-socket\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:45.543288 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.543275    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:45.543444 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.543300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f631933-134e-4f16-9006-c1d944e83e8a-data-volume\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:45.543444 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.543323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:45.543444 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.543328    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f631933-134e-4f16-9006-c1d944e83e8a-crio-socket\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:45.543444 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:45.543336    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 19:04:45.543444 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.543338    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s42c\" (UniqueName: \"kubernetes.io/projected/2f631933-134e-4f16-9006-c1d944e83e8a-kube-api-access-4s42c\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:45.543444 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:45.543414    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm podName:2f631933-134e-4f16-9006-c1d944e83e8a nodeName:}" failed. No retries permitted until 2026-07-29 19:04:46.043393958 +0000 UTC m=+260.888123926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qc2w8" (UID: "2f631933-134e-4f16-9006-c1d944e83e8a") : configmap "kube-rbac-proxy" not found
Jul 29 19:04:45.543689 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:45.543450    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:04:45.543689 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:45.543514    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls podName:2f631933-134e-4f16-9006-c1d944e83e8a nodeName:}" failed. No retries permitted until 2026-07-29 19:04:46.043497975 +0000 UTC m=+260.888227930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qc2w8" (UID: "2f631933-134e-4f16-9006-c1d944e83e8a") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:04:45.543689 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.543657    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f631933-134e-4f16-9006-c1d944e83e8a-data-volume\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:45.551319 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.551299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s42c\" (UniqueName: \"kubernetes.io/projected/2f631933-134e-4f16-9006-c1d944e83e8a-kube-api-access-4s42c\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:45.705972 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.705939    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:45.769907 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.769883    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-hqbf8"]
Jul 29 19:04:45.772788 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.772773    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hqbf8"
Jul 29 19:04:45.775215 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.775188    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 29 19:04:45.775215 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.775192    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xzl4q\""
Jul 29 19:04:45.775416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.775309    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 29 19:04:45.782276 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.782259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-hqbf8"]
Jul 29 19:04:45.786158 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.786104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:45.836547 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.836487    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:45.844618 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.844587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p225x\" (UniqueName: \"kubernetes.io/projected/6805d1cc-921d-492c-b367-ca06d873e471-kube-api-access-p225x\") pod \"migrator-6865c9967-hqbf8\" (UID: \"6805d1cc-921d-492c-b367-ca06d873e471\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hqbf8"
Jul 29 19:04:45.945810 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.945788    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p225x\" (UniqueName: \"kubernetes.io/projected/6805d1cc-921d-492c-b367-ca06d873e471-kube-api-access-p225x\") pod \"migrator-6865c9967-hqbf8\" (UID: \"6805d1cc-921d-492c-b367-ca06d873e471\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hqbf8"
Jul 29 19:04:45.957174 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.957151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p225x\" (UniqueName: \"kubernetes.io/projected/6805d1cc-921d-492c-b367-ca06d873e471-kube-api-access-p225x\") pod \"migrator-6865c9967-hqbf8\" (UID: \"6805d1cc-921d-492c-b367-ca06d873e471\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hqbf8"
Jul 29 19:04:45.972035 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:45.972007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:46.047119 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:46.047095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:46.047211 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:46.047131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:46.047260 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:46.047206    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 19:04:46.047296 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:46.047261    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm podName:2f631933-134e-4f16-9006-c1d944e83e8a nodeName:}" failed. No retries permitted until 2026-07-29 19:04:47.047244997 +0000 UTC m=+261.891974947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qc2w8" (UID: "2f631933-134e-4f16-9006-c1d944e83e8a") : configmap "kube-rbac-proxy" not found
Jul 29 19:04:46.047296 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:46.047209    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:04:46.047387 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:46.047335    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls podName:2f631933-134e-4f16-9006-c1d944e83e8a nodeName:}" failed. No retries permitted until 2026-07-29 19:04:47.04731604 +0000 UTC m=+261.892046008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qc2w8" (UID: "2f631933-134e-4f16-9006-c1d944e83e8a") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:04:46.075028 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:46.074984    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:46.081075 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:46.081055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hqbf8"
Jul 29 19:04:46.198941 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:46.198912    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-hqbf8"]
Jul 29 19:04:46.201954 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:04:46.201929    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6805d1cc_921d_492c_b367_ca06d873e471.slice/crio-b9080b4d3bb2940c58b8d6a22780799f2fcdf6f58428ccb80d9728cbc86556fc WatchSource:0}: Error finding container b9080b4d3bb2940c58b8d6a22780799f2fcdf6f58428ccb80d9728cbc86556fc: Status 404 returned error can't find the container with id b9080b4d3bb2940c58b8d6a22780799f2fcdf6f58428ccb80d9728cbc86556fc
Jul 29 19:04:46.409923 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:46.409856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hqbf8" event={"ID":"6805d1cc-921d-492c-b367-ca06d873e471","Type":"ContainerStarted","Data":"b9080b4d3bb2940c58b8d6a22780799f2fcdf6f58428ccb80d9728cbc86556fc"}
Jul 29 19:04:47.053964 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:47.053918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:47.053964 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:47.053974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:47.054241 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:47.054056    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 19:04:47.054241 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:47.054109    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:04:47.054241 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:47.054117    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm podName:2f631933-134e-4f16-9006-c1d944e83e8a nodeName:}" failed. No retries permitted until 2026-07-29 19:04:49.054103726 +0000 UTC m=+263.898833676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qc2w8" (UID: "2f631933-134e-4f16-9006-c1d944e83e8a") : configmap "kube-rbac-proxy" not found
Jul 29 19:04:47.054241 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:47.054148    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls podName:2f631933-134e-4f16-9006-c1d944e83e8a nodeName:}" failed. No retries permitted until 2026-07-29 19:04:49.054137415 +0000 UTC m=+263.898867365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qc2w8" (UID: "2f631933-134e-4f16-9006-c1d944e83e8a") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:04:47.155218 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:47.155188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:47.155218 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:47.155220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:47.155377 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:47.155336    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 19:04:47.155377 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:47.155344    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle podName:1172b25f-71d3-458d-8043-da0b367e9fb7 nodeName:}" failed. No retries permitted until 2026-07-29 19:04:55.155327821 +0000 UTC m=+270.000057771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle") pod "router-default-6b8dd8f79f-j8jln" (UID: "1172b25f-71d3-458d-8043-da0b367e9fb7") : configmap references non-existent config key: service-ca.crt
Jul 29 19:04:47.155377 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:47.155370    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs podName:1172b25f-71d3-458d-8043-da0b367e9fb7 nodeName:}" failed. No retries permitted until 2026-07-29 19:04:55.155360612 +0000 UTC m=+270.000090563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs") pod "router-default-6b8dd8f79f-j8jln" (UID: "1172b25f-71d3-458d-8043-da0b367e9fb7") : secret "router-metrics-certs-default" not found
Jul 29 19:04:47.335620 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:47.335539    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8w67g_2641c276-30f3-4887-8935-5baecd3a3ef7/dns-node-resolver/0.log"
Jul 29 19:04:47.600332 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:47.600260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:48.335679 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:48.335639    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mklk5_09767a94-1353-451e-81e2-bc2b3c443aef/node-ca/0.log"
Jul 29 19:04:48.480869 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:48.480835    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:48.935573 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:48.935541    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hnc98_b7e65e6f-91cd-4f99-a3c8-24370c517877/serve-healthcheck-canary/0.log"
Jul 29 19:04:49.069505 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:49.069480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:49.069599 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:49.069545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:49.069599 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:49.069587    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 19:04:49.069665 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:49.069655    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm podName:2f631933-134e-4f16-9006-c1d944e83e8a nodeName:}" failed. No retries permitted until 2026-07-29 19:04:53.069634728 +0000 UTC m=+267.914364695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qc2w8" (UID: "2f631933-134e-4f16-9006-c1d944e83e8a") : configmap "kube-rbac-proxy" not found
Jul 29 19:04:49.069705 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:49.069674    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:04:49.069737 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:49.069713    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls podName:2f631933-134e-4f16-9006-c1d944e83e8a nodeName:}" failed. No retries permitted until 2026-07-29 19:04:53.069701152 +0000 UTC m=+267.914431108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qc2w8" (UID: "2f631933-134e-4f16-9006-c1d944e83e8a") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:04:49.317951 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:49.317880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:49.419243 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:49.419211    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:49.423505 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:49.423482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hqbf8" event={"ID":"6805d1cc-921d-492c-b367-ca06d873e471","Type":"ContainerStarted","Data":"be4694852adde418d53503bd431d44677947866870ef31fa02e81b81a26f9db3"}
Jul 29 19:04:49.423604 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:49.423572    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hqbf8" event={"ID":"6805d1cc-921d-492c-b367-ca06d873e471","Type":"ContainerStarted","Data":"5532e065768725112c77501e06bd6e63a7ab1ae8a9c5f0ba3f42deca86816715"}
Jul 29 19:04:49.454730 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:49.454691    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hqbf8" podStartSLOduration=1.633701477 podStartE2EDuration="4.4546788s" totalImagesPullingTime="2.820977323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:04:49.454418577 +0000 UTC m=+264.299148549" watchObservedRunningTime="2026-07-29 19:04:49.4546788 +0000 UTC m=+264.299408808"
Jul 29 19:04:49.503393 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:49.503371    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:49.564258 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:49.564236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:49.666036 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:49.666013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:49.725636 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:49.725607    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:50.424139 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:50.424100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:50.820151 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:50.820069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:51.144674 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:51.144590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:51.246005 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:51.245960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:51.972234 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:51.972207    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:52.073459 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:52.073435    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:52.228970 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:52.228873    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:52.821946 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:52.821919    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:53.097135 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:53.097057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:53.097135 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:53.097101    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:04:53.097530 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:53.097171    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 19:04:53.097530 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:53.097197    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:04:53.097530 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:53.097228    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm podName:2f631933-134e-4f16-9006-c1d944e83e8a nodeName:}" failed. No retries permitted until 2026-07-29 19:05:01.09721393 +0000 UTC m=+275.941943880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qc2w8" (UID: "2f631933-134e-4f16-9006-c1d944e83e8a") : configmap "kube-rbac-proxy" not found
Jul 29 19:04:53.097530 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:53.097302    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls podName:2f631933-134e-4f16-9006-c1d944e83e8a nodeName:}" failed. No retries permitted until 2026-07-29 19:05:01.097281146 +0000 UTC m=+275.942011103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qc2w8" (UID: "2f631933-134e-4f16-9006-c1d944e83e8a") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:04:53.265388 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:53.265358    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:53.560369 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:53.560339    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:53.660953 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:53.660925    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:53.761664 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:53.761634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:54.014520 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:54.014490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:54.213311 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:54.213280    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:54.615779 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:54.615752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:55.215111 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:55.215077    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:55.215111 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:55.215114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:55.215499 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:04:55.215241    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle podName:1172b25f-71d3-458d-8043-da0b367e9fb7 nodeName:}" failed. No retries permitted until 2026-07-29 19:05:11.215222328 +0000 UTC m=+286.059952278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle") pod "router-default-6b8dd8f79f-j8jln" (UID: "1172b25f-71d3-458d-8043-da0b367e9fb7") : configmap references non-existent config key: service-ca.crt
Jul 29 19:04:55.217507 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:55.217484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1172b25f-71d3-458d-8043-da0b367e9fb7-metrics-certs\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:04:55.226587 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:55.226561    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:55.724655 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:55.724605    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:55.825740 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:55.825710    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:56.013550 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:56.013482    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:56.217854 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:56.217828    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:56.615002 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:56.614958    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:57.214428 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:57.214399    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:57.615065 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:57.614960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:58.947197 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:58.947165    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:59.007912 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:59.007872    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:59.060729 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:59.060706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:59.416020 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:59.415979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:59.506824 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:59.506798    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:04:59.824146 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:04:59.824067    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:00.019203 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:00.019173    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:01.159333 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:01.159281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:05:01.159741 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:01.159372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:05:01.159855 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:01.159836    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f631933-134e-4f16-9006-c1d944e83e8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:05:01.161522 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:01.161493    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f631933-134e-4f16-9006-c1d944e83e8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qc2w8\" (UID: \"2f631933-134e-4f16-9006-c1d944e83e8a\") " pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:05:01.280925 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:01.280898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qc2w8"
Jul 29 19:05:01.400436 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:01.400408    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qc2w8"]
Jul 29 19:05:01.403540 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:05:01.403517    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f631933_134e_4f16_9006_c1d944e83e8a.slice/crio-ed80db9c4a8c21473e5e0ea73d09bd085f824d41e2bd8c4bcf535064ded6348e WatchSource:0}: Error finding container ed80db9c4a8c21473e5e0ea73d09bd085f824d41e2bd8c4bcf535064ded6348e: Status 404 returned error can't find the container with id ed80db9c4a8c21473e5e0ea73d09bd085f824d41e2bd8c4bcf535064ded6348e
Jul 29 19:05:01.457465 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:01.457439    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qc2w8" event={"ID":"2f631933-134e-4f16-9006-c1d944e83e8a","Type":"ContainerStarted","Data":"ed80db9c4a8c21473e5e0ea73d09bd085f824d41e2bd8c4bcf535064ded6348e"}
Jul 29 19:05:02.610866 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:02.610794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:02.666666 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:02.666633    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:06.142777 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:05:06.142736    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f8mw5" podUID="bf416666-de96-435e-a000-b4fa34920d59"
Jul 29 19:05:06.475246 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:06.475219    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:05:06.475246 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:06.475226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qc2w8" event={"ID":"2f631933-134e-4f16-9006-c1d944e83e8a","Type":"ContainerStarted","Data":"7ba79472125968374e029e7e5a5e31f54366746619e40353a88b284099582545"}
Jul 29 19:05:06.920690 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:06.920645    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:07.021464 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:07.021425    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:08.323771 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:08.323739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:08.425585 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:08.425547    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:08.611777 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:08.611704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:08.660233 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:08.660203    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:08.981980 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:08.981944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:09.082971 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:09.082941    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:09.353050 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:09.352970    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:10.130042 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.129949    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:05:10.132340 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.132316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf416666-de96-435e-a000-b4fa34920d59-metrics-tls\") pod \"dns-default-f8mw5\" (UID: \"bf416666-de96-435e-a000-b4fa34920d59\") " pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:05:10.216070 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.216044    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:10.253028 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.251592    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6645fdd8c7-4tf9l"]
Jul 29 19:05:10.255406 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.255389    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.258941 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.258919    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 19:05:10.259148 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.259132    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 19:05:10.260407 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.260389    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 19:05:10.260731 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.260711    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xdl87\""
Jul 29 19:05:10.266218 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.266199    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 19:05:10.276916 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.276895    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6645fdd8c7-4tf9l"]
Jul 29 19:05:10.327303 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.327268    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:10.331622 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.331603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53f4ee95-9177-4484-962f-307f8346032f-trusted-ca\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.331715 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.331660    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53f4ee95-9177-4484-962f-307f8346032f-ca-trust-extracted\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.331715 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.331691    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53f4ee95-9177-4484-962f-307f8346032f-bound-sa-token\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.331826 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.331736    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53f4ee95-9177-4484-962f-307f8346032f-registry-certificates\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.331826 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.331781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53f4ee95-9177-4484-962f-307f8346032f-installation-pull-secrets\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.331904 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.331868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rbb9\" (UniqueName: \"kubernetes.io/projected/53f4ee95-9177-4484-962f-307f8346032f-kube-api-access-2rbb9\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.331904 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.331889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53f4ee95-9177-4484-962f-307f8346032f-registry-tls\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.331982 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.331910    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53f4ee95-9177-4484-962f-307f8346032f-image-registry-private-configuration\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.378637 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.378617    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7dnhc\""
Jul 29 19:05:10.387222 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.387172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:05:10.432484 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.432453    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53f4ee95-9177-4484-962f-307f8346032f-registry-tls\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.432561 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.432533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53f4ee95-9177-4484-962f-307f8346032f-image-registry-private-configuration\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.432606 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.432593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53f4ee95-9177-4484-962f-307f8346032f-trusted-ca\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.432677 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.432651    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53f4ee95-9177-4484-962f-307f8346032f-ca-trust-extracted\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.432842 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.432824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53f4ee95-9177-4484-962f-307f8346032f-bound-sa-token\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.432987 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.432971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53f4ee95-9177-4484-962f-307f8346032f-registry-certificates\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.433133 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.433117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53f4ee95-9177-4484-962f-307f8346032f-installation-pull-secrets\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.433256 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.433240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rbb9\" (UniqueName: \"kubernetes.io/projected/53f4ee95-9177-4484-962f-307f8346032f-kube-api-access-2rbb9\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.433735 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.433705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53f4ee95-9177-4484-962f-307f8346032f-ca-trust-extracted\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.434097 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.434073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53f4ee95-9177-4484-962f-307f8346032f-trusted-ca\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.434321 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.434299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53f4ee95-9177-4484-962f-307f8346032f-registry-certificates\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.436422 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.436387    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53f4ee95-9177-4484-962f-307f8346032f-installation-pull-secrets\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.436836 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.436814    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53f4ee95-9177-4484-962f-307f8346032f-image-registry-private-configuration\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.437157 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.437135    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53f4ee95-9177-4484-962f-307f8346032f-registry-tls\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.444426 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.444381    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rbb9\" (UniqueName: \"kubernetes.io/projected/53f4ee95-9177-4484-962f-307f8346032f-kube-api-access-2rbb9\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.445500 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.445474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53f4ee95-9177-4484-962f-307f8346032f-bound-sa-token\") pod \"image-registry-6645fdd8c7-4tf9l\" (UID: \"53f4ee95-9177-4484-962f-307f8346032f\") " pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.491096 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.491061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qc2w8" event={"ID":"2f631933-134e-4f16-9006-c1d944e83e8a","Type":"ContainerStarted","Data":"839981e6f5aae6e386e0df4c032270f728c94662fbdb0364ee69e677131093ce"}
Jul 29 19:05:10.514291 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.514260    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f8mw5"]
Jul 29 19:05:10.517783 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:05:10.517754    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf416666_de96_435e_a000_b4fa34920d59.slice/crio-0980faf904886a3ab6c0dc1b843861f162fc48779b90488dc0984fb0e1c54d01 WatchSource:0}: Error finding container 0980faf904886a3ab6c0dc1b843861f162fc48779b90488dc0984fb0e1c54d01: Status 404 returned error can't find the container with id 0980faf904886a3ab6c0dc1b843861f162fc48779b90488dc0984fb0e1c54d01
Jul 29 19:05:10.564646 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.564620    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:10.707443 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:10.707413    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6645fdd8c7-4tf9l"]
Jul 29 19:05:10.712836 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:05:10.712806    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f4ee95_9177_4484_962f_307f8346032f.slice/crio-62bbda905e7f48160564fbd56be65d0db848a32c45776d96ee8c525e36f5eb7c WatchSource:0}: Error finding container 62bbda905e7f48160564fbd56be65d0db848a32c45776d96ee8c525e36f5eb7c: Status 404 returned error can't find the container with id 62bbda905e7f48160564fbd56be65d0db848a32c45776d96ee8c525e36f5eb7c
Jul 29 19:05:11.038607 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.038538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:11.101885 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.101848    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:11.239462 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.239414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:05:11.240130 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.240107    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1172b25f-71d3-458d-8043-da0b367e9fb7-service-ca-bundle\") pod \"router-default-6b8dd8f79f-j8jln\" (UID: \"1172b25f-71d3-458d-8043-da0b367e9fb7\") " pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:05:11.278646 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.278610    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:05:11.430111 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.430080    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b8dd8f79f-j8jln"]
Jul 29 19:05:11.434719 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:05:11.434689    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1172b25f_71d3_458d_8043_da0b367e9fb7.slice/crio-6271b928d47341ac10d206aeb6187747d561553ff02046a91076b075fab16bb6 WatchSource:0}: Error finding container 6271b928d47341ac10d206aeb6187747d561553ff02046a91076b075fab16bb6: Status 404 returned error can't find the container with id 6271b928d47341ac10d206aeb6187747d561553ff02046a91076b075fab16bb6
Jul 29 19:05:11.498026 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.497523    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l" event={"ID":"53f4ee95-9177-4484-962f-307f8346032f","Type":"ContainerStarted","Data":"33f79bf9fa38cf8837f6849f05866212e73d34d6264f66046e543de5485e3053"}
Jul 29 19:05:11.498026 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.497592    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l" event={"ID":"53f4ee95-9177-4484-962f-307f8346032f","Type":"ContainerStarted","Data":"62bbda905e7f48160564fbd56be65d0db848a32c45776d96ee8c525e36f5eb7c"}
Jul 29 19:05:11.498026 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.497683    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:11.499044 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.499017    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8mw5" event={"ID":"bf416666-de96-435e-a000-b4fa34920d59","Type":"ContainerStarted","Data":"0980faf904886a3ab6c0dc1b843861f162fc48779b90488dc0984fb0e1c54d01"}
Jul 29 19:05:11.501449 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.501419    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b8dd8f79f-j8jln" event={"ID":"1172b25f-71d3-458d-8043-da0b367e9fb7","Type":"ContainerStarted","Data":"6271b928d47341ac10d206aeb6187747d561553ff02046a91076b075fab16bb6"}
Jul 29 19:05:11.522751 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.522648    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l" podStartSLOduration=1.5226351679999999 podStartE2EDuration="1.522635168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:05:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:05:11.522225028 +0000 UTC m=+286.366955001" watchObservedRunningTime="2026-07-29 19:05:11.522635168 +0000 UTC m=+286.367365139"
Jul 29 19:05:11.544173 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.544124    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b8dd8f79f-j8jln" podStartSLOduration=32.544110076 podStartE2EDuration="32.544110076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:04:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:05:11.543143867 +0000 UTC m=+286.387873842" watchObservedRunningTime="2026-07-29 19:05:11.544110076 +0000 UTC m=+286.388840049"
Jul 29 19:05:11.566587 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.566514    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:11.669958 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:11.669928    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:12.278902 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:12.278853    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:05:12.282164 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:12.282142    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:05:12.507047 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:12.507008    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b8dd8f79f-j8jln" event={"ID":"1172b25f-71d3-458d-8043-da0b367e9fb7","Type":"ContainerStarted","Data":"f5b62927aaa728ee716aa843de981684986e564c664cd23c8628179ddaf3143a"}
Jul 29 19:05:12.507492 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:12.507398    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:05:12.508647 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:12.508623    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b8dd8f79f-j8jln"
Jul 29 19:05:14.515899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:14.515862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8mw5" event={"ID":"bf416666-de96-435e-a000-b4fa34920d59","Type":"ContainerStarted","Data":"135b412bfeea66c85bb5c54cd8bf917ff75e6a075b1cf1fdb436c2ad0eeadff8"}
Jul 29 19:05:14.516363 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:14.516028    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:05:14.516363 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:14.516093    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8mw5" event={"ID":"bf416666-de96-435e-a000-b4fa34920d59","Type":"ContainerStarted","Data":"ad143c17cd968ef8c75bba91a287ebfe7d19d78896fb25ffaae304e92fb4889d"}
Jul 29 19:05:14.518007 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:14.517968    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qc2w8" event={"ID":"2f631933-134e-4f16-9006-c1d944e83e8a","Type":"ContainerStarted","Data":"e1c548df0efe9142283f909870e2a624dcb79586067418f3e52095e9a3c1d24f"}
Jul 29 19:05:14.532718 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:14.532676    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f8mw5" podStartSLOduration=251.015006652 podStartE2EDuration="4m14.532663913s" totalImagesPullingTime="3.517657261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:05:14.530938931 +0000 UTC m=+289.375668896" watchObservedRunningTime="2026-07-29 19:05:14.532663913 +0000 UTC m=+289.377393884"
Jul 29 19:05:14.546560 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:14.546511    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qc2w8" podStartSLOduration=17.013810122 podStartE2EDuration="29.546495309s" totalImagesPullingTime="12.532685187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:04:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:05:14.54595585 +0000 UTC m=+289.390685824" watchObservedRunningTime="2026-07-29 19:05:14.546495309 +0000 UTC m=+289.391225283"
Jul 29 19:05:16.070794 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:16.070761    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:16.209953 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:16.209919    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:16.314018 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:16.313973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:16.417935 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:16.417892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:17.662021 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:05:17.660087    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ts6wm" podUID="c1f37fb3-f377-4226-b541-29e42c89c50b"
Jul 29 19:05:18.327176 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:18.327144    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:18.378455 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:18.378431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:19.247164 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:19.247133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:19.307448 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:19.307425    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:19.457041 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:19.457003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:21.583828 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:21.583797    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:23.653138 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.653106    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rrgn8"]
Jul 29 19:05:23.657152 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.657133    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.659664 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.659640    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 19:05:23.660156 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.660139    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 19:05:23.660156 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.660149    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 19:05:23.660311 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.660146    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 19:05:23.660905 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.660884    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 19:05:23.661158 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.661138    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-58xhx\""
Jul 29 19:05:23.661229 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.661151    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 19:05:23.663765 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.663746    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"]
Jul 29 19:05:23.667847 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.667831    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.670193 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.670176    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vzd8j\""
Jul 29 19:05:23.670418 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.670403    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 29 19:05:23.670752 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.670738    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 29 19:05:23.670811 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.670741    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 29 19:05:23.677654 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.677635    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"]
Jul 29 19:05:23.827808 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.827776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7srq\" (UniqueName: \"kubernetes.io/projected/cfd18709-2511-4539-9633-3f6aefe7b480-kube-api-access-g7srq\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.827808 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.827811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e991238-d1bb-4e3e-a778-b5c462096033-sys\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.828050 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.827832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dx5l\" (UniqueName: \"kubernetes.io/projected/1e991238-d1bb-4e3e-a778-b5c462096033-kube-api-access-9dx5l\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.828050 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.827878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cfd18709-2511-4539-9633-3f6aefe7b480-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.828050 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.827919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e991238-d1bb-4e3e-a778-b5c462096033-root\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.828050 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.827948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-tls\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.828050 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.827975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfd18709-2511-4539-9633-3f6aefe7b480-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.828050 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.828010    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-wtmp\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.828050 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.828051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfd18709-2511-4539-9633-3f6aefe7b480-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.828345 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.828082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfd18709-2511-4539-9633-3f6aefe7b480-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.828345 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.828116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.828345 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.828144    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e991238-d1bb-4e3e-a778-b5c462096033-metrics-client-ca\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.828345 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.828164    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-accelerators-collector-config\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.828345 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.828211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cfd18709-2511-4539-9633-3f6aefe7b480-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.828345 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.828239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-textfile\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.929294 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e991238-d1bb-4e3e-a778-b5c462096033-metrics-client-ca\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.929431 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-accelerators-collector-config\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.929431 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cfd18709-2511-4539-9633-3f6aefe7b480-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.929431 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-textfile\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.929431 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7srq\" (UniqueName: \"kubernetes.io/projected/cfd18709-2511-4539-9633-3f6aefe7b480-kube-api-access-g7srq\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.929431 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e991238-d1bb-4e3e-a778-b5c462096033-sys\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.929672 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dx5l\" (UniqueName: \"kubernetes.io/projected/1e991238-d1bb-4e3e-a778-b5c462096033-kube-api-access-9dx5l\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.929672 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cfd18709-2511-4539-9633-3f6aefe7b480-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.929672 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e991238-d1bb-4e3e-a778-b5c462096033-root\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.929672 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-tls\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.929672 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfd18709-2511-4539-9633-3f6aefe7b480-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.929672 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-wtmp\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.930047 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfd18709-2511-4539-9633-3f6aefe7b480-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.930047 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929733    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-textfile\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.930047 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929740    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfd18709-2511-4539-9633-3f6aefe7b480-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.930047 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929776    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cfd18709-2511-4539-9633-3f6aefe7b480-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.930047 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.930047 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.929822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e991238-d1bb-4e3e-a778-b5c462096033-sys\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.930325 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.930061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-accelerators-collector-config\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.930325 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.930102    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e991238-d1bb-4e3e-a778-b5c462096033-root\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.930325 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.930169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cfd18709-2511-4539-9633-3f6aefe7b480-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.930325 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:05:23.930182    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 19:05:23.930325 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.930209    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e991238-d1bb-4e3e-a778-b5c462096033-metrics-client-ca\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.930325 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.930242    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-wtmp\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.930325 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:05:23.930270    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-tls podName:1e991238-d1bb-4e3e-a778-b5c462096033 nodeName:}" failed. No retries permitted until 2026-07-29 19:05:24.430250682 +0000 UTC m=+299.274980634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-tls") pod "node-exporter-rrgn8" (UID: "1e991238-d1bb-4e3e-a778-b5c462096033") : secret "node-exporter-tls" not found
Jul 29 19:05:23.930800 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.930776    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfd18709-2511-4539-9633-3f6aefe7b480-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.932028 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.932007    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.932089 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.932034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfd18709-2511-4539-9633-3f6aefe7b480-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.932160 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.932146    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfd18709-2511-4539-9633-3f6aefe7b480-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.941023 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.940980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7srq\" (UniqueName: \"kubernetes.io/projected/cfd18709-2511-4539-9633-3f6aefe7b480-kube-api-access-g7srq\") pod \"kube-state-metrics-56d9f944b4-9wdf5\" (UID: \"cfd18709-2511-4539-9633-3f6aefe7b480\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:23.941416 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.941396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dx5l\" (UniqueName: \"kubernetes.io/projected/1e991238-d1bb-4e3e-a778-b5c462096033-kube-api-access-9dx5l\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:23.975610 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:23.975588    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"
Jul 29 19:05:24.102590 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:24.102556    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5"]
Jul 29 19:05:24.106297 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:05:24.106267    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd18709_2511_4539_9633_3f6aefe7b480.slice/crio-47388c42b0f9bd70c527d3b4c33f58a6455f579d116be8ad652617592ee57475 WatchSource:0}: Error finding container 47388c42b0f9bd70c527d3b4c33f58a6455f579d116be8ad652617592ee57475: Status 404 returned error can't find the container with id 47388c42b0f9bd70c527d3b4c33f58a6455f579d116be8ad652617592ee57475
Jul 29 19:05:24.433921 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:24.433886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-tls\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:24.436091 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:24.436071    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e991238-d1bb-4e3e-a778-b5c462096033-node-exporter-tls\") pod \"node-exporter-rrgn8\" (UID: \"1e991238-d1bb-4e3e-a778-b5c462096033\") " pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:24.524568 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:24.524540    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f8mw5"
Jul 29 19:05:24.550621 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:24.550590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5" event={"ID":"cfd18709-2511-4539-9633-3f6aefe7b480","Type":"ContainerStarted","Data":"47388c42b0f9bd70c527d3b4c33f58a6455f579d116be8ad652617592ee57475"}
Jul 29 19:05:24.567009 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:24.566966    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rrgn8"
Jul 29 19:05:24.579262 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:05:24.579232    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e991238_d1bb_4e3e_a778_b5c462096033.slice/crio-5be8732cad2eb5c8336d41a0e0fada0f19ddcde4bba1972f9033dd16865791fb WatchSource:0}: Error finding container 5be8732cad2eb5c8336d41a0e0fada0f19ddcde4bba1972f9033dd16865791fb: Status 404 returned error can't find the container with id 5be8732cad2eb5c8336d41a0e0fada0f19ddcde4bba1972f9033dd16865791fb
Jul 29 19:05:25.555567 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:25.555536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrgn8" event={"ID":"1e991238-d1bb-4e3e-a778-b5c462096033","Type":"ContainerStarted","Data":"5be8732cad2eb5c8336d41a0e0fada0f19ddcde4bba1972f9033dd16865791fb"}
Jul 29 19:05:25.849400 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:25.849376    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 19:05:26.300624 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:26.300584    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:26.561595 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:26.561512    2563 generic.go:356] "Generic (PLEG): container finished" podID="1e991238-d1bb-4e3e-a778-b5c462096033" containerID="618f845b64f78032c52036c8a5ec0551e60fcc5a5c39d0989b4eeeda0c5b0a30" exitCode=0
Jul 29 19:05:26.562035 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:26.561596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrgn8" event={"ID":"1e991238-d1bb-4e3e-a778-b5c462096033","Type":"ContainerDied","Data":"618f845b64f78032c52036c8a5ec0551e60fcc5a5c39d0989b4eeeda0c5b0a30"}
Jul 29 19:05:26.564461 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:26.564317    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5" event={"ID":"cfd18709-2511-4539-9633-3f6aefe7b480","Type":"ContainerStarted","Data":"3b316f4c82f49f1dd585efa0936473794e5032b1a6bee4e0d99d7dadd0ea8bb8"}
Jul 29 19:05:26.564461 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:26.564366    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5" event={"ID":"cfd18709-2511-4539-9633-3f6aefe7b480","Type":"ContainerStarted","Data":"f1545bf1f30118f8f5ae16f2ee1090eb67849a3228d2af854d160bc4eeb60599"}
Jul 29 19:05:26.564461 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:26.564393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5" event={"ID":"cfd18709-2511-4539-9633-3f6aefe7b480","Type":"ContainerStarted","Data":"3a6b642a050dd0d184c5f8d03fe448a7ef00b7e57917ae9e11063eccc6e6d5a4"}
Jul 29 19:05:26.586842 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:26.586820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:26.597923 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:26.597881    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9wdf5" podStartSLOduration=1.835797291 podStartE2EDuration="3.597868789s" totalImagesPullingTime="1.762071498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:05:26.597114608 +0000 UTC m=+301.441844592" watchObservedRunningTime="2026-07-29 19:05:26.597868789 +0000 UTC m=+301.442598761"
Jul 29 19:05:26.687561 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:26.687536    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:26.774025 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:26.773977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:27.570152 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:27.570114    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrgn8" event={"ID":"1e991238-d1bb-4e3e-a778-b5c462096033","Type":"ContainerStarted","Data":"a914970b59b309bc7230b4071579842010fbcd24a98eefb2ecab46927795f919"}
Jul 29 19:05:27.570622 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:27.570177    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrgn8" event={"ID":"1e991238-d1bb-4e3e-a778-b5c462096033","Type":"ContainerStarted","Data":"be88c47cb5c37a72acf96e287386d19937a65c79a55ff017c1df4112f6b6a55b"}
Jul 29 19:05:27.588283 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:27.588238    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rrgn8" podStartSLOduration=3.606861726 podStartE2EDuration="4.588222803s" totalImagesPullingTime="911.759257ms" totalInitContainerRuntime="69.60182ms" isStatefulPod=true podCreationTimestamp="2026-07-29 19:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:05:27.586501618 +0000 UTC m=+302.431231591" watchObservedRunningTime="2026-07-29 19:05:27.588222803 +0000 UTC m=+302.432952805"
Jul 29 19:05:28.067013 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.064515    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-cddcd899c-ps2vj"]
Jul 29 19:05:28.067900 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.067883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.070569 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.070545    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 29 19:05:28.070684 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.070579    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 19:05:28.070684 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.070598    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 29 19:05:28.070813 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.070717    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-emfgtfgdck4rb\""
Jul 29 19:05:28.071576 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.071558    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zbmlx\""
Jul 29 19:05:28.071687 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.071561    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 29 19:05:28.077985 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.077957    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-cddcd899c-ps2vj"]
Jul 29 19:05:28.166935 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.166910    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-audit-log\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.167080 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.166947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-secret-metrics-server-tls\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.167080 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.166969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-secret-metrics-server-client-certs\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.167080 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.167058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-metrics-server-audit-profiles\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.167179 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.167092    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdjq9\" (UniqueName: \"kubernetes.io/projected/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-kube-api-access-gdjq9\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.167179 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.167137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.167179 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.167155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-client-ca-bundle\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.268169 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.268143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjq9\" (UniqueName: \"kubernetes.io/projected/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-kube-api-access-gdjq9\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.268239 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.268196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.268239 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.268220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-client-ca-bundle\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.268404 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.268251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-audit-log\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.268404 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.268282    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-secret-metrics-server-tls\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.268404 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.268308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-secret-metrics-server-client-certs\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.268404 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.268346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-metrics-server-audit-profiles\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.268787 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.268752    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-audit-log\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.268932 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.268911    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.269503 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.269476    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-metrics-server-audit-profiles\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.270757 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.270736    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-secret-metrics-server-client-certs\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.271209 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.271189    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-secret-metrics-server-tls\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.271300 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.271285    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-client-ca-bundle\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.276787 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.276767    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdjq9\" (UniqueName: \"kubernetes.io/projected/eca76a6d-3b3d-4e24-bae3-36509e61a1b5-kube-api-access-gdjq9\") pod \"metrics-server-cddcd899c-ps2vj\" (UID: \"eca76a6d-3b3d-4e24-bae3-36509e61a1b5\") " pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.378077 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.378021    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:28.418365 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.418307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:28.509154 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.509126    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-cddcd899c-ps2vj"]
Jul 29 19:05:28.512085 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:05:28.512048    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca76a6d_3b3d_4e24_bae3_36509e61a1b5.slice/crio-7486ef1f820e4d44026aa75e19a2ea73f47ec0ed535dc1f8e91593baa26b3e65 WatchSource:0}: Error finding container 7486ef1f820e4d44026aa75e19a2ea73f47ec0ed535dc1f8e91593baa26b3e65: Status 404 returned error can't find the container with id 7486ef1f820e4d44026aa75e19a2ea73f47ec0ed535dc1f8e91593baa26b3e65
Jul 29 19:05:28.512457 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.512431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:28.514375 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.514361    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:05:28.574557 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.574526    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj" event={"ID":"eca76a6d-3b3d-4e24-bae3-36509e61a1b5","Type":"ContainerStarted","Data":"7486ef1f820e4d44026aa75e19a2ea73f47ec0ed535dc1f8e91593baa26b3e65"}
Jul 29 19:05:28.617737 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.617715    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:28.719470 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.719442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:28.773125 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:28.773098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:29.441264 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.441227    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:29.473896 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.473866    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d5546ddb8-95w4l"]
Jul 29 19:05:29.477086 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.477060    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.479631 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.479599    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 19:05:29.479747 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.479667    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 19:05:29.481007 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.480974    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-plq5m\""
Jul 29 19:05:29.481120 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.481022    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 19:05:29.481120 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.481078    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 19:05:29.481284 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.481265    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 19:05:29.481349 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.481290    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 19:05:29.481404 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.481297    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 19:05:29.486912 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.486885    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 19:05:29.488127 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.488103    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d5546ddb8-95w4l"]
Jul 29 19:05:29.579663 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.579637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-config\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.580042 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.579669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-oauth-config\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.580042 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.579712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptqg2\" (UniqueName: \"kubernetes.io/projected/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-kube-api-access-ptqg2\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.580042 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.579749    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-service-ca\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.580042 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.579772    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-oauth-serving-cert\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.580042 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.579800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-serving-cert\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.580042 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.579833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-trusted-ca-bundle\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.680535 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.680508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-oauth-config\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.680706 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.680567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptqg2\" (UniqueName: \"kubernetes.io/projected/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-kube-api-access-ptqg2\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.680706 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.680600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-service-ca\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.680706 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.680632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-oauth-serving-cert\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.680706 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.680672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-serving-cert\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.680914 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.680720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-trusted-ca-bundle\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.681029 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.680976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-config\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.681725 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.681696    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-service-ca\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.681847 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.681726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-oauth-serving-cert\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.681847 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.681726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-trusted-ca-bundle\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.681847 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.681727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-config\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.683201 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.683179    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-oauth-config\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.683620 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.683593    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-serving-cert\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.688446 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.688422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptqg2\" (UniqueName: \"kubernetes.io/projected/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-kube-api-access-ptqg2\") pod \"console-7d5546ddb8-95w4l\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") " pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.788955 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.788888    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:29.871248 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:29.871222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:30.077244 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:30.077217    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d5546ddb8-95w4l"]
Jul 29 19:05:30.080664 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:05:30.080640    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec4e8fa4_1012_4f68_a9ea_ff9d376d42a3.slice/crio-d5f50754dda7b574c59bc97a7644b1b5572288e22b780cd1081f831bc2c1f799 WatchSource:0}: Error finding container d5f50754dda7b574c59bc97a7644b1b5572288e22b780cd1081f831bc2c1f799: Status 404 returned error can't find the container with id d5f50754dda7b574c59bc97a7644b1b5572288e22b780cd1081f831bc2c1f799
Jul 29 19:05:30.436878 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:30.436830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:30.582266 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:30.582232    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj" event={"ID":"eca76a6d-3b3d-4e24-bae3-36509e61a1b5","Type":"ContainerStarted","Data":"f072d70b52e7f9f1fb2c8c4ba62997281c75cd47ad3ac5ecb748591e0f28c484"}
Jul 29 19:05:30.583377 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:30.583353    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5546ddb8-95w4l" event={"ID":"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3","Type":"ContainerStarted","Data":"d5f50754dda7b574c59bc97a7644b1b5572288e22b780cd1081f831bc2c1f799"}
Jul 29 19:05:30.598211 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:30.598160    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj" podStartSLOduration=1.114992144 podStartE2EDuration="2.598142421s" totalImagesPullingTime="1.483150277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:05:30.597361721 +0000 UTC m=+305.442091693" watchObservedRunningTime="2026-07-29 19:05:30.598142421 +0000 UTC m=+305.442872395"
Jul 29 19:05:31.395534 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:31.395496    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:31.445348 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:31.445303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:31.659218 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:31.659126    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:05:32.512973 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:32.512945    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6645fdd8c7-4tf9l"
Jul 29 19:05:32.628425 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:32.628379    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:32.728511 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:32.728483    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:32.829412 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:32.829330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:32.929689 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:32.929654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:34.229661 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:34.229637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:34.291124 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:34.291095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:34.602795 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:34.602710    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5546ddb8-95w4l" event={"ID":"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3","Type":"ContainerStarted","Data":"a9795386889ec2034ad492f0f0e366c2508b9df17a666e1c14067769ecf15fa8"}
Jul 29 19:05:34.619606 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:34.619540    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d5546ddb8-95w4l" podStartSLOduration=1.987451193 podStartE2EDuration="5.619524803s" totalImagesPullingTime="3.63207361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:05:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:05:34.618576338 +0000 UTC m=+309.463306311" watchObservedRunningTime="2026-07-29 19:05:34.619524803 +0000 UTC m=+309.464254775"
Jul 29 19:05:39.789469 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:39.789438    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:39.789885 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:39.789488    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:39.794325 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:39.794303    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:40.626397 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:40.626372    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:05:41.620395 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:41.620362    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:41.675611 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:41.675575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:42.111216 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:42.111163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:42.163879 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:42.163853    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:47.604749 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:47.604718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:47.702781 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:47.702754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:48.378637 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:48.378604    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:48.378800 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:48.378666    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:05:48.629067 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:48.628976    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:48.690769 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:48.690736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:50.301100 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:50.301059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:05:50.401470 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:05:50.401440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:08.384223 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:08.384193    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:06:08.388184 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:08.388164    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-cddcd899c-ps2vj"
Jul 29 19:06:17.613967 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:17.613892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:17.680777 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:17.680746    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:34.863513 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:34.863469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:34.919617 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:34.919591    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:39.507124 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:39.507090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:06:39.509271 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:39.509250    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f37fb3-f377-4226-b541-29e42c89c50b-metrics-certs\") pod \"network-metrics-daemon-ts6wm\" (UID: \"c1f37fb3-f377-4226-b541-29e42c89c50b\") " pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:06:39.762622 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:39.762542    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qh2tz\""
Jul 29 19:06:39.770964 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:39.770940    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts6wm"
Jul 29 19:06:39.904737 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:39.904699    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ts6wm"]
Jul 29 19:06:39.908650 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:06:39.908620    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f37fb3_f377_4226_b541_29e42c89c50b.slice/crio-2b6b55a648e2193eb7246a46f6abd3664c02dc9d4e6cdd8436f73b30b4b1e441 WatchSource:0}: Error finding container 2b6b55a648e2193eb7246a46f6abd3664c02dc9d4e6cdd8436f73b30b4b1e441: Status 404 returned error can't find the container with id 2b6b55a648e2193eb7246a46f6abd3664c02dc9d4e6cdd8436f73b30b4b1e441
Jul 29 19:06:40.817031 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:40.816975    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ts6wm" event={"ID":"c1f37fb3-f377-4226-b541-29e42c89c50b","Type":"ContainerStarted","Data":"2b6b55a648e2193eb7246a46f6abd3664c02dc9d4e6cdd8436f73b30b4b1e441"}
Jul 29 19:06:42.826516 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:42.826484    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ts6wm" event={"ID":"c1f37fb3-f377-4226-b541-29e42c89c50b","Type":"ContainerStarted","Data":"dc1daa0c8e9f0e6202f4527b847409b5f278ad1caf34e36b1ff478501defc7b6"}
Jul 29 19:06:42.826916 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:42.826534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ts6wm" event={"ID":"c1f37fb3-f377-4226-b541-29e42c89c50b","Type":"ContainerStarted","Data":"c8ddb75bbc8b1db9080c49687bb7898e5ca1b95a21c92dac42742c7849e7a523"}
Jul 29 19:06:42.842922 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:42.842877    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ts6wm" podStartSLOduration=375.500325186 podStartE2EDuration="6m17.842861234s" totalImagesPullingTime="2.342536048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:06:42.841925209 +0000 UTC m=+377.686655182" watchObservedRunningTime="2026-07-29 19:06:42.842861234 +0000 UTC m=+377.687591206"
Jul 29 19:06:42.893357 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:42.893327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:42.994717 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:42.994688    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:43.194307 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:43.194282    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:49.677908 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:49.677871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:49.735058 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:49.735029    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:52.673642 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.673608    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f465b9969-gbsm5"]
Jul 29 19:06:52.675900 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.675878    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.686334 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.686307    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f465b9969-gbsm5"]
Jul 29 19:06:52.698762 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.698738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd099124-c501-4470-a07f-ee85011076b5-console-serving-cert\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.698762 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.698764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-trusted-ca-bundle\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.698954 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.698802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzqcz\" (UniqueName: \"kubernetes.io/projected/bd099124-c501-4470-a07f-ee85011076b5-kube-api-access-qzqcz\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.698954 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.698853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-console-config\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.698954 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.698927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-oauth-serving-cert\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.699140 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.698959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd099124-c501-4470-a07f-ee85011076b5-console-oauth-config\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.699140 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.699071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-service-ca\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.800100 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.800073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd099124-c501-4470-a07f-ee85011076b5-console-oauth-config\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.800227 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.800109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-service-ca\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.800227 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.800133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd099124-c501-4470-a07f-ee85011076b5-console-serving-cert\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.800227 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.800154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-trusted-ca-bundle\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.800227 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.800200    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzqcz\" (UniqueName: \"kubernetes.io/projected/bd099124-c501-4470-a07f-ee85011076b5-kube-api-access-qzqcz\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.800410 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.800232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-console-config\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.800410 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.800275    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-oauth-serving-cert\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.800897 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.800870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-service-ca\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.801053 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.800984    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-trusted-ca-bundle\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.801053 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.801015    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-oauth-serving-cert\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.801180 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.801058    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-console-config\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.802543 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.802524    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd099124-c501-4470-a07f-ee85011076b5-console-oauth-config\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.802667 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.802652    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd099124-c501-4470-a07f-ee85011076b5-console-serving-cert\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.808420 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.808398    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzqcz\" (UniqueName: \"kubernetes.io/projected/bd099124-c501-4470-a07f-ee85011076b5-kube-api-access-qzqcz\") pod \"console-f465b9969-gbsm5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") " pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:52.985830 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:52.985752    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:06:53.108270 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:53.108232    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f465b9969-gbsm5"]
Jul 29 19:06:53.111120 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:06:53.111095    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd099124_c501_4470_a07f_ee85011076b5.slice/crio-40107fd19b2318e02e939b706a2ce5a802030506995d50aa83afc5d88344f785 WatchSource:0}: Error finding container 40107fd19b2318e02e939b706a2ce5a802030506995d50aa83afc5d88344f785: Status 404 returned error can't find the container with id 40107fd19b2318e02e939b706a2ce5a802030506995d50aa83afc5d88344f785
Jul 29 19:06:53.349103 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:53.349018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:53.398063 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:53.398030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:53.468772 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:53.468740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:53.525005 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:53.524960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:53.864567 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:53.864533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f465b9969-gbsm5" event={"ID":"bd099124-c501-4470-a07f-ee85011076b5","Type":"ContainerStarted","Data":"02a161567054937bb41c2a77190042fb20ef8b939764b91b07711294c29bceda"}
Jul 29 19:06:53.864906 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:53.864598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f465b9969-gbsm5" event={"ID":"bd099124-c501-4470-a07f-ee85011076b5","Type":"ContainerStarted","Data":"40107fd19b2318e02e939b706a2ce5a802030506995d50aa83afc5d88344f785"}
Jul 29 19:06:53.883406 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:53.883354    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f465b9969-gbsm5" podStartSLOduration=1.8833393840000001 podStartE2EDuration="1.883339384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:06:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:06:53.881251795 +0000 UTC m=+388.725981796" watchObservedRunningTime="2026-07-29 19:06:53.883339384 +0000 UTC m=+388.728069356"
Jul 29 19:06:58.131673 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:58.131630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:58.180088 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:58.180048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:06:59.712356 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:06:59.712324    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:07:02.986620 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:02.986588    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:07:02.987069 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:02.986648    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:07:02.991329 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:02.991308    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:07:03.561935 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.561900    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f465b9969-gbsm5"]
Jul 29 19:07:03.587870 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.587836    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c744bc69c-fgmfs"]
Jul 29 19:07:03.590192 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.590173    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.600569 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.600542    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c744bc69c-fgmfs"]
Jul 29 19:07:03.682057 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.682024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-oauth-config\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.682216 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.682061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-config\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.682216 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.682083    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js44v\" (UniqueName: \"kubernetes.io/projected/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-kube-api-access-js44v\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.682216 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.682104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-service-ca\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.682216 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.682120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-serving-cert\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.682216 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.682143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-oauth-serving-cert\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.682216 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.682170    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-trusted-ca-bundle\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.782801 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.782773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-oauth-config\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.782937 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.782808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-config\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.782937 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.782829    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js44v\" (UniqueName: \"kubernetes.io/projected/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-kube-api-access-js44v\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.782937 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.782849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-service-ca\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.782937 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.782868    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-serving-cert\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.782937 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.782889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-oauth-serving-cert\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.782937 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.782907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-trusted-ca-bundle\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.783557 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.783534    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-config\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.783685 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.783660    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-service-ca\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.783781 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.783758    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-oauth-serving-cert\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.783821 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.783797    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-trusted-ca-bundle\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.785821 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.785792    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-oauth-config\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.785901 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.785850    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-serving-cert\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.791658 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.791629    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js44v\" (UniqueName: \"kubernetes.io/projected/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-kube-api-access-js44v\") pod \"console-6c744bc69c-fgmfs\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") " pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.899178 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.899152    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:03.900354 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:03.900337    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:07:04.019641 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:04.019609    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c744bc69c-fgmfs"]
Jul 29 19:07:04.022266 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:07:04.022237    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod084d96a5_c3ea_412c_87b2_d77fef5e8a6d.slice/crio-ab89fd14da65677da373d5a771ec603cec2bdf3b06e69953ed9a87704062cc37 WatchSource:0}: Error finding container ab89fd14da65677da373d5a771ec603cec2bdf3b06e69953ed9a87704062cc37: Status 404 returned error can't find the container with id ab89fd14da65677da373d5a771ec603cec2bdf3b06e69953ed9a87704062cc37
Jul 29 19:07:04.902317 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:04.902274    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c744bc69c-fgmfs" event={"ID":"084d96a5-c3ea-412c-87b2-d77fef5e8a6d","Type":"ContainerStarted","Data":"9b1861f3deb3ef897c75247f56e227e6c94db0a7b2c2127865fb74109d11d7cb"}
Jul 29 19:07:04.902515 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:04.902328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c744bc69c-fgmfs" event={"ID":"084d96a5-c3ea-412c-87b2-d77fef5e8a6d","Type":"ContainerStarted","Data":"ab89fd14da65677da373d5a771ec603cec2bdf3b06e69953ed9a87704062cc37"}
Jul 29 19:07:04.920787 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:04.920745    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c744bc69c-fgmfs" podStartSLOduration=1.920731114 podStartE2EDuration="1.920731114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:07:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:07:04.919455207 +0000 UTC m=+399.764185180" watchObservedRunningTime="2026-07-29 19:07:04.920731114 +0000 UTC m=+399.765461085"
Jul 29 19:07:10.106200 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:10.106166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:07:10.160693 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:10.160662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:07:13.900214 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:13.900181    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:13.900637 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:13.900242    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:13.904693 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:13.904675    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:13.937286 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:13.937263    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:07:13.979050 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:13.979021    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d5546ddb8-95w4l"]
Jul 29 19:07:14.082135 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:14.082101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:07:14.130007 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:14.129964    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:07:14.191004 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:14.190962    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:07:17.610369 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:17.610331    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:07:17.709199 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:17.709169    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:07:29.920330 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:29.920265    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f465b9969-gbsm5" podUID="bd099124-c501-4470-a07f-ee85011076b5" containerName="console" containerID="cri-o://02a161567054937bb41c2a77190042fb20ef8b939764b91b07711294c29bceda" gracePeriod=15
Jul 29 19:07:30.164373 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.164350    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:07:30.266486 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.266410    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-trusted-ca-bundle\") pod \"bd099124-c501-4470-a07f-ee85011076b5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") "
Jul 29 19:07:30.266486 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.266454    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd099124-c501-4470-a07f-ee85011076b5-console-serving-cert\") pod \"bd099124-c501-4470-a07f-ee85011076b5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") "
Jul 29 19:07:30.266486 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.266481    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzqcz\" (UniqueName: \"kubernetes.io/projected/bd099124-c501-4470-a07f-ee85011076b5-kube-api-access-qzqcz\") pod \"bd099124-c501-4470-a07f-ee85011076b5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") "
Jul 29 19:07:30.266714 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.266525    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-service-ca\") pod \"bd099124-c501-4470-a07f-ee85011076b5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") "
Jul 29 19:07:30.266714 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.266544    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-oauth-serving-cert\") pod \"bd099124-c501-4470-a07f-ee85011076b5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") "
Jul 29 19:07:30.266714 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.266566    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-console-config\") pod \"bd099124-c501-4470-a07f-ee85011076b5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") "
Jul 29 19:07:30.266714 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.266595    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd099124-c501-4470-a07f-ee85011076b5-console-oauth-config\") pod \"bd099124-c501-4470-a07f-ee85011076b5\" (UID: \"bd099124-c501-4470-a07f-ee85011076b5\") "
Jul 29 19:07:30.266968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.266938    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bd099124-c501-4470-a07f-ee85011076b5" (UID: "bd099124-c501-4470-a07f-ee85011076b5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:07:30.266968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.266950    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-service-ca" (OuterVolumeSpecName: "service-ca") pod "bd099124-c501-4470-a07f-ee85011076b5" (UID: "bd099124-c501-4470-a07f-ee85011076b5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:07:30.267091 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.266956    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bd099124-c501-4470-a07f-ee85011076b5" (UID: "bd099124-c501-4470-a07f-ee85011076b5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:07:30.267091 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.266976    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-console-config" (OuterVolumeSpecName: "console-config") pod "bd099124-c501-4470-a07f-ee85011076b5" (UID: "bd099124-c501-4470-a07f-ee85011076b5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:07:30.268803 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.268773    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd099124-c501-4470-a07f-ee85011076b5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bd099124-c501-4470-a07f-ee85011076b5" (UID: "bd099124-c501-4470-a07f-ee85011076b5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:07:30.268803 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.268784    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd099124-c501-4470-a07f-ee85011076b5-kube-api-access-qzqcz" (OuterVolumeSpecName: "kube-api-access-qzqcz") pod "bd099124-c501-4470-a07f-ee85011076b5" (UID: "bd099124-c501-4470-a07f-ee85011076b5"). InnerVolumeSpecName "kube-api-access-qzqcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:07:30.268933 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.268846    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd099124-c501-4470-a07f-ee85011076b5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bd099124-c501-4470-a07f-ee85011076b5" (UID: "bd099124-c501-4470-a07f-ee85011076b5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:07:30.368026 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.367970    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzqcz\" (UniqueName: \"kubernetes.io/projected/bd099124-c501-4470-a07f-ee85011076b5-kube-api-access-qzqcz\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:07:30.368026 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.368022    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:07:30.368026 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.368032    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-oauth-serving-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:07:30.368026 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.368040    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-console-config\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:07:30.368251 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.368049    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd099124-c501-4470-a07f-ee85011076b5-console-oauth-config\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:07:30.368251 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.368077    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd099124-c501-4470-a07f-ee85011076b5-trusted-ca-bundle\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:07:30.368251 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.368086    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd099124-c501-4470-a07f-ee85011076b5-console-serving-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:07:30.993461 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.993423    2563 generic.go:356] "Generic (PLEG): container finished" podID="bd099124-c501-4470-a07f-ee85011076b5" containerID="02a161567054937bb41c2a77190042fb20ef8b939764b91b07711294c29bceda" exitCode=0
Jul 29 19:07:30.993821 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.993472    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f465b9969-gbsm5"
Jul 29 19:07:30.993821 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.993478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f465b9969-gbsm5" event={"ID":"bd099124-c501-4470-a07f-ee85011076b5","Type":"ContainerDied","Data":"02a161567054937bb41c2a77190042fb20ef8b939764b91b07711294c29bceda"}
Jul 29 19:07:30.993821 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.993597    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f465b9969-gbsm5" event={"ID":"bd099124-c501-4470-a07f-ee85011076b5","Type":"ContainerDied","Data":"40107fd19b2318e02e939b706a2ce5a802030506995d50aa83afc5d88344f785"}
Jul 29 19:07:30.993821 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:30.993646    2563 scope.go:117] "RemoveContainer" containerID="02a161567054937bb41c2a77190042fb20ef8b939764b91b07711294c29bceda"
Jul 29 19:07:31.002185 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:31.002169    2563 scope.go:117] "RemoveContainer" containerID="02a161567054937bb41c2a77190042fb20ef8b939764b91b07711294c29bceda"
Jul 29 19:07:31.002437 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:07:31.002416    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02a161567054937bb41c2a77190042fb20ef8b939764b91b07711294c29bceda\": container with ID starting with 02a161567054937bb41c2a77190042fb20ef8b939764b91b07711294c29bceda not found: ID does not exist" containerID="02a161567054937bb41c2a77190042fb20ef8b939764b91b07711294c29bceda"
Jul 29 19:07:31.002487 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:31.002444    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02a161567054937bb41c2a77190042fb20ef8b939764b91b07711294c29bceda"} err="failed to get container status \"02a161567054937bb41c2a77190042fb20ef8b939764b91b07711294c29bceda\": rpc error: code = NotFound desc = could not find container \"02a161567054937bb41c2a77190042fb20ef8b939764b91b07711294c29bceda\": container with ID starting with 02a161567054937bb41c2a77190042fb20ef8b939764b91b07711294c29bceda not found: ID does not exist"
Jul 29 19:07:31.015088 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:31.015063    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f465b9969-gbsm5"]
Jul 29 19:07:31.018499 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:31.018474    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f465b9969-gbsm5"]
Jul 29 19:07:31.184957 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:31.184925    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:07:31.286146 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:31.286072    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:07:31.663414 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:31.663381    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd099124-c501-4470-a07f-ee85011076b5" path="/var/lib/kubelet/pods/bd099124-c501-4470-a07f-ee85011076b5/volumes"
Jul 29 19:07:38.998224 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:38.998178    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d5546ddb8-95w4l" podUID="ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3" containerName="console" containerID="cri-o://a9795386889ec2034ad492f0f0e366c2508b9df17a666e1c14067769ecf15fa8" gracePeriod=15
Jul 29 19:07:39.240294 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.240268    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:07:39.329786 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.329720    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-config\") pod \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") "
Jul 29 19:07:39.329786 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.329752    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptqg2\" (UniqueName: \"kubernetes.io/projected/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-kube-api-access-ptqg2\") pod \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") "
Jul 29 19:07:39.329786 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.329779    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-oauth-serving-cert\") pod \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") "
Jul 29 19:07:39.330050 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.329811    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-serving-cert\") pod \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") "
Jul 29 19:07:39.330050 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.329941    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-trusted-ca-bundle\") pod \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") "
Jul 29 19:07:39.330050 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.329986    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-service-ca\") pod \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") "
Jul 29 19:07:39.330050 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.330046    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-oauth-config\") pod \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\" (UID: \"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3\") "
Jul 29 19:07:39.330257 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.330197    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-config" (OuterVolumeSpecName: "console-config") pod "ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3" (UID: "ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:07:39.330312 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.330269    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3" (UID: "ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:07:39.330312 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.330275    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-config\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:07:39.330417 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.330350    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3" (UID: "ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:07:39.330417 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.330372    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3" (UID: "ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:07:39.331929 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.331905    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3" (UID: "ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:07:39.331929 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.331919    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-kube-api-access-ptqg2" (OuterVolumeSpecName: "kube-api-access-ptqg2") pod "ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3" (UID: "ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3"). InnerVolumeSpecName "kube-api-access-ptqg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:07:39.332104 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.332088    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3" (UID: "ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:07:39.430583 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.430558    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptqg2\" (UniqueName: \"kubernetes.io/projected/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-kube-api-access-ptqg2\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:07:39.430583 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.430580    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-oauth-serving-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:07:39.430718 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.430590    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-serving-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:07:39.430718 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.430599    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-trusted-ca-bundle\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:07:39.430718 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.430608    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:07:39.430718 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:39.430617    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3-console-oauth-config\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:07:40.029671 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:40.029583    2563 generic.go:356] "Generic (PLEG): container finished" podID="ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3" containerID="a9795386889ec2034ad492f0f0e366c2508b9df17a666e1c14067769ecf15fa8" exitCode=0
Jul 29 19:07:40.029671 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:40.029637    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5546ddb8-95w4l"
Jul 29 19:07:40.030112 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:40.029679    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5546ddb8-95w4l" event={"ID":"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3","Type":"ContainerDied","Data":"a9795386889ec2034ad492f0f0e366c2508b9df17a666e1c14067769ecf15fa8"}
Jul 29 19:07:40.030112 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:40.029756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5546ddb8-95w4l" event={"ID":"ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3","Type":"ContainerDied","Data":"d5f50754dda7b574c59bc97a7644b1b5572288e22b780cd1081f831bc2c1f799"}
Jul 29 19:07:40.030112 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:40.029777    2563 scope.go:117] "RemoveContainer" containerID="a9795386889ec2034ad492f0f0e366c2508b9df17a666e1c14067769ecf15fa8"
Jul 29 19:07:40.037591 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:40.037570    2563 scope.go:117] "RemoveContainer" containerID="a9795386889ec2034ad492f0f0e366c2508b9df17a666e1c14067769ecf15fa8"
Jul 29 19:07:40.037819 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:07:40.037801    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9795386889ec2034ad492f0f0e366c2508b9df17a666e1c14067769ecf15fa8\": container with ID starting with a9795386889ec2034ad492f0f0e366c2508b9df17a666e1c14067769ecf15fa8 not found: ID does not exist" containerID="a9795386889ec2034ad492f0f0e366c2508b9df17a666e1c14067769ecf15fa8"
Jul 29 19:07:40.037870 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:40.037828    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9795386889ec2034ad492f0f0e366c2508b9df17a666e1c14067769ecf15fa8"} err="failed to get container status \"a9795386889ec2034ad492f0f0e366c2508b9df17a666e1c14067769ecf15fa8\": rpc error: code = NotFound desc = could not find container \"a9795386889ec2034ad492f0f0e366c2508b9df17a666e1c14067769ecf15fa8\": container with ID starting with a9795386889ec2034ad492f0f0e366c2508b9df17a666e1c14067769ecf15fa8 not found: ID does not exist"
Jul 29 19:07:40.046446 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:40.046426    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d5546ddb8-95w4l"]
Jul 29 19:07:40.050462 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:40.050444    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d5546ddb8-95w4l"]
Jul 29 19:07:41.662610 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:41.662564    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3" path="/var/lib/kubelet/pods/ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3/volumes"
Jul 29 19:07:53.813091 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:53.812978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:07:53.866044 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:07:53.866013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:05.207890 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:05.207854    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:05.306644 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:05.306616    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:32.342483 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:32.342451    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:33.855303 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:33.855256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:36.340189 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:36.340154    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:36.458837 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:36.458802    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:37.729102 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:37.729068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:37.862334 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:37.862303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:38.092695 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:38.092626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:38.325941 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:38.325909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:40.499627 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:40.499588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:40.957344 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:40.957311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:43.116094 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:43.116061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:43.190717 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:43.190685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:45.186042 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.186011    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qxlzh"]
Jul 29 19:08:45.186412 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.186255    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3" containerName="console"
Jul 29 19:08:45.186412 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.186266    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3" containerName="console"
Jul 29 19:08:45.186412 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.186280    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd099124-c501-4470-a07f-ee85011076b5" containerName="console"
Jul 29 19:08:45.186412 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.186285    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd099124-c501-4470-a07f-ee85011076b5" containerName="console"
Jul 29 19:08:45.186412 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.186332    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd099124-c501-4470-a07f-ee85011076b5" containerName="console"
Jul 29 19:08:45.186412 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.186342    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec4e8fa4-1012-4f68-a9ea-ff9d376d42a3" containerName="console"
Jul 29 19:08:45.190232 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.190215    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qxlzh"
Jul 29 19:08:45.193276 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.193255    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rplcn\""
Jul 29 19:08:45.194428 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.194404    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 19:08:45.194479 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.194404    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 19:08:45.206496 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.206473    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qxlzh"]
Jul 29 19:08:45.299257 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.299231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cwdj\" (UniqueName: \"kubernetes.io/projected/ce7bf354-1d19-4d94-a517-d3f33bd1fd53-kube-api-access-8cwdj\") pod \"cert-manager-webhook-6486ffd997-qxlzh\" (UID: \"ce7bf354-1d19-4d94-a517-d3f33bd1fd53\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxlzh"
Jul 29 19:08:45.299257 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.299264    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce7bf354-1d19-4d94-a517-d3f33bd1fd53-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qxlzh\" (UID: \"ce7bf354-1d19-4d94-a517-d3f33bd1fd53\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxlzh"
Jul 29 19:08:45.400548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.400506    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cwdj\" (UniqueName: \"kubernetes.io/projected/ce7bf354-1d19-4d94-a517-d3f33bd1fd53-kube-api-access-8cwdj\") pod \"cert-manager-webhook-6486ffd997-qxlzh\" (UID: \"ce7bf354-1d19-4d94-a517-d3f33bd1fd53\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxlzh"
Jul 29 19:08:45.400548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.400554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce7bf354-1d19-4d94-a517-d3f33bd1fd53-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qxlzh\" (UID: \"ce7bf354-1d19-4d94-a517-d3f33bd1fd53\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxlzh"
Jul 29 19:08:45.410102 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.410076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce7bf354-1d19-4d94-a517-d3f33bd1fd53-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qxlzh\" (UID: \"ce7bf354-1d19-4d94-a517-d3f33bd1fd53\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxlzh"
Jul 29 19:08:45.410194 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.410137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cwdj\" (UniqueName: \"kubernetes.io/projected/ce7bf354-1d19-4d94-a517-d3f33bd1fd53-kube-api-access-8cwdj\") pod \"cert-manager-webhook-6486ffd997-qxlzh\" (UID: \"ce7bf354-1d19-4d94-a517-d3f33bd1fd53\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxlzh"
Jul 29 19:08:45.498961 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.498900    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qxlzh"
Jul 29 19:08:45.632526 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:45.632500    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qxlzh"]
Jul 29 19:08:45.634941 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:08:45.634907    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce7bf354_1d19_4d94_a517_d3f33bd1fd53.slice/crio-efdb1e5821d17e8b0a3bba6ddcdd0795d03cc949e5b4483ffc4de09b124de838 WatchSource:0}: Error finding container efdb1e5821d17e8b0a3bba6ddcdd0795d03cc949e5b4483ffc4de09b124de838: Status 404 returned error can't find the container with id efdb1e5821d17e8b0a3bba6ddcdd0795d03cc949e5b4483ffc4de09b124de838
Jul 29 19:08:46.161655 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:46.161621    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:46.261135 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:46.261103    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qxlzh" event={"ID":"ce7bf354-1d19-4d94-a517-d3f33bd1fd53","Type":"ContainerStarted","Data":"efdb1e5821d17e8b0a3bba6ddcdd0795d03cc949e5b4483ffc4de09b124de838"}
Jul 29 19:08:46.326495 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:46.326457    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:46.425008 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:46.424909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:48.064071 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:48.064039    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:48.979429 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:48.979342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:49.074191 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:49.074161    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:49.274878 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:49.274805    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qxlzh" event={"ID":"ce7bf354-1d19-4d94-a517-d3f33bd1fd53","Type":"ContainerStarted","Data":"ca992d7a4bc9de2890afeac6544a33c59b839908b84c85c8449ffad93fbf6491"}
Jul 29 19:08:49.275023 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:49.274924    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qxlzh"
Jul 29 19:08:49.300972 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:49.300927    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-qxlzh" podStartSLOduration=1.231969012 podStartE2EDuration="4.3009124s" totalImagesPullingTime="3.068943388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:08:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:08:49.298571846 +0000 UTC m=+504.143301817" watchObservedRunningTime="2026-07-29 19:08:49.3009124 +0000 UTC m=+504.145642371"
Jul 29 19:08:51.800785 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:51.800720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:51.904762 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:51.904721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:54.032357 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:54.032315    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:08:55.281323 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:08:55.281294    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qxlzh"
Jul 29 19:09:06.046477 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:06.046445    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:06.216582 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:06.216549    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:07.335563 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.335524    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"]
Jul 29 19:09:07.341250 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.341228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.362251 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.362232    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 19:09:07.362370 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.362255    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 19:09:07.362370 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.362232    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 19:09:07.362370 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.362232    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 19:09:07.362556 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.362543    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b4wmv\""
Jul 29 19:09:07.418157 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.418132    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"]
Jul 29 19:09:07.473328 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.473300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-manifests\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.473429 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.473335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-tmp\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.473429 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.473408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-webhook-cert\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.473507 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.473444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhx8q\" (UniqueName: \"kubernetes.io/projected/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-kube-api-access-zhx8q\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.473507 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.473485    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.573946 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.573915    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-webhook-cert\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.574104 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.573958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhx8q\" (UniqueName: \"kubernetes.io/projected/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-kube-api-access-zhx8q\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.574104 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.574015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.574104 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.574040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-manifests\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.574104 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.574074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-tmp\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.574514 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.574486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-manifests\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.576301 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.576280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-tmp\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.576654 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.576635    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.576695 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.576635    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-webhook-cert\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.592385 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.592334    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhx8q\" (UniqueName: \"kubernetes.io/projected/a395f60c-f0bc-497a-bdbf-d47ad69f89f2-kube-api-access-zhx8q\") pod \"opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5\" (UID: \"a395f60c-f0bc-497a-bdbf-d47ad69f89f2\") " pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.624958 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.624933    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:07.651130 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.651110    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:07.770235 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.770205    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:07.791395 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.791370    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"]
Jul 29 19:09:07.795413 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:09:07.795385    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda395f60c_f0bc_497a_bdbf_d47ad69f89f2.slice/crio-8ee744692fe0bf2c670f44de53905a5f9494bde270e67b9fafd8d53c62322828 WatchSource:0}: Error finding container 8ee744692fe0bf2c670f44de53905a5f9494bde270e67b9fafd8d53c62322828: Status 404 returned error can't find the container with id 8ee744692fe0bf2c670f44de53905a5f9494bde270e67b9fafd8d53c62322828
Jul 29 19:09:07.955330 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:07.955298    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:08.086825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:08.086795    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:08.234547 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:08.234461    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:08.339983 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:08.339949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5" event={"ID":"a395f60c-f0bc-497a-bdbf-d47ad69f89f2","Type":"ContainerStarted","Data":"8ee744692fe0bf2c670f44de53905a5f9494bde270e67b9fafd8d53c62322828"}
Jul 29 19:09:08.380364 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:08.380337    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:08.496740 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:08.496672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:11.353903 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:11.353866    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5" event={"ID":"a395f60c-f0bc-497a-bdbf-d47ad69f89f2","Type":"ContainerStarted","Data":"99f01f79f716cc67750204d8857111b7792a2d701d17fb36ee71ec2efcbe0c3c"}
Jul 29 19:09:12.359671 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:12.359632    2563 generic.go:356] "Generic (PLEG): container finished" podID="a395f60c-f0bc-497a-bdbf-d47ad69f89f2" containerID="99f01f79f716cc67750204d8857111b7792a2d701d17fb36ee71ec2efcbe0c3c" exitCode=0
Jul 29 19:09:12.360081 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:12.359719    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5" event={"ID":"a395f60c-f0bc-497a-bdbf-d47ad69f89f2","Type":"ContainerDied","Data":"99f01f79f716cc67750204d8857111b7792a2d701d17fb36ee71ec2efcbe0c3c"}
Jul 29 19:09:12.784450 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:12.784413    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:12.880291 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:12.880260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:13.365087 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:13.364986    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5" event={"ID":"a395f60c-f0bc-497a-bdbf-d47ad69f89f2","Type":"ContainerStarted","Data":"89aed1a05ed0a473d05342fc63e9b0df33648713c75027ee128f597683852288"}
Jul 29 19:09:13.365441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:13.365129    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:13.405516 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:13.405468    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5" podStartSLOduration=1.8125332950000002 podStartE2EDuration="6.405454365s" totalImagesPullingTime="3.567882082s" totalInitContainerRuntime="1.025038988s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:09:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:09:13.404929342 +0000 UTC m=+528.249659315" watchObservedRunningTime="2026-07-29 19:09:13.405454365 +0000 UTC m=+528.250184337"
Jul 29 19:09:22.527167 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:22.527090    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:24.371217 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:24.371189    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5"
Jul 29 19:09:26.007721 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.007690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:26.122609 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.118250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:26.141055 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.141011    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"]
Jul 29 19:09:26.145419 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.145387    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:26.148793 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.148767    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:09:26.149857 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.149832    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 19:09:26.149961 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.149867    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 19:09:26.150045 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.149963    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 19:09:26.150100 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.149966    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 19:09:26.150154 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.150106    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hp5pw\""
Jul 29 19:09:26.166856 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.166835    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"]
Jul 29 19:09:26.225592 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.225565    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed-manager-config\") pod \"lws-controller-manager-79b99cb5c6-rqxjm\" (UID: \"b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed\") " pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:26.225755 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.225613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed-cert\") pod \"lws-controller-manager-79b99cb5c6-rqxjm\" (UID: \"b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed\") " pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:26.225755 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.225660    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed-metrics-cert\") pod \"lws-controller-manager-79b99cb5c6-rqxjm\" (UID: \"b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed\") " pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:26.225755 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.225686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sjxn\" (UniqueName: \"kubernetes.io/projected/b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed-kube-api-access-4sjxn\") pod \"lws-controller-manager-79b99cb5c6-rqxjm\" (UID: \"b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed\") " pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:26.326935 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.326848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed-metrics-cert\") pod \"lws-controller-manager-79b99cb5c6-rqxjm\" (UID: \"b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed\") " pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:26.326935 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.326906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sjxn\" (UniqueName: \"kubernetes.io/projected/b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed-kube-api-access-4sjxn\") pod \"lws-controller-manager-79b99cb5c6-rqxjm\" (UID: \"b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed\") " pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:26.327152 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.327007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed-manager-config\") pod \"lws-controller-manager-79b99cb5c6-rqxjm\" (UID: \"b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed\") " pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:26.327152 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.327042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed-cert\") pod \"lws-controller-manager-79b99cb5c6-rqxjm\" (UID: \"b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed\") " pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:26.327685 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.327661    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed-manager-config\") pod \"lws-controller-manager-79b99cb5c6-rqxjm\" (UID: \"b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed\") " pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:26.329280 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.329261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed-cert\") pod \"lws-controller-manager-79b99cb5c6-rqxjm\" (UID: \"b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed\") " pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:26.329351 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.329334    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed-metrics-cert\") pod \"lws-controller-manager-79b99cb5c6-rqxjm\" (UID: \"b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed\") " pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:26.340451 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.340432    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sjxn\" (UniqueName: \"kubernetes.io/projected/b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed-kube-api-access-4sjxn\") pod \"lws-controller-manager-79b99cb5c6-rqxjm\" (UID: \"b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed\") " pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:26.455932 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.455903    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:26.598417 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:26.598392    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"]
Jul 29 19:09:26.600239 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:09:26.600213    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b1a5a1_8cdc_4f68_bca3_0aa4fc6d05ed.slice/crio-6d2755655232a6e130ea40d3c816c8e8408e726d30bebd85db72311405d53405 WatchSource:0}: Error finding container 6d2755655232a6e130ea40d3c816c8e8408e726d30bebd85db72311405d53405: Status 404 returned error can't find the container with id 6d2755655232a6e130ea40d3c816c8e8408e726d30bebd85db72311405d53405
Jul 29 19:09:27.416698 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:27.416649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm" event={"ID":"b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed","Type":"ContainerStarted","Data":"6d2755655232a6e130ea40d3c816c8e8408e726d30bebd85db72311405d53405"}
Jul 29 19:09:28.292035 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:28.291984    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:28.476542 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:28.476503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:28.941217 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:28.941178    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:29.195203 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:29.195092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:29.430175 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:29.430136    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm" event={"ID":"b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed","Type":"ContainerStarted","Data":"53df21fa7b55ff4a8a57e7b5bbc7dcf7940ca122e8d7401d087ff6a855c30f66"}
Jul 29 19:09:29.430336 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:29.430271    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:29.770087 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:29.770059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:29.881956 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:29.881922    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:30.016947 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:30.016912    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:30.485831 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:30.485799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:30.863639 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:30.863537    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:31.323912 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:31.323875    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:31.597056 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:31.596963    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:31.778718 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:31.778686    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:32.958503 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:32.958469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:37.207483 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.207423    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm" podStartSLOduration=8.849189162 podStartE2EDuration="11.207400519s" totalImagesPullingTime="2.358211357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:09:29.47460174 +0000 UTC m=+544.319331713" watchObservedRunningTime="2026-07-29 19:09:37.207400519 +0000 UTC m=+552.052130491"
Jul 29 19:09:37.208637 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.208616    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"]
Jul 29 19:09:37.211980 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.211962    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.214997 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.214971    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 19:09:37.215258 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.215237    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 19:09:37.215337 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.215278    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 19:09:37.215385 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.215280    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 19:09:37.215588 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.215575    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qfzmc\""
Jul 29 19:09:37.218424 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.218405    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88049de3-a881-4cd7-ae76-d8518789bca5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.218500 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.218434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl6l2\" (UniqueName: \"kubernetes.io/projected/88049de3-a881-4cd7-ae76-d8518789bca5-kube-api-access-hl6l2\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.218500 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.218483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/88049de3-a881-4cd7-ae76-d8518789bca5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.218597 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.218503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/88049de3-a881-4cd7-ae76-d8518789bca5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.218597 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.218574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88049de3-a881-4cd7-ae76-d8518789bca5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.218693 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.218616    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/88049de3-a881-4cd7-ae76-d8518789bca5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.218693 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.218662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/88049de3-a881-4cd7-ae76-d8518789bca5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.237585 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.237560    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"]
Jul 29 19:09:37.319103 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.319073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88049de3-a881-4cd7-ae76-d8518789bca5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.319258 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.319211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/88049de3-a881-4cd7-ae76-d8518789bca5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.319344 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.319321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/88049de3-a881-4cd7-ae76-d8518789bca5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.319401 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.319380    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88049de3-a881-4cd7-ae76-d8518789bca5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.319457 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.319405    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl6l2\" (UniqueName: \"kubernetes.io/projected/88049de3-a881-4cd7-ae76-d8518789bca5-kube-api-access-hl6l2\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.319511 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.319461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/88049de3-a881-4cd7-ae76-d8518789bca5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.319511 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.319485    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/88049de3-a881-4cd7-ae76-d8518789bca5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.320404 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.320368    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/88049de3-a881-4cd7-ae76-d8518789bca5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.321697 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.321668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/88049de3-a881-4cd7-ae76-d8518789bca5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.321853 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.321833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88049de3-a881-4cd7-ae76-d8518789bca5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.322020 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.321979    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/88049de3-a881-4cd7-ae76-d8518789bca5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.322094 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.321980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/88049de3-a881-4cd7-ae76-d8518789bca5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.337285 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.337263    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl6l2\" (UniqueName: \"kubernetes.io/projected/88049de3-a881-4cd7-ae76-d8518789bca5-kube-api-access-hl6l2\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.354742 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.354718    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88049de3-a881-4cd7-ae76-d8518789bca5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-4m4fk\" (UID: \"88049de3-a881-4cd7-ae76-d8518789bca5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.474837 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.474768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:37.520922 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.520898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:37.572526 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.572495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:37.663505 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:09:37.663475    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88049de3_a881_4cd7_ae76_d8518789bca5.slice/crio-2658e514b226cdde6770961f8190a93120e3f690e5bb4eb1212b52886df57db9 WatchSource:0}: Error finding container 2658e514b226cdde6770961f8190a93120e3f690e5bb4eb1212b52886df57db9: Status 404 returned error can't find the container with id 2658e514b226cdde6770961f8190a93120e3f690e5bb4eb1212b52886df57db9
Jul 29 19:09:37.664169 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:37.664136    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"]
Jul 29 19:09:38.356281 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:38.356240    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:38.465799 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:38.465764    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk" event={"ID":"88049de3-a881-4cd7-ae76-d8518789bca5","Type":"ContainerStarted","Data":"2658e514b226cdde6770961f8190a93120e3f690e5bb4eb1212b52886df57db9"}
Jul 29 19:09:38.666624 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:38.666590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:38.760451 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:38.760420    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:39.975590 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:39.975556    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:09:39.975850 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:39.975629    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:09:40.323722 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:40.323632    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:40.436312 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:40.436280    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79b99cb5c6-rqxjm"
Jul 29 19:09:40.475572 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:40.475539    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk" event={"ID":"88049de3-a881-4cd7-ae76-d8518789bca5","Type":"ContainerStarted","Data":"0dc6c47ace07b10498a67c5f28740976bb669b065f720f76a6a8ab1e32963470"}
Jul 29 19:09:40.475750 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:40.475672    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:40.547115 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:40.547087    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:40.677388 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:40.677340    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk" podStartSLOduration=1.3674344600000001 podStartE2EDuration="3.677322394s" totalImagesPullingTime="2.309887934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:09:40.677314844 +0000 UTC m=+555.522044815" watchObservedRunningTime="2026-07-29 19:09:40.677322394 +0000 UTC m=+555.522052366"
Jul 29 19:09:40.934731 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:40.934650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:41.481547 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:41.481517    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-4m4fk"
Jul 29 19:09:42.243496 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:42.243463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:42.386977 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:42.386941    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:42.535256 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:42.535171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:09:57.866809 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:09:57.866775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:10:09.831004 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:10:09.830952    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:10:17.556289 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:10:17.556249    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:10:17.661467 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:10:17.661430    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:10:19.507590 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:10:19.507561    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:10:19.614211 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:10:19.614180    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:10:29.697159 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:10:29.697126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:10:31.942107 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:10:31.942074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:10:58.786152 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:10:58.786063    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:02.172574 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:02.172527    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:03.016419 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:03.016384    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:06.064515 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:06.064478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:06.169646 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:06.169611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:06.371974 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:06.371903    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:08.483286 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:08.483256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:10.370367 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:10.370334    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:11.823377 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:11.823340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:13.428956 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:13.428916    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:16.040813 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:16.040778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:16.150862 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:16.150824    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:21.004121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:21.004086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:21.110500 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:21.110465    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:21.633646 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:21.633615    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:21.723431 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:21.723403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:22.017404 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:22.017373    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:25.995430 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:25.995395    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:26.096647 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:26.096619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:32.078196 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:32.078159    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:32.180332 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:32.180274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:36.356265 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:36.356225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:36.470352 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:36.470320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:40.203803 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:40.203769    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:41.856788 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:41.856753    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:41.947483 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:41.947451    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:45.369188 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:45.369146    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:47.020902 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:47.020871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:50.990803 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:50.990769    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:51.089326 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:51.089292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:54.408567 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.408530    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-596775b77-psqn7"]
Jul 29 19:11:54.411329 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.411312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.427384 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.427362    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-596775b77-psqn7"]
Jul 29 19:11:54.509649 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.509620    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:54.568498 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.568463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89211e3f-bb93-4903-9993-ba32b8b63a79-trusted-ca-bundle\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.568667 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.568532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89211e3f-bb93-4903-9993-ba32b8b63a79-console-oauth-config\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.568667 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.568568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89211e3f-bb93-4903-9993-ba32b8b63a79-console-config\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.568667 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.568591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89211e3f-bb93-4903-9993-ba32b8b63a79-oauth-serving-cert\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.568667 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.568642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89211e3f-bb93-4903-9993-ba32b8b63a79-service-ca\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.568667 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.568660    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89211e3f-bb93-4903-9993-ba32b8b63a79-console-serving-cert\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.568862 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.568677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l9rp\" (UniqueName: \"kubernetes.io/projected/89211e3f-bb93-4903-9993-ba32b8b63a79-kube-api-access-8l9rp\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.606816 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.606784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:54.669898 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.669874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89211e3f-bb93-4903-9993-ba32b8b63a79-console-oauth-config\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.670062 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.669912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89211e3f-bb93-4903-9993-ba32b8b63a79-console-config\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.670062 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.669939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89211e3f-bb93-4903-9993-ba32b8b63a79-oauth-serving-cert\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.670062 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.669980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89211e3f-bb93-4903-9993-ba32b8b63a79-service-ca\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.670062 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.670030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89211e3f-bb93-4903-9993-ba32b8b63a79-console-serving-cert\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.670062 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.670055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l9rp\" (UniqueName: \"kubernetes.io/projected/89211e3f-bb93-4903-9993-ba32b8b63a79-kube-api-access-8l9rp\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.670318 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.670083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89211e3f-bb93-4903-9993-ba32b8b63a79-trusted-ca-bundle\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.670666 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.670646    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89211e3f-bb93-4903-9993-ba32b8b63a79-console-config\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.670838 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.670816    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89211e3f-bb93-4903-9993-ba32b8b63a79-service-ca\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.670889 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.670847    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89211e3f-bb93-4903-9993-ba32b8b63a79-oauth-serving-cert\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.670953 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.670932    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89211e3f-bb93-4903-9993-ba32b8b63a79-trusted-ca-bundle\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.672476 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.672448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89211e3f-bb93-4903-9993-ba32b8b63a79-console-oauth-config\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.672749 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.672728    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89211e3f-bb93-4903-9993-ba32b8b63a79-console-serving-cert\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.678970 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.678945    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l9rp\" (UniqueName: \"kubernetes.io/projected/89211e3f-bb93-4903-9993-ba32b8b63a79-kube-api-access-8l9rp\") pod \"console-596775b77-psqn7\" (UID: \"89211e3f-bb93-4903-9993-ba32b8b63a79\") " pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.709093 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.709069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:54.720032 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.720009    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:11:54.850488 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.850466    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-596775b77-psqn7"]
Jul 29 19:11:54.853388 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:11:54.853362    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89211e3f_bb93_4903_9993_ba32b8b63a79.slice/crio-235955f798e2a5f5bda024b678a4a2cf8e47d96e4403eb8d54457e2a00d72ce9 WatchSource:0}: Error finding container 235955f798e2a5f5bda024b678a4a2cf8e47d96e4403eb8d54457e2a00d72ce9: Status 404 returned error can't find the container with id 235955f798e2a5f5bda024b678a4a2cf8e47d96e4403eb8d54457e2a00d72ce9
Jul 29 19:11:54.994306 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.994206    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596775b77-psqn7" event={"ID":"89211e3f-bb93-4903-9993-ba32b8b63a79","Type":"ContainerStarted","Data":"cf443bf2e22cc877b1f878a1a029270fa0e86965f928b9d5e3121527f1a33900"}
Jul 29 19:11:54.994306 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:54.994271    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596775b77-psqn7" event={"ID":"89211e3f-bb93-4903-9993-ba32b8b63a79","Type":"ContainerStarted","Data":"235955f798e2a5f5bda024b678a4a2cf8e47d96e4403eb8d54457e2a00d72ce9"}
Jul 29 19:11:55.012916 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:55.012867    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-596775b77-psqn7" podStartSLOduration=1.012851406 podStartE2EDuration="1.012851406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:11:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:11:55.011782943 +0000 UTC m=+689.856512916" watchObservedRunningTime="2026-07-29 19:11:55.012851406 +0000 UTC m=+689.857581378"
Jul 29 19:11:55.138409 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:55.138348    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:11:56.944009 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:11:56.943955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:04.721165 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:04.721116    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:12:04.721165 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:04.721183    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:12:04.726120 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:04.726098    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:12:05.035476 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:05.035392    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-596775b77-psqn7"
Jul 29 19:12:05.090397 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:05.090362    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c744bc69c-fgmfs"]
Jul 29 19:12:05.213320 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:05.213287    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:05.314215 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:05.314147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:05.375410 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:05.375385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:13.683583 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:13.683547    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:14.976658 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:14.976622    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:29.395845 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:29.395769    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:29.514236 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:29.514199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:29.631047 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:29.631016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:29.844048 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:29.844019    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:12:29.847154 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:29.847135    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-r424q"
Jul 29 19:12:29.849906 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:29.849888    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 19:12:29.850019 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:29.849978    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-m7785\""
Jul 29 19:12:29.851043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:29.851024    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 19:12:29.851122 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:29.851096    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 19:12:29.856702 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:29.856677    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:12:29.889710 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:29.889686    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:12:29.947175 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:29.947152    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a18f5230-981c-4b71-b7f1-f77f729563e4-config-file\") pod \"limitador-limitador-54d6d988d5-r424q\" (UID: \"a18f5230-981c-4b71-b7f1-f77f729563e4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-r424q"
Jul 29 19:12:29.947289 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:29.947201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtjcq\" (UniqueName: \"kubernetes.io/projected/a18f5230-981c-4b71-b7f1-f77f729563e4-kube-api-access-jtjcq\") pod \"limitador-limitador-54d6d988d5-r424q\" (UID: \"a18f5230-981c-4b71-b7f1-f77f729563e4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-r424q"
Jul 29 19:12:30.047844 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.047814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjcq\" (UniqueName: \"kubernetes.io/projected/a18f5230-981c-4b71-b7f1-f77f729563e4-kube-api-access-jtjcq\") pod \"limitador-limitador-54d6d988d5-r424q\" (UID: \"a18f5230-981c-4b71-b7f1-f77f729563e4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-r424q"
Jul 29 19:12:30.048012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.047926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a18f5230-981c-4b71-b7f1-f77f729563e4-config-file\") pod \"limitador-limitador-54d6d988d5-r424q\" (UID: \"a18f5230-981c-4b71-b7f1-f77f729563e4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-r424q"
Jul 29 19:12:30.048560 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.048537    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a18f5230-981c-4b71-b7f1-f77f729563e4-config-file\") pod \"limitador-limitador-54d6d988d5-r424q\" (UID: \"a18f5230-981c-4b71-b7f1-f77f729563e4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-r424q"
Jul 29 19:12:30.056973 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.056953    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtjcq\" (UniqueName: \"kubernetes.io/projected/a18f5230-981c-4b71-b7f1-f77f729563e4-kube-api-access-jtjcq\") pod \"limitador-limitador-54d6d988d5-r424q\" (UID: \"a18f5230-981c-4b71-b7f1-f77f729563e4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-r424q"
Jul 29 19:12:30.116464 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.116393    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c744bc69c-fgmfs" podUID="084d96a5-c3ea-412c-87b2-d77fef5e8a6d" containerName="console" containerID="cri-o://9b1861f3deb3ef897c75247f56e227e6c94db0a7b2c2127865fb74109d11d7cb" gracePeriod=15
Jul 29 19:12:30.157697 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.157674    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-r424q"
Jul 29 19:12:30.238499 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.238458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:30.291123 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.291060    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:12:30.296318 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:12:30.296282    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18f5230_981c_4b71_b7f1_f77f729563e4.slice/crio-062eb7582464aad1a7900a8ce7064d936432f2319fee32f4c314281914fef1b1 WatchSource:0}: Error finding container 062eb7582464aad1a7900a8ce7064d936432f2319fee32f4c314281914fef1b1: Status 404 returned error can't find the container with id 062eb7582464aad1a7900a8ce7064d936432f2319fee32f4c314281914fef1b1
Jul 29 19:12:30.298420 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.298401    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:12:30.313498 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.313474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:30.363733 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.363711    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:12:30.452086 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.452063    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-oauth-serving-cert\") pod \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") "
Jul 29 19:12:30.452429 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.452101    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-oauth-config\") pod \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") "
Jul 29 19:12:30.452429 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.452127    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-trusted-ca-bundle\") pod \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") "
Jul 29 19:12:30.452429 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.452309    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-service-ca\") pod \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") "
Jul 29 19:12:30.452429 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.452367    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-config\") pod \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") "
Jul 29 19:12:30.452429 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.452415    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js44v\" (UniqueName: \"kubernetes.io/projected/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-kube-api-access-js44v\") pod \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") "
Jul 29 19:12:30.452684 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.452441    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-serving-cert\") pod \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\" (UID: \"084d96a5-c3ea-412c-87b2-d77fef5e8a6d\") "
Jul 29 19:12:30.452684 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.452601    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "084d96a5-c3ea-412c-87b2-d77fef5e8a6d" (UID: "084d96a5-c3ea-412c-87b2-d77fef5e8a6d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:12:30.452684 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.452627    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "084d96a5-c3ea-412c-87b2-d77fef5e8a6d" (UID: "084d96a5-c3ea-412c-87b2-d77fef5e8a6d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:12:30.452831 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.452719    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-config" (OuterVolumeSpecName: "console-config") pod "084d96a5-c3ea-412c-87b2-d77fef5e8a6d" (UID: "084d96a5-c3ea-412c-87b2-d77fef5e8a6d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:12:30.452831 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.452728    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-service-ca" (OuterVolumeSpecName: "service-ca") pod "084d96a5-c3ea-412c-87b2-d77fef5e8a6d" (UID: "084d96a5-c3ea-412c-87b2-d77fef5e8a6d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:12:30.452831 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.452734    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-oauth-serving-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:12:30.452831 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.452770    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-trusted-ca-bundle\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:12:30.454293 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.454275    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "084d96a5-c3ea-412c-87b2-d77fef5e8a6d" (UID: "084d96a5-c3ea-412c-87b2-d77fef5e8a6d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:12:30.454400 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.454371    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-kube-api-access-js44v" (OuterVolumeSpecName: "kube-api-access-js44v") pod "084d96a5-c3ea-412c-87b2-d77fef5e8a6d" (UID: "084d96a5-c3ea-412c-87b2-d77fef5e8a6d"). InnerVolumeSpecName "kube-api-access-js44v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:12:30.454490 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.454474    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "084d96a5-c3ea-412c-87b2-d77fef5e8a6d" (UID: "084d96a5-c3ea-412c-87b2-d77fef5e8a6d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:12:30.553705 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.553671    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js44v\" (UniqueName: \"kubernetes.io/projected/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-kube-api-access-js44v\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:12:30.553705 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.553697    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-serving-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:12:30.553705 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.553707    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-oauth-config\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:12:30.553913 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.553717    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:12:30.553913 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:30.553726    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/084d96a5-c3ea-412c-87b2-d77fef5e8a6d-console-config\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:12:31.138736 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:31.138702    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-r424q" event={"ID":"a18f5230-981c-4b71-b7f1-f77f729563e4","Type":"ContainerStarted","Data":"062eb7582464aad1a7900a8ce7064d936432f2319fee32f4c314281914fef1b1"}
Jul 29 19:12:31.140144 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:31.140114    2563 generic.go:356] "Generic (PLEG): container finished" podID="084d96a5-c3ea-412c-87b2-d77fef5e8a6d" containerID="9b1861f3deb3ef897c75247f56e227e6c94db0a7b2c2127865fb74109d11d7cb" exitCode=0
Jul 29 19:12:31.140252 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:31.140200    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c744bc69c-fgmfs"
Jul 29 19:12:31.140311 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:31.140204    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c744bc69c-fgmfs" event={"ID":"084d96a5-c3ea-412c-87b2-d77fef5e8a6d","Type":"ContainerDied","Data":"9b1861f3deb3ef897c75247f56e227e6c94db0a7b2c2127865fb74109d11d7cb"}
Jul 29 19:12:31.140353 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:31.140330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c744bc69c-fgmfs" event={"ID":"084d96a5-c3ea-412c-87b2-d77fef5e8a6d","Type":"ContainerDied","Data":"ab89fd14da65677da373d5a771ec603cec2bdf3b06e69953ed9a87704062cc37"}
Jul 29 19:12:31.140395 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:31.140363    2563 scope.go:117] "RemoveContainer" containerID="9b1861f3deb3ef897c75247f56e227e6c94db0a7b2c2127865fb74109d11d7cb"
Jul 29 19:12:31.149757 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:31.149735    2563 scope.go:117] "RemoveContainer" containerID="9b1861f3deb3ef897c75247f56e227e6c94db0a7b2c2127865fb74109d11d7cb"
Jul 29 19:12:31.150047 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:12:31.150021    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b1861f3deb3ef897c75247f56e227e6c94db0a7b2c2127865fb74109d11d7cb\": container with ID starting with 9b1861f3deb3ef897c75247f56e227e6c94db0a7b2c2127865fb74109d11d7cb not found: ID does not exist" containerID="9b1861f3deb3ef897c75247f56e227e6c94db0a7b2c2127865fb74109d11d7cb"
Jul 29 19:12:31.150163 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:31.150055    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1861f3deb3ef897c75247f56e227e6c94db0a7b2c2127865fb74109d11d7cb"} err="failed to get container status \"9b1861f3deb3ef897c75247f56e227e6c94db0a7b2c2127865fb74109d11d7cb\": rpc error: code = NotFound desc = could not find container \"9b1861f3deb3ef897c75247f56e227e6c94db0a7b2c2127865fb74109d11d7cb\": container with ID starting with 9b1861f3deb3ef897c75247f56e227e6c94db0a7b2c2127865fb74109d11d7cb not found: ID does not exist"
Jul 29 19:12:31.166269 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:31.166232    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c744bc69c-fgmfs"]
Jul 29 19:12:31.169130 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:31.169106    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c744bc69c-fgmfs"]
Jul 29 19:12:31.666155 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:31.666118    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="084d96a5-c3ea-412c-87b2-d77fef5e8a6d" path="/var/lib/kubelet/pods/084d96a5-c3ea-412c-87b2-d77fef5e8a6d/volumes"
Jul 29 19:12:33.152088 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:33.151978    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-r424q" event={"ID":"a18f5230-981c-4b71-b7f1-f77f729563e4","Type":"ContainerStarted","Data":"c72faa103f0aa76d0635ad846e00ae9edaf0eb9f8d074dcf1ec429e642e6e136"}
Jul 29 19:12:33.152499 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:33.152156    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-r424q"
Jul 29 19:12:41.861228 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:41.861192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:41.932720 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:41.932689    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:44.157524 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:44.157496    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-r424q"
Jul 29 19:12:44.175720 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:44.175675    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-r424q" podStartSLOduration=12.715750102 podStartE2EDuration="15.175659144s" totalImagesPullingTime="2.459909042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:12:33.171142457 +0000 UTC m=+728.015872430" watchObservedRunningTime="2026-07-29 19:12:44.175659144 +0000 UTC m=+739.020389093"
Jul 29 19:12:46.913271 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:46.913218    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:47.003465 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:47.003425    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:47.415195 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:47.415167    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:51.964353 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:51.964318    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:52.063912 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:52.063872    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:56.818935 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:56.818901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:12:56.883306 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:12:56.883279    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:00.035168 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:00.035132    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:00.173975 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:00.173942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:06.925205 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:06.925175    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:07.029073 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:07.029035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:07.110153 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:07.110126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:07.169156 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:07.169126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:10.355377 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:10.355340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:10.461204 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:10.461171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:22.928936 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:22.928903    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:42.781745 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:42.781706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:42.887293 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:42.887263    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:43.432704 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:43.432674    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:43.600478 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:43.600443    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:44.016676 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:44.016645    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:44.121571 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:44.121539    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:44.409668 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:44.409582    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:13:53.640934 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:53.640854    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:13:53.745099 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:13:53.745065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:14:04.825559 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:04.825528    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:14:05.318453 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:05.318422    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:14:21.746494 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:21.746458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:14:22.597558 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:22.597523    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:14:46.201588 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.201549    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"]
Jul 29 19:14:46.202155 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.201831    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="084d96a5-c3ea-412c-87b2-d77fef5e8a6d" containerName="console"
Jul 29 19:14:46.202155 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.201841    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="084d96a5-c3ea-412c-87b2-d77fef5e8a6d" containerName="console"
Jul 29 19:14:46.202155 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.201899    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="084d96a5-c3ea-412c-87b2-d77fef5e8a6d" containerName="console"
Jul 29 19:14:46.204723 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.204703    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.209645 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.209619    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 19:14:46.209645 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.209619    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lj9bm\""
Jul 29 19:14:46.209822 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.209700    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 29 19:14:46.209822 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.209716    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 19:14:46.224427 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.224404    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"]
Jul 29 19:14:46.298730 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.298701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:14:46.308838 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.308815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.308913 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.308858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.308913 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.308881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.309039 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.308957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.309081 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.309045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l8tk\" (UniqueName: \"kubernetes.io/projected/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-kube-api-access-6l8tk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.309128 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.309096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.410259 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.410226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.410408 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.410268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.410408 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.410313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.410408 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.410359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l8tk\" (UniqueName: \"kubernetes.io/projected/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-kube-api-access-6l8tk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.410570 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.410418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.410570 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.410450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.410788 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.410766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.410860 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.410815    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.410898 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.410866    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.412508 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.412485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.412762 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.412746    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.419760 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.419734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l8tk\" (UniqueName: \"kubernetes.io/projected/a0580d6b-0599-4625-8aa0-101c8bd4f7d6-kube-api-access-6l8tk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8zsks\" (UID: \"a0580d6b-0599-4625-8aa0-101c8bd4f7d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.514783 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.514714    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:46.645374 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.645351    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"]
Jul 29 19:14:46.647057 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:14:46.647020    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0580d6b_0599_4625_8aa0_101c8bd4f7d6.slice/crio-d0e24b99a9533127093bdcd7ead64b2569c864a5b1ff24927b305306841bf2fa WatchSource:0}: Error finding container d0e24b99a9533127093bdcd7ead64b2569c864a5b1ff24927b305306841bf2fa: Status 404 returned error can't find the container with id d0e24b99a9533127093bdcd7ead64b2569c864a5b1ff24927b305306841bf2fa
Jul 29 19:14:46.686556 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:46.686527    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks" event={"ID":"a0580d6b-0599-4625-8aa0-101c8bd4f7d6","Type":"ContainerStarted","Data":"d0e24b99a9533127093bdcd7ead64b2569c864a5b1ff24927b305306841bf2fa"}
Jul 29 19:14:47.602926 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:47.602903    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:14:47.691327 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:47.691293    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks" event={"ID":"a0580d6b-0599-4625-8aa0-101c8bd4f7d6","Type":"ContainerStarted","Data":"3d10ccf23e7be646ed6a1efe6052ae4371718574f4ed09d42afcb82ff966fcca"}
Jul 29 19:14:47.712102 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:47.712046    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks" podStartSLOduration=0.777128186 podStartE2EDuration="1.712025379s" totalImagesPullingTime="934.897193ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:14:47.710941351 +0000 UTC m=+862.555671324" watchObservedRunningTime="2026-07-29 19:14:47.712025379 +0000 UTC m=+862.556755354"
Jul 29 19:14:56.515267 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:56.515232    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:56.515726 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:56.515326    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:56.527821 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:56.527801    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:14:56.742294 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:14:56.742263    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8zsks"
Jul 29 19:15:03.581422 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:03.581388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:05.194664 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.194630    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"]
Jul 29 19:15:05.198210 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.198178    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.201080 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.201059    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 29 19:15:05.209501 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.209480    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"]
Jul 29 19:15:05.236422 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.236391    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:05.260912 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.260887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce23ec97-98c8-4c06-a3d9-792f0c408098-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.261020 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.260917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce23ec97-98c8-4c06-a3d9-792f0c408098-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.261020 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.260937    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwh8j\" (UniqueName: \"kubernetes.io/projected/ce23ec97-98c8-4c06-a3d9-792f0c408098-kube-api-access-dwh8j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.261020 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.260987    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce23ec97-98c8-4c06-a3d9-792f0c408098-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.261142 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.261068    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce23ec97-98c8-4c06-a3d9-792f0c408098-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.261142 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.261101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce23ec97-98c8-4c06-a3d9-792f0c408098-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.362436 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.362392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce23ec97-98c8-4c06-a3d9-792f0c408098-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.362580 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.362457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce23ec97-98c8-4c06-a3d9-792f0c408098-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.362651 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.362631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwh8j\" (UniqueName: \"kubernetes.io/projected/ce23ec97-98c8-4c06-a3d9-792f0c408098-kube-api-access-dwh8j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.362716 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.362692    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce23ec97-98c8-4c06-a3d9-792f0c408098-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.362787 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.362767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce23ec97-98c8-4c06-a3d9-792f0c408098-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.362937 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.362910    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce23ec97-98c8-4c06-a3d9-792f0c408098-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.363045 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.362938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce23ec97-98c8-4c06-a3d9-792f0c408098-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.363045 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.362854    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce23ec97-98c8-4c06-a3d9-792f0c408098-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.363241 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.363219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce23ec97-98c8-4c06-a3d9-792f0c408098-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.365120 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.365098    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce23ec97-98c8-4c06-a3d9-792f0c408098-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.365367 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.365352    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce23ec97-98c8-4c06-a3d9-792f0c408098-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.370808 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.370788    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwh8j\" (UniqueName: \"kubernetes.io/projected/ce23ec97-98c8-4c06-a3d9-792f0c408098-kube-api-access-dwh8j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq\" (UID: \"ce23ec97-98c8-4c06-a3d9-792f0c408098\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.508182 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.508111    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:05.634765 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.634742    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"]
Jul 29 19:15:05.637141 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:15:05.637107    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce23ec97_98c8_4c06_a3d9_792f0c408098.slice/crio-8e3efb593a3efbf8385bd5ec3f7dba978e1a14c176e849bb86c360c4dd35ab84 WatchSource:0}: Error finding container 8e3efb593a3efbf8385bd5ec3f7dba978e1a14c176e849bb86c360c4dd35ab84: Status 404 returned error can't find the container with id 8e3efb593a3efbf8385bd5ec3f7dba978e1a14c176e849bb86c360c4dd35ab84
Jul 29 19:15:05.766635 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:05.766559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq" event={"ID":"ce23ec97-98c8-4c06-a3d9-792f0c408098","Type":"ContainerStarted","Data":"8e3efb593a3efbf8385bd5ec3f7dba978e1a14c176e849bb86c360c4dd35ab84"}
Jul 29 19:15:06.690562 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:06.690479    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:15:06.772046 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:06.771981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq" event={"ID":"ce23ec97-98c8-4c06-a3d9-792f0c408098","Type":"ContainerStarted","Data":"9e3c3ba409efc74f362f1103a7a280f2fdd07cb9756fcdabd77eeeeafba1781e"}
Jul 29 19:15:06.792444 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:06.792377    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq" podStartSLOduration=1.018848313 podStartE2EDuration="1.792361513s" totalImagesPullingTime="773.5132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:15:06.790749555 +0000 UTC m=+881.635479529" watchObservedRunningTime="2026-07-29 19:15:06.792361513 +0000 UTC m=+881.637091463"
Jul 29 19:15:10.605468 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:10.605436    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:13.194689 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:13.194652    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:15:15.508449 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:15.508416    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:15.508881 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:15.508598    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:15.521070 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:15.521045    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:15.818460 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:15.818379    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq"
Jul 29 19:15:19.439268 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:19.439175    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:15:22.927436 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:15:22.927403    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:16:29.546533 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:16:29.546500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:31.593743 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:16:31.593701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:54.824342 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:16:54.824253    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:16:58.503159 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:16:58.503120    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:17:08.696817 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:17:08.696780    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:17:18.457841 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:17:18.457806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:17:18.558377 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:17:18.558347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:17:20.504892 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:17:20.504856    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:17:34.005963 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:17:34.005930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:18:35.183372 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:18:35.183294    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:18:36.434392 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:18:36.434359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:03.004281 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:19:03.004249    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:19:17.668510 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:19:17.668465    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:17.763505 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:19:17.763468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:17.875817 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:19:17.875783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:23.762377 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:19:23.762341    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:23.864599 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:19:23.864567    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:23.963031 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:19:23.962981    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:24.109759 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:19:24.109671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:29.863567 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:19:29.863532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:29.934899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:19:29.934868    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:19:47.211829 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:19:47.211792    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:19:56.494966 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:19:56.494931    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:20:07.493946 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:20:07.493912    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:20:16.003411 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:20:16.003376    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:20:27.798230 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:20:27.798196    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:20:37.510744 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:20:37.510685    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:20:50.205333 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:20:50.205288    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:21:00.357329 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:21:00.357293    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:21:21.705221 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:21:21.705137    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:21:32.405755 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:21:32.405718    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:21:56.701139 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:21:56.701105    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:22:08.135550 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:22:08.135519    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:09.813512 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:22:09.813477    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:22:11.685936 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:22:11.685896    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:22:21.301568 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:22:21.301538    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:22:47.801492 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:22:47.801416    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:22:57.807175 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:22:57.807138    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:23:10.721433 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:23:10.721398    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:23:42.898347 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:23:42.898315    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:23:51.061392 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:23:51.061359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:25:13.817498 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:25:13.817465    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:25:23.119788 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:25:23.119753    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:25:37.904255 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:25:37.904219    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:25:46.109531 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:25:46.109493    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:25:56.388575 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:25:56.388491    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:26:04.300873 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:26:04.300838    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:26:15.308072 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:26:15.308031    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:26:27.698573 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:26:27.698537    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:26:35.697550 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:26:35.697515    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:26:46.197576 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:26:46.197543    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:26:57.292749 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:26:57.292708    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:27:03.694898 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:27:03.694862    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:27:06.653336 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:27:06.653301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:27:06.743738 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:27:06.743707    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:27:25.894928 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:27:25.894856    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:27:34.338975 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:27:34.338937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:27:36.512690 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:27:36.512652    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:27:37.827484 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:27:37.827436    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:27:53.098885 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:27:53.098849    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:28:08.609515 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:28:08.609473    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:28:09.647773 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:28:09.647737    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:28:12.407818 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:28:12.407783    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:28:27.494880 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:28:27.494840    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:28:34.036428 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:28:34.036385    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:28:49.799206 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:28:49.799129    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:28:59.799215 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:28:59.799178    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:29:09.597518 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:29:09.597481    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:29:16.608797 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:29:16.608755    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:29:16.682983 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:29:16.682951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:29:20.004696 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:29:20.004665    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:29:29.301500 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:29:29.301461    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:29:38.999123 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:29:38.999076    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:29:52.606347 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:29:52.606315    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:30:02.097647 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:30:02.097610    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:30:16.901742 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:30:16.901710    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:30:25.793159 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:30:25.793123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:30:37.406325 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:30:37.406290    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:30:52.913287 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:30:52.913252    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:31:04.606749 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:04.606712    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:31:16.193530 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:16.193484    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:31:19.021003 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:19.020970    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:30.501928 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:30.501894    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:31:40.103511 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:40.103477    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:31:40.428383 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:40.428349    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:43.404204 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:43.404167    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:43.497345 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:43.497312    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:43.848693 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:43.848665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:49.604313 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:49.604228    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:31:49.778171 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:49.778137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:49.878762 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:49.878687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:49.990519 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:49.990485    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:50.315178 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:50.315142    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:50.484528 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:50.484497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:52.711185 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:52.711145    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:52.801512 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:52.801480    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:52.945400 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:52.945370    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:53.135279 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:53.135201    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:53.423876 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:53.423844    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:53.535098 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:53.535060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:31:58.194428 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:31:58.194394    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:32:23.350404 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:23.350365    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:23.425465 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:23.425434    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:23.542869 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:23.542837    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:23.752074 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:23.752034    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:23.831358 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:23.831327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:24.021168 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:24.021096    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:24.342903 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:24.342825    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:24.437980 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:24.437954    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:24.539974 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:24.539945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:24.869641 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:24.869601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:24.974288 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:24.974257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:27.019609 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:27.019571    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:27.156320 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:27.156287    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:27.498532 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:27.498498    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:32:27.625096 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:27.625066    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:27.727932 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:27.727900    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:39.396816 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:39.396776    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:32:57.804802 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:57.804764    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:32:59.145515 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:32:59.145483    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:01.140926 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:01.140894    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:01.274798 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:01.274762    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:01.359135 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:01.359107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:01.473492 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:01.473466    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:01.936633 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:01.936598    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:33:02.028292 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:02.028256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:02.126027 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:02.125979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:11.328955 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:11.328928    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:13.493533 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:13.493495    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:33:26.851482 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:26.851405    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5"]
Jul 29 19:33:26.854774 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:26.854756    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5"
Jul 29 19:33:26.857799 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:26.857776    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:33:26.857907 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:26.857815    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nq9q2\""
Jul 29 19:33:26.863074 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:26.863051    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5"]
Jul 29 19:33:27.039956 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:27.039920    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7c5fe5-7e5a-47c3-99da-f701bd73b98d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5\" (UID: \"1a7c5fe5-7e5a-47c3-99da-f701bd73b98d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5"
Jul 29 19:33:27.140718 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:27.140642    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7c5fe5-7e5a-47c3-99da-f701bd73b98d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5\" (UID: \"1a7c5fe5-7e5a-47c3-99da-f701bd73b98d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5"
Jul 29 19:33:27.141262 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:27.141243    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7c5fe5-7e5a-47c3-99da-f701bd73b98d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5\" (UID: \"1a7c5fe5-7e5a-47c3-99da-f701bd73b98d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5"
Jul 29 19:33:27.166241 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:27.166220    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5"
Jul 29 19:33:27.292570 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:27.292536    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5"]
Jul 29 19:33:27.295339 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:33:27.295313    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7c5fe5_7e5a_47c3_99da_f701bd73b98d.slice/crio-553587fde4db22ea3bc93f9eb6c7fc9c5705eebb93f0d07ffbde1a60642f8925 WatchSource:0}: Error finding container 553587fde4db22ea3bc93f9eb6c7fc9c5705eebb93f0d07ffbde1a60642f8925: Status 404 returned error can't find the container with id 553587fde4db22ea3bc93f9eb6c7fc9c5705eebb93f0d07ffbde1a60642f8925
Jul 29 19:33:27.297208 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:27.297190    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:33:28.256887 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:28.256849    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5" event={"ID":"1a7c5fe5-7e5a-47c3-99da-f701bd73b98d","Type":"ContainerStarted","Data":"553587fde4db22ea3bc93f9eb6c7fc9c5705eebb93f0d07ffbde1a60642f8925"}
Jul 29 19:33:30.267382 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:30.267347    2563 generic.go:356] "Generic (PLEG): container finished" podID="1a7c5fe5-7e5a-47c3-99da-f701bd73b98d" containerID="47d7e0e66f9a853170a8784a7c82a7731f5f97d60da720e6d9698888261f740f" exitCode=0
Jul 29 19:33:30.267931 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:30.267435    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5" event={"ID":"1a7c5fe5-7e5a-47c3-99da-f701bd73b98d","Type":"ContainerDied","Data":"47d7e0e66f9a853170a8784a7c82a7731f5f97d60da720e6d9698888261f740f"}
Jul 29 19:33:31.401071 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:31.401040    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5"
Jul 29 19:33:31.479698 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:31.479668    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7c5fe5-7e5a-47c3-99da-f701bd73b98d-maas-api-service-ca\") pod \"1a7c5fe5-7e5a-47c3-99da-f701bd73b98d\" (UID: \"1a7c5fe5-7e5a-47c3-99da-f701bd73b98d\") "
Jul 29 19:33:31.479981 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:31.479958    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a7c5fe5-7e5a-47c3-99da-f701bd73b98d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1a7c5fe5-7e5a-47c3-99da-f701bd73b98d" (UID: "1a7c5fe5-7e5a-47c3-99da-f701bd73b98d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:33:31.580308 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:31.580235    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7c5fe5-7e5a-47c3-99da-f701bd73b98d-maas-api-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:33:32.276595 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:32.276560    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5" event={"ID":"1a7c5fe5-7e5a-47c3-99da-f701bd73b98d","Type":"ContainerDied","Data":"553587fde4db22ea3bc93f9eb6c7fc9c5705eebb93f0d07ffbde1a60642f8925"}
Jul 29 19:33:32.276595 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:32.276596    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5"
Jul 29 19:33:32.276805 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:32.276609    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="553587fde4db22ea3bc93f9eb6c7fc9c5705eebb93f0d07ffbde1a60642f8925"
Jul 29 19:33:41.785318 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:41.785283    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:41.857696 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:41.857654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:41.951560 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:41.951525    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:41.990618 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:41.990580    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5"]
Jul 29 19:33:41.992955 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:41.992930    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6d42a5b6-q9rs5"]
Jul 29 19:33:42.099032 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:42.098930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:43.199293 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:43.199266    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:43.401702 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:43.401658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:43.618954 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:43.618872    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:43.664024 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:43.663981    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a7c5fe5-7e5a-47c3-99da-f701bd73b98d" path="/var/lib/kubelet/pods/1a7c5fe5-7e5a-47c3-99da-f701bd73b98d/volumes"
Jul 29 19:33:43.925269 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:43.925233    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:44.228717 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:44.228639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:45.591285 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:45.591255    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:33:46.418264 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:46.418230    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:46.521136 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:46.521100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:46.624611 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:46.624576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:47.162078 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:47.162038    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:47.310588 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:47.310560    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:33:57.204583 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:33:57.204538    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:34:11.260451 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.260409    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz"]
Jul 29 19:34:11.261059 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.260863    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a7c5fe5-7e5a-47c3-99da-f701bd73b98d" containerName="revoke-keys"
Jul 29 19:34:11.261059 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.260882    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a7c5fe5-7e5a-47c3-99da-f701bd73b98d" containerName="revoke-keys"
Jul 29 19:34:11.261059 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.260967    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a7c5fe5-7e5a-47c3-99da-f701bd73b98d" containerName="revoke-keys"
Jul 29 19:34:11.268438 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.268416    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz"
Jul 29 19:34:11.271304 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.271284    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nq9q2\""
Jul 29 19:34:11.271410 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.271304    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:34:11.274766 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.274741    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz"]
Jul 29 19:34:11.395979 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.395946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2a4df1-a883-4064-a33c-a54ef08744ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3a338fad-669nz\" (UID: \"ef2a4df1-a883-4064-a33c-a54ef08744ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz"
Jul 29 19:34:11.496818 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.496786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2a4df1-a883-4064-a33c-a54ef08744ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3a338fad-669nz\" (UID: \"ef2a4df1-a883-4064-a33c-a54ef08744ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz"
Jul 29 19:34:11.497423 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.497405    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2a4df1-a883-4064-a33c-a54ef08744ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3a338fad-669nz\" (UID: \"ef2a4df1-a883-4064-a33c-a54ef08744ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz"
Jul 29 19:34:11.579594 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.579514    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz"
Jul 29 19:34:11.707548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.707518    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz"]
Jul 29 19:34:11.711152 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:34:11.711122    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2a4df1_a883_4064_a33c_a54ef08744ba.slice/crio-765a82d2a75d2199e7736161cbb3313d60179b36704f305687edf03c48a900c0 WatchSource:0}: Error finding container 765a82d2a75d2199e7736161cbb3313d60179b36704f305687edf03c48a900c0: Status 404 returned error can't find the container with id 765a82d2a75d2199e7736161cbb3313d60179b36704f305687edf03c48a900c0
Jul 29 19:34:11.801757 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.801680    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:11.903530 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:11.903509    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:12.457461 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:12.457430    2563 generic.go:356] "Generic (PLEG): container finished" podID="ef2a4df1-a883-4064-a33c-a54ef08744ba" containerID="d9a3054e4b84c3ea5d8a452152d17f809cb90116be3b407542a6ab94b54fb4c4" exitCode=0
Jul 29 19:34:12.457810 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:12.457511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz" event={"ID":"ef2a4df1-a883-4064-a33c-a54ef08744ba","Type":"ContainerDied","Data":"d9a3054e4b84c3ea5d8a452152d17f809cb90116be3b407542a6ab94b54fb4c4"}
Jul 29 19:34:12.457810 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:12.457559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz" event={"ID":"ef2a4df1-a883-4064-a33c-a54ef08744ba","Type":"ContainerStarted","Data":"765a82d2a75d2199e7736161cbb3313d60179b36704f305687edf03c48a900c0"}
Jul 29 19:34:13.589465 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:13.589443    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz"
Jul 29 19:34:13.716223 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:13.716141    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2a4df1-a883-4064-a33c-a54ef08744ba-maas-api-service-ca\") pod \"ef2a4df1-a883-4064-a33c-a54ef08744ba\" (UID: \"ef2a4df1-a883-4064-a33c-a54ef08744ba\") "
Jul 29 19:34:13.716485 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:13.716462    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef2a4df1-a883-4064-a33c-a54ef08744ba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ef2a4df1-a883-4064-a33c-a54ef08744ba" (UID: "ef2a4df1-a883-4064-a33c-a54ef08744ba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:34:13.817264 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:13.817234    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2a4df1-a883-4064-a33c-a54ef08744ba-maas-api-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:34:14.466347 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:14.466311    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz" event={"ID":"ef2a4df1-a883-4064-a33c-a54ef08744ba","Type":"ContainerDied","Data":"765a82d2a75d2199e7736161cbb3313d60179b36704f305687edf03c48a900c0"}
Jul 29 19:34:14.466347 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:14.466345    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz"
Jul 29 19:34:14.466543 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:14.466365    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="765a82d2a75d2199e7736161cbb3313d60179b36704f305687edf03c48a900c0"
Jul 29 19:34:17.074362 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:17.074330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:17.221470 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:17.221439    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:17.329684 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:17.322301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:17.367590 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:17.367557    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz"]
Jul 29 19:34:17.372629 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:17.372601    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3a338fad-669nz"]
Jul 29 19:34:17.436721 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:17.436690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:17.549310 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:17.549276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:17.664007 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:17.663965    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef2a4df1-a883-4064-a33c-a54ef08744ba" path="/var/lib/kubelet/pods/ef2a4df1-a883-4064-a33c-a54ef08744ba/volumes"
Jul 29 19:34:17.752890 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:17.752864    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:18.209366 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:18.209336    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:18.296175 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:18.296144    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:18.402168 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:18.402133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:19.751575 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:19.751520    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:20.994543 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:20.994508    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:34:26.111768 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:26.111733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:26.231747 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:26.231710    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:26.329917 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:26.329886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:26.428235 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:26.428204    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:26.896566 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:26.896487    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:34:52.810441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:34:52.810359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:00.258907 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:00.258877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:00.365123 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:00.365093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:00.465768 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:00.465737    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:03.701339 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:03.701300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:03.780115 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:03.780085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:16.310822 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:16.310787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:22.420551 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:22.420518    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:22.494310 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:22.494277    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:22.573651 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:22.573623    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:22.674562 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:22.674489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:33.168540 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:33.168504    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:33.917176 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:33.917142    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:40.414048 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:40.414012    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:40.517733 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:40.517701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:40.615584 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:40.615553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:40.716274 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:40.716197    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:43.598838 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:43.598795    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:35:52.172598 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:52.172564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:52.287108 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:52.287080    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:52.401288 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:52.401261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:53.391257 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:53.391226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:54.170669 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:54.170634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:35:55.798662 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:55.798630    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:35:59.960336 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:35:59.960301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:00.059797 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:00.059759    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:00.660444 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:00.660407    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:05.897729 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:05.897693    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:36:06.553764 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:06.553729    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:06.658496 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:06.658459    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:06.826303 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:06.826226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:07.167466 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:07.167437    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:07.382641 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:07.382608    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:09.876914 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:09.876880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:09.983613 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:09.983587    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:10.099196 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:10.099168    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:10.286622 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:10.286590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:10.817732 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:10.817702    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:10.924375 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:10.924344    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:15.204386 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:15.204350    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:36:34.806195 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:34.806157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:35.475795 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:35.475759    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:35.572952 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:35.572923    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:35.856646 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:35.856563    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:42.058280 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.058245    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:42.131604 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.131575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:42.438576 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.438542    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb"]
Jul 29 19:36:42.438871 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.438858    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2a4df1-a883-4064-a33c-a54ef08744ba" containerName="revoke-keys"
Jul 29 19:36:42.438920 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.438873    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2a4df1-a883-4064-a33c-a54ef08744ba" containerName="revoke-keys"
Jul 29 19:36:42.438954 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.438942    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef2a4df1-a883-4064-a33c-a54ef08744ba" containerName="revoke-keys"
Jul 29 19:36:42.441697 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.441680    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb"
Jul 29 19:36:42.445670 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.445651    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:36:42.445806 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.445696    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nq9q2\""
Jul 29 19:36:42.452840 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.452818    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb"]
Jul 29 19:36:42.494231 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.494201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8c54f61-0727-4dcb-884f-2bc3199a891c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb\" (UID: \"d8c54f61-0727-4dcb-884f-2bc3199a891c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb"
Jul 29 19:36:42.594830 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.594793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8c54f61-0727-4dcb-884f-2bc3199a891c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb\" (UID: \"d8c54f61-0727-4dcb-884f-2bc3199a891c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb"
Jul 29 19:36:42.595422 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.595396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8c54f61-0727-4dcb-884f-2bc3199a891c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb\" (UID: \"d8c54f61-0727-4dcb-884f-2bc3199a891c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb"
Jul 29 19:36:42.752391 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.752323    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb"
Jul 29 19:36:42.887055 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:42.887027    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb"]
Jul 29 19:36:42.889280 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:36:42.889253    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8c54f61_0727_4dcb_884f_2bc3199a891c.slice/crio-2d87b4e88eb2042c5efb1171d9ffc49e1554020f70dc1c7795f75030293d2dee WatchSource:0}: Error finding container 2d87b4e88eb2042c5efb1171d9ffc49e1554020f70dc1c7795f75030293d2dee: Status 404 returned error can't find the container with id 2d87b4e88eb2042c5efb1171d9ffc49e1554020f70dc1c7795f75030293d2dee
Jul 29 19:36:43.073737 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:43.073669    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb" event={"ID":"d8c54f61-0727-4dcb-884f-2bc3199a891c","Type":"ContainerStarted","Data":"2d87b4e88eb2042c5efb1171d9ffc49e1554020f70dc1c7795f75030293d2dee"}
Jul 29 19:36:44.079700 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:44.079667    2563 generic.go:356] "Generic (PLEG): container finished" podID="d8c54f61-0727-4dcb-884f-2bc3199a891c" containerID="2b39ebd0f116fc1ff9283c6f647ea966c0e59c8d52d17a53c8ee432adf72e397" exitCode=0
Jul 29 19:36:44.080116 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:44.079755    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb" event={"ID":"d8c54f61-0727-4dcb-884f-2bc3199a891c","Type":"ContainerDied","Data":"2b39ebd0f116fc1ff9283c6f647ea966c0e59c8d52d17a53c8ee432adf72e397"}
Jul 29 19:36:45.217035 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:45.217011    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb"
Jul 29 19:36:45.316681 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:45.316650    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8c54f61-0727-4dcb-884f-2bc3199a891c-maas-api-service-ca\") pod \"d8c54f61-0727-4dcb-884f-2bc3199a891c\" (UID: \"d8c54f61-0727-4dcb-884f-2bc3199a891c\") "
Jul 29 19:36:45.316970 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:45.316950    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8c54f61-0727-4dcb-884f-2bc3199a891c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d8c54f61-0727-4dcb-884f-2bc3199a891c" (UID: "d8c54f61-0727-4dcb-884f-2bc3199a891c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:36:45.418124 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:45.418099    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8c54f61-0727-4dcb-884f-2bc3199a891c-maas-api-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:36:46.089527 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:46.089433    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb"
Jul 29 19:36:46.089527 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:46.089464    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb" event={"ID":"d8c54f61-0727-4dcb-884f-2bc3199a891c","Type":"ContainerDied","Data":"2d87b4e88eb2042c5efb1171d9ffc49e1554020f70dc1c7795f75030293d2dee"}
Jul 29 19:36:46.089527 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:46.089521    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d87b4e88eb2042c5efb1171d9ffc49e1554020f70dc1c7795f75030293d2dee"
Jul 29 19:36:52.882135 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:52.882101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:52.990221 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:52.990190    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:53.068377 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:53.068340    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb"]
Jul 29 19:36:53.072077 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:53.072047    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7beba8e5-qfbnb"]
Jul 29 19:36:53.073605 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:53.073526    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:53.476290 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:53.476259    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:53.664243 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:53.664206    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8c54f61-0727-4dcb-884f-2bc3199a891c" path="/var/lib/kubelet/pods/d8c54f61-0727-4dcb-884f-2bc3199a891c/volumes"
Jul 29 19:36:55.796161 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:55.796125    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:36:59.649269 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:59.649231    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:59.750318 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:59.750289    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:36:59.939334 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:36:59.939300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:00.172728 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:00.172697    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:00.310078 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:00.309973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:00.409828 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:00.409799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:00.517824 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:00.517797    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:06.463447 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:06.463412    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:06.602586 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:06.602547    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:06.698647 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:06.698617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:06.812017 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:06.811930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:12.507527 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:12.507488    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:12.607482 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:12.607449    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:19.333818 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:19.333783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:19.696960 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:19.696932    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:20.267627 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:20.267588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:22.249183 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:22.249147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:22.349767 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:22.349730    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:22.433634 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:22.433600    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:22.937082 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:22.937039    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:23.025488 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:23.025456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:27.206164 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:27.206127    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:37:47.273958 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:47.273878    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:37:54.116189 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:37:54.116155    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:38:05.178982 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:05.178940    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:38:08.206667 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:08.206633    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:38:22.297873 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:22.297834    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:38:26.724360 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:26.724322    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4"]
Jul 29 19:38:26.724795 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:26.724657    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8c54f61-0727-4dcb-884f-2bc3199a891c" containerName="revoke-keys"
Jul 29 19:38:26.724795 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:26.724674    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8c54f61-0727-4dcb-884f-2bc3199a891c" containerName="revoke-keys"
Jul 29 19:38:26.724795 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:26.724734    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8c54f61-0727-4dcb-884f-2bc3199a891c" containerName="revoke-keys"
Jul 29 19:38:26.727599 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:26.727581    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4"
Jul 29 19:38:26.730302 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:26.730281    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nq9q2\""
Jul 29 19:38:26.730424 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:26.730372    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:38:26.733881 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:26.733821    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4"]
Jul 29 19:38:26.810886 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:26.810850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1039064f-27a1-4c20-a23c-03c9feba4525-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4\" (UID: \"1039064f-27a1-4c20-a23c-03c9feba4525\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4"
Jul 29 19:38:26.912069 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:26.912038    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1039064f-27a1-4c20-a23c-03c9feba4525-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4\" (UID: \"1039064f-27a1-4c20-a23c-03c9feba4525\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4"
Jul 29 19:38:26.912639 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:26.912619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1039064f-27a1-4c20-a23c-03c9feba4525-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4\" (UID: \"1039064f-27a1-4c20-a23c-03c9feba4525\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4"
Jul 29 19:38:27.040482 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:27.040404    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4"
Jul 29 19:38:27.174297 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:27.173806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4"]
Jul 29 19:38:27.515651 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:27.515610    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4" event={"ID":"1039064f-27a1-4c20-a23c-03c9feba4525","Type":"ContainerStarted","Data":"6d0fc87e5c9a48c971373a48bda46c8c18ea067634b4d99d09b122b6b0063116"}
Jul 29 19:38:27.515788 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:27.515673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4" event={"ID":"1039064f-27a1-4c20-a23c-03c9feba4525","Type":"ContainerStarted","Data":"8638e600c76c4b788867f9a976f48241d2343ca84b18972918b57806f2a5a60b"}
Jul 29 19:38:27.531344 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:27.531302    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4" podStartSLOduration=1.531288126 podStartE2EDuration="1.531288126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:38:27.529798638 +0000 UTC m=+2282.374528609" watchObservedRunningTime="2026-07-29 19:38:27.531288126 +0000 UTC m=+2282.376018092"
Jul 29 19:38:28.521453 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:28.521419    2563 generic.go:356] "Generic (PLEG): container finished" podID="1039064f-27a1-4c20-a23c-03c9feba4525" containerID="6d0fc87e5c9a48c971373a48bda46c8c18ea067634b4d99d09b122b6b0063116" exitCode=0
Jul 29 19:38:28.521832 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:28.521506    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4" event={"ID":"1039064f-27a1-4c20-a23c-03c9feba4525","Type":"ContainerDied","Data":"6d0fc87e5c9a48c971373a48bda46c8c18ea067634b4d99d09b122b6b0063116"}
Jul 29 19:38:29.652001 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:29.651967    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4"
Jul 29 19:38:29.734091 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:29.734065    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1039064f-27a1-4c20-a23c-03c9feba4525-maas-api-service-ca\") pod \"1039064f-27a1-4c20-a23c-03c9feba4525\" (UID: \"1039064f-27a1-4c20-a23c-03c9feba4525\") "
Jul 29 19:38:29.734422 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:29.734400    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1039064f-27a1-4c20-a23c-03c9feba4525-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1039064f-27a1-4c20-a23c-03c9feba4525" (UID: "1039064f-27a1-4c20-a23c-03c9feba4525"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:38:29.835155 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:29.835088    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1039064f-27a1-4c20-a23c-03c9feba4525-maas-api-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:38:30.531025 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:30.530982    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4"
Jul 29 19:38:30.531025 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:30.531007    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4" event={"ID":"1039064f-27a1-4c20-a23c-03c9feba4525","Type":"ContainerDied","Data":"8638e600c76c4b788867f9a976f48241d2343ca84b18972918b57806f2a5a60b"}
Jul 29 19:38:30.531278 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:30.531049    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8638e600c76c4b788867f9a976f48241d2343ca84b18972918b57806f2a5a60b"
Jul 29 19:38:40.803650 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:40.803609    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:38:42.133899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:42.133855    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:38:42.203833 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:42.203803    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:38:42.282967 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:42.282937    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4"]
Jul 29 19:38:42.285925 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:42.285896    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77b3a01f-gmsl4"]
Jul 29 19:38:42.385287 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:42.385216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:38:42.494336 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:42.494306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:38:43.663640 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:43.663602    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1039064f-27a1-4c20-a23c-03c9feba4525" path="/var/lib/kubelet/pods/1039064f-27a1-4c20-a23c-03c9feba4525/volumes"
Jul 29 19:38:45.366016 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:45.365964    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:38:50.442223 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:50.442186    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:38:51.693063 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:38:51.693027    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:39:13.697841 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:13.697804    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:26.497926 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:26.497892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:27.539858 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:27.539821    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:33.155912 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:33.155875    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:47.586934 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:47.586900    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:47.687600 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:47.687563    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:47.856106 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:47.856018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:48.087274 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:48.087241    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:49.130864 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:49.130832    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:49.232531 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:49.232496    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:49.332691 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:49.332664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:50.055665 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:50.055626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:50.150095 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:50.150064    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:51.567074 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:51.567040    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:51.809229 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:51.809197    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:39:57.549761 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:57.549732    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:57.723812 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:57.723782    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:39:58.275875 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:39:58.275842    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:04.419648 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:04.419612    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:40:04.694446 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:04.694369    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:04.820064 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:04.820028    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:04.916303 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:04.916272    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:15.388782 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:15.388743    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:15.721198 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:15.721154    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:25.744255 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:25.744226    2563 scope.go:117] "RemoveContainer" containerID="47d7e0e66f9a853170a8784a7c82a7731f5f97d60da720e6d9698888261f740f"
Jul 29 19:40:25.752098 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:25.752079    2563 scope.go:117] "RemoveContainer" containerID="d9a3054e4b84c3ea5d8a452152d17f809cb90116be3b407542a6ab94b54fb4c4"
Jul 29 19:40:36.646646 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:36.646603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:43.443823 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:43.443787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:43.541913 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:43.541884    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:43.767292 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:43.767217    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:44.091709 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:44.091606    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:44.190317 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:44.190281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:47.492154 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:47.492071    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:47.598783 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:47.598753    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:47.693769 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:47.693742    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:47.793475 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:47.793400    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:48.145960 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:48.145875    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:48.244312 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:48.244281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:48.969368 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:48.969334    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:49.073600 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:49.073569    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:40:53.214668 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:40:53.214632    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:41:12.431093 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:41:12.431058    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:12.813119 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:41:12.813038    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:13.066500 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:41:13.066412    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:13.549796 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:41:13.549762    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:15.667046 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:41:15.667011    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:15.764326 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:41:15.764291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:15.863055 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:41:15.863018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:15.988856 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:41:15.988781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:16.541730 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:41:16.541698    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:16.642319 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:41:16.642286    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:20.496616 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:41:20.496585    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:41:26.843186 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:41:26.843147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:41:40.612013 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:41:40.611963    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:01.295346 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.295301    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"]
Jul 29 19:42:01.295794 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.295645    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1039064f-27a1-4c20-a23c-03c9feba4525" containerName="revoke-keys"
Jul 29 19:42:01.295794 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.295658    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1039064f-27a1-4c20-a23c-03c9feba4525" containerName="revoke-keys"
Jul 29 19:42:01.295794 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.295719    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1039064f-27a1-4c20-a23c-03c9feba4525" containerName="revoke-keys"
Jul 29 19:42:01.298594 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.298565    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.301757 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.301731    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-909676\"/\"kube-root-ca.crt\""
Jul 29 19:42:01.303106 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.303085    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-909676\"/\"openshift-service-ca.crt\""
Jul 29 19:42:01.303230 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.303130    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-909676\"/\"test-model-909676-kserve-self-signed-certs\""
Jul 29 19:42:01.303230 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.303130    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-909676\"/\"default-dockercfg-tgpdw\""
Jul 29 19:42:01.310314 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.310291    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"]
Jul 29 19:42:01.395821 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.395786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:01.410408 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.410384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-tmp-dir\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.410498 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.410417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-model-cache\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.410498 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.410436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-dshm\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.410612 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.410570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-home\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.410657 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.410617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8652ce28-2288-4045-8c8e-01e0c51c5bc6-tls-certs\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.410697 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.410670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hktx\" (UniqueName: \"kubernetes.io/projected/8652ce28-2288-4045-8c8e-01e0c51c5bc6-kube-api-access-2hktx\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.511276 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.511252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8652ce28-2288-4045-8c8e-01e0c51c5bc6-tls-certs\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.511417 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.511286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hktx\" (UniqueName: \"kubernetes.io/projected/8652ce28-2288-4045-8c8e-01e0c51c5bc6-kube-api-access-2hktx\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.511459 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.511412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-tmp-dir\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.511459 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.511451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-model-cache\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.511538 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.511471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-dshm\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.511588 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.511536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-home\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.511822 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.511803    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-tmp-dir\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.511926 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.511827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-model-cache\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.511969 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.511939    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-home\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.513650 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.513620    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-dshm\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.513773 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.513665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8652ce28-2288-4045-8c8e-01e0c51c5bc6-tls-certs\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.521187 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.521164    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hktx\" (UniqueName: \"kubernetes.io/projected/8652ce28-2288-4045-8c8e-01e0c51c5bc6-kube-api-access-2hktx\") pod \"test-model-909676-kserve-5f5fd4fbb7-4975c\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") " pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.608612 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.608538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:01.738600 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:01.738491    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"]
Jul 29 19:42:01.741308 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:42:01.741276    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8652ce28_2288_4045_8c8e_01e0c51c5bc6.slice/crio-e125f789324034f82bcbd3b20c30bb3d8ed9a1e4eeab6e6ec49d95f1d15d304b WatchSource:0}: Error finding container e125f789324034f82bcbd3b20c30bb3d8ed9a1e4eeab6e6ec49d95f1d15d304b: Status 404 returned error can't find the container with id e125f789324034f82bcbd3b20c30bb3d8ed9a1e4eeab6e6ec49d95f1d15d304b
Jul 29 19:42:02.433432 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:02.433391    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c" event={"ID":"8652ce28-2288-4045-8c8e-01e0c51c5bc6","Type":"ContainerStarted","Data":"3d8374d68d3896780e829d395f9dbe3b1f3ea7f33b8ff5e082fb59d29b46a059"}
Jul 29 19:42:02.433432 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:02.433439    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c" event={"ID":"8652ce28-2288-4045-8c8e-01e0c51c5bc6","Type":"ContainerStarted","Data":"e125f789324034f82bcbd3b20c30bb3d8ed9a1e4eeab6e6ec49d95f1d15d304b"}
Jul 29 19:42:02.455106 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:02.455059    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c" podStartSLOduration=1.455045353 podStartE2EDuration="1.455045353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:42:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:42:02.452731911 +0000 UTC m=+2497.297461884" watchObservedRunningTime="2026-07-29 19:42:02.455045353 +0000 UTC m=+2497.299775327"
Jul 29 19:42:04.990915 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:04.990878    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:42:09.349138 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:09.349101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:09.409863 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:09.409831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:11.609060 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:11.609031    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:11.609428 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:11.609072    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:11.621608 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:11.621582    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:12.485113 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:12.485087    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:42:19.002464 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:19.002428    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:42:34.878807 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:34.878772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:42:38.912203 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:38.912165    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:42:53.009691 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:42:53.009654    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:43:20.554343 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:20.554310    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"]
Jul 29 19:43:20.577397 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:20.577362    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:21.697107 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:21.697070    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9"]
Jul 29 19:43:21.700357 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:21.700336    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9"
Jul 29 19:43:21.704572 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:21.704554    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nq9q2\""
Jul 29 19:43:21.704909 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:21.704894    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:43:21.721891 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:21.721869    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9"]
Jul 29 19:43:21.765212 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:21.765184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7c65af-976e-477e-8b09-a465837ca637-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-909676-jkqc9\" (UID: \"9b7c65af-976e-477e-8b09-a465837ca637\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9"
Jul 29 19:43:21.866569 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:21.866545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7c65af-976e-477e-8b09-a465837ca637-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-909676-jkqc9\" (UID: \"9b7c65af-976e-477e-8b09-a465837ca637\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9"
Jul 29 19:43:21.867195 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:21.867174    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7c65af-976e-477e-8b09-a465837ca637-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-909676-jkqc9\" (UID: \"9b7c65af-976e-477e-8b09-a465837ca637\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9"
Jul 29 19:43:22.010038 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:22.009957    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9"
Jul 29 19:43:22.031842 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:22.031808    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:22.137161 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:22.137125    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9"]
Jul 29 19:43:22.139533 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:43:22.139507    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7c65af_976e_477e_8b09_a465837ca637.slice/crio-9007619512d8a94b2a24e11ae836540748f84806317a108de754f11adc63b4a8 WatchSource:0}: Error finding container 9007619512d8a94b2a24e11ae836540748f84806317a108de754f11adc63b4a8: Status 404 returned error can't find the container with id 9007619512d8a94b2a24e11ae836540748f84806317a108de754f11adc63b4a8
Jul 29 19:43:22.768201 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:22.768170    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9" event={"ID":"9b7c65af-976e-477e-8b09-a465837ca637","Type":"ContainerStarted","Data":"1fa4f39402acb81957ce2ac13f27da4af8088f0fdfc3704c6dfe0352aa07d485"}
Jul 29 19:43:22.768617 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:22.768226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9" event={"ID":"9b7c65af-976e-477e-8b09-a465837ca637","Type":"ContainerStarted","Data":"9007619512d8a94b2a24e11ae836540748f84806317a108de754f11adc63b4a8"}
Jul 29 19:43:22.785783 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:22.785741    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9" podStartSLOduration=1.785725904 podStartE2EDuration="1.785725904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:43:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:43:22.784140981 +0000 UTC m=+2577.628870954" watchObservedRunningTime="2026-07-29 19:43:22.785725904 +0000 UTC m=+2577.630455875"
Jul 29 19:43:23.774171 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:23.774135    2563 generic.go:356] "Generic (PLEG): container finished" podID="9b7c65af-976e-477e-8b09-a465837ca637" containerID="1fa4f39402acb81957ce2ac13f27da4af8088f0fdfc3704c6dfe0352aa07d485" exitCode=0
Jul 29 19:43:23.774171 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:23.774173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9" event={"ID":"9b7c65af-976e-477e-8b09-a465837ca637","Type":"ContainerDied","Data":"1fa4f39402acb81957ce2ac13f27da4af8088f0fdfc3704c6dfe0352aa07d485"}
Jul 29 19:43:24.913101 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:24.913071    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9"
Jul 29 19:43:24.986327 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:24.986295    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7c65af-976e-477e-8b09-a465837ca637-maas-api-service-ca\") pod \"9b7c65af-976e-477e-8b09-a465837ca637\" (UID: \"9b7c65af-976e-477e-8b09-a465837ca637\") "
Jul 29 19:43:24.986624 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:24.986600    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b7c65af-976e-477e-8b09-a465837ca637-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9b7c65af-976e-477e-8b09-a465837ca637" (UID: "9b7c65af-976e-477e-8b09-a465837ca637"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:43:25.087345 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:25.087256    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7c65af-976e-477e-8b09-a465837ca637-maas-api-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:43:25.499550 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:25.499517    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:43:25.781953 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:25.781879    2563 scope.go:117] "RemoveContainer" containerID="2b39ebd0f116fc1ff9283c6f647ea966c0e59c8d52d17a53c8ee432adf72e397"
Jul 29 19:43:25.788037 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:25.788015    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9"
Jul 29 19:43:25.788151 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:25.788023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9" event={"ID":"9b7c65af-976e-477e-8b09-a465837ca637","Type":"ContainerDied","Data":"9007619512d8a94b2a24e11ae836540748f84806317a108de754f11adc63b4a8"}
Jul 29 19:43:25.788151 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:25.788078    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9007619512d8a94b2a24e11ae836540748f84806317a108de754f11adc63b4a8"
Jul 29 19:43:32.259285 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:32.259251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:32.360499 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:32.360466    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:32.432987 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:32.432952    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9"]
Jul 29 19:43:32.435140 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:32.435114    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-909676-jkqc9"]
Jul 29 19:43:32.435461 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:32.435430    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:32.822407 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:32.822380    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:33.664022 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:33.663973    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b7c65af-976e-477e-8b09-a465837ca637" path="/var/lib/kubelet/pods/9b7c65af-976e-477e-8b09-a465837ca637/volumes"
Jul 29 19:43:35.573177 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.573139    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c" podUID="8652ce28-2288-4045-8c8e-01e0c51c5bc6" containerName="main" containerID="cri-o://3d8374d68d3896780e829d395f9dbe3b1f3ea7f33b8ff5e082fb59d29b46a059" gracePeriod=45
Jul 29 19:43:35.824203 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.824148    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:43:35.832818 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.832792    2563 generic.go:356] "Generic (PLEG): container finished" podID="8652ce28-2288-4045-8c8e-01e0c51c5bc6" containerID="3d8374d68d3896780e829d395f9dbe3b1f3ea7f33b8ff5e082fb59d29b46a059" exitCode=0
Jul 29 19:43:35.832915 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.832832    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"
Jul 29 19:43:35.832915 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.832868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c" event={"ID":"8652ce28-2288-4045-8c8e-01e0c51c5bc6","Type":"ContainerDied","Data":"3d8374d68d3896780e829d395f9dbe3b1f3ea7f33b8ff5e082fb59d29b46a059"}
Jul 29 19:43:35.832915 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.832908    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c" event={"ID":"8652ce28-2288-4045-8c8e-01e0c51c5bc6","Type":"ContainerDied","Data":"e125f789324034f82bcbd3b20c30bb3d8ed9a1e4eeab6e6ec49d95f1d15d304b"}
Jul 29 19:43:35.833045 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.832925    2563 scope.go:117] "RemoveContainer" containerID="3d8374d68d3896780e829d395f9dbe3b1f3ea7f33b8ff5e082fb59d29b46a059"
Jul 29 19:43:35.840345 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.840326    2563 scope.go:117] "RemoveContainer" containerID="3d8374d68d3896780e829d395f9dbe3b1f3ea7f33b8ff5e082fb59d29b46a059"
Jul 29 19:43:35.840609 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:43:35.840578    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d8374d68d3896780e829d395f9dbe3b1f3ea7f33b8ff5e082fb59d29b46a059\": container with ID starting with 3d8374d68d3896780e829d395f9dbe3b1f3ea7f33b8ff5e082fb59d29b46a059 not found: ID does not exist" containerID="3d8374d68d3896780e829d395f9dbe3b1f3ea7f33b8ff5e082fb59d29b46a059"
Jul 29 19:43:35.840669 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.840610    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d8374d68d3896780e829d395f9dbe3b1f3ea7f33b8ff5e082fb59d29b46a059"} err="failed to get container status \"3d8374d68d3896780e829d395f9dbe3b1f3ea7f33b8ff5e082fb59d29b46a059\": rpc error: code = NotFound desc = could not find container \"3d8374d68d3896780e829d395f9dbe3b1f3ea7f33b8ff5e082fb59d29b46a059\": container with ID starting with 3d8374d68d3896780e829d395f9dbe3b1f3ea7f33b8ff5e082fb59d29b46a059 not found: ID does not exist"
Jul 29 19:43:35.874424 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.874399    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8652ce28-2288-4045-8c8e-01e0c51c5bc6-tls-certs\") pod \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") "
Jul 29 19:43:35.874538 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.874457    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-home\") pod \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") "
Jul 29 19:43:35.874538 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.874490    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-tmp-dir\") pod \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") "
Jul 29 19:43:35.874538 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.874504    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-dshm\") pod \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") "
Jul 29 19:43:35.874748 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.874542    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-model-cache\") pod \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") "
Jul 29 19:43:35.874748 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.874563    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hktx\" (UniqueName: \"kubernetes.io/projected/8652ce28-2288-4045-8c8e-01e0c51c5bc6-kube-api-access-2hktx\") pod \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\" (UID: \"8652ce28-2288-4045-8c8e-01e0c51c5bc6\") "
Jul 29 19:43:35.874748 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.874737    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-home" (OuterVolumeSpecName: "home") pod "8652ce28-2288-4045-8c8e-01e0c51c5bc6" (UID: "8652ce28-2288-4045-8c8e-01e0c51c5bc6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:43:35.874908 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.874744    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8652ce28-2288-4045-8c8e-01e0c51c5bc6" (UID: "8652ce28-2288-4045-8c8e-01e0c51c5bc6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:43:35.874908 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.874766    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-model-cache" (OuterVolumeSpecName: "model-cache") pod "8652ce28-2288-4045-8c8e-01e0c51c5bc6" (UID: "8652ce28-2288-4045-8c8e-01e0c51c5bc6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:43:35.876614 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.876587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8652ce28-2288-4045-8c8e-01e0c51c5bc6-kube-api-access-2hktx" (OuterVolumeSpecName: "kube-api-access-2hktx") pod "8652ce28-2288-4045-8c8e-01e0c51c5bc6" (UID: "8652ce28-2288-4045-8c8e-01e0c51c5bc6"). InnerVolumeSpecName "kube-api-access-2hktx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:43:35.876614 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.876604    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-dshm" (OuterVolumeSpecName: "dshm") pod "8652ce28-2288-4045-8c8e-01e0c51c5bc6" (UID: "8652ce28-2288-4045-8c8e-01e0c51c5bc6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:43:35.876742 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.876668    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8652ce28-2288-4045-8c8e-01e0c51c5bc6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8652ce28-2288-4045-8c8e-01e0c51c5bc6" (UID: "8652ce28-2288-4045-8c8e-01e0c51c5bc6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:43:35.976127 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.976101    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-home\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:43:35.976127 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.976121    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-tmp-dir\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:43:35.976127 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.976130    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-dshm\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:43:35.976304 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.976137    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8652ce28-2288-4045-8c8e-01e0c51c5bc6-model-cache\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:43:35.976304 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.976148    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hktx\" (UniqueName: \"kubernetes.io/projected/8652ce28-2288-4045-8c8e-01e0c51c5bc6-kube-api-access-2hktx\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:43:35.976304 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:35.976157    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8652ce28-2288-4045-8c8e-01e0c51c5bc6-tls-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:43:36.155875 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:36.155845    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"]
Jul 29 19:43:36.162175 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:36.161776    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-909676/test-model-909676-kserve-5f5fd4fbb7-4975c"]
Jul 29 19:43:37.663612 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:37.663580    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8652ce28-2288-4045-8c8e-01e0c51c5bc6" path="/var/lib/kubelet/pods/8652ce28-2288-4045-8c8e-01e0c51c5bc6/volumes"
Jul 29 19:43:38.766797 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:38.766763    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:38.867149 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:38.867118    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:39.067696 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.067588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:39.277877 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.277846    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:39.379604 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.379537    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk"]
Jul 29 19:43:39.379840 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.379826    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7c65af-976e-477e-8b09-a465837ca637" containerName="revoke-keys"
Jul 29 19:43:39.379884 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.379841    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7c65af-976e-477e-8b09-a465837ca637" containerName="revoke-keys"
Jul 29 19:43:39.379884 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.379856    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8652ce28-2288-4045-8c8e-01e0c51c5bc6" containerName="main"
Jul 29 19:43:39.379884 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.379862    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8652ce28-2288-4045-8c8e-01e0c51c5bc6" containerName="main"
Jul 29 19:43:39.379975 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.379910    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8652ce28-2288-4045-8c8e-01e0c51c5bc6" containerName="main"
Jul 29 19:43:39.379975 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.379917    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b7c65af-976e-477e-8b09-a465837ca637" containerName="revoke-keys"
Jul 29 19:43:39.383856 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.383839    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk"
Jul 29 19:43:39.386856 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.386831    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:43:39.387094 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.387080    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nq9q2\""
Jul 29 19:43:39.392788 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.392765    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk"]
Jul 29 19:43:39.500891 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.500863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb745af-616e-4ec3-adc8-7c185493f0c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk\" (UID: \"1fb745af-616e-4ec3-adc8-7c185493f0c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk"
Jul 29 19:43:39.601552 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.601520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb745af-616e-4ec3-adc8-7c185493f0c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk\" (UID: \"1fb745af-616e-4ec3-adc8-7c185493f0c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk"
Jul 29 19:43:39.602118 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.602101    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb745af-616e-4ec3-adc8-7c185493f0c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk\" (UID: \"1fb745af-616e-4ec3-adc8-7c185493f0c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk"
Jul 29 19:43:39.695176 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.695155    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk"
Jul 29 19:43:39.826501 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.826444    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk"]
Jul 29 19:43:39.829690 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:43:39.829659    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb745af_616e_4ec3_adc8_7c185493f0c3.slice/crio-c159532233528f7fe11754a1491451202bcea9fce6996440df4f665c2ffe4c56 WatchSource:0}: Error finding container c159532233528f7fe11754a1491451202bcea9fce6996440df4f665c2ffe4c56: Status 404 returned error can't find the container with id c159532233528f7fe11754a1491451202bcea9fce6996440df4f665c2ffe4c56
Jul 29 19:43:39.861634 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:39.861601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk" event={"ID":"1fb745af-616e-4ec3-adc8-7c185493f0c3","Type":"ContainerStarted","Data":"c159532233528f7fe11754a1491451202bcea9fce6996440df4f665c2ffe4c56"}
Jul 29 19:43:40.867469 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:40.867385    2563 generic.go:356] "Generic (PLEG): container finished" podID="1fb745af-616e-4ec3-adc8-7c185493f0c3" containerID="3598e67867afb714643074648c6add9de151badbcc6c1d877ba962bed8eb2366" exitCode=0
Jul 29 19:43:40.867815 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:40.867475    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk" event={"ID":"1fb745af-616e-4ec3-adc8-7c185493f0c3","Type":"ContainerDied","Data":"3598e67867afb714643074648c6add9de151badbcc6c1d877ba962bed8eb2366"}
Jul 29 19:43:42.008140 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:42.008113    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:43:42.014524 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:42.014506    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk"
Jul 29 19:43:42.124675 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:42.124609    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb745af-616e-4ec3-adc8-7c185493f0c3-maas-api-service-ca\") pod \"1fb745af-616e-4ec3-adc8-7c185493f0c3\" (UID: \"1fb745af-616e-4ec3-adc8-7c185493f0c3\") "
Jul 29 19:43:42.124919 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:42.124897    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb745af-616e-4ec3-adc8-7c185493f0c3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1fb745af-616e-4ec3-adc8-7c185493f0c3" (UID: "1fb745af-616e-4ec3-adc8-7c185493f0c3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:43:42.225412 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:42.225387    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fb745af-616e-4ec3-adc8-7c185493f0c3-maas-api-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:43:42.882559 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:42.882528    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk"
Jul 29 19:43:42.882720 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:42.882555    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk" event={"ID":"1fb745af-616e-4ec3-adc8-7c185493f0c3","Type":"ContainerDied","Data":"c159532233528f7fe11754a1491451202bcea9fce6996440df4f665c2ffe4c56"}
Jul 29 19:43:42.882720 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:42.882643    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c159532233528f7fe11754a1491451202bcea9fce6996440df4f665c2ffe4c56"
Jul 29 19:43:49.925501 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:49.925421    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:50.026651 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:50.026615    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:50.089601 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:50.089567    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk"]
Jul 29 19:43:50.090889 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:50.090869    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b3bf1c-968gk"]
Jul 29 19:43:50.105340 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:50.105314    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:50.455861 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:50.455822    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:51.665200 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:51.665167    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fb745af-616e-4ec3-adc8-7c185493f0c3" path="/var/lib/kubelet/pods/1fb745af-616e-4ec3-adc8-7c185493f0c3/volumes"
Jul 29 19:43:53.914985 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:53.914948    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:43:56.190100 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:56.190063    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:56.294688 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:56.294652    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:56.457344 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:56.457266    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:56.674395 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:56.674359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:57.000737 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:57.000704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:57.422458 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:57.422424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:43:57.657484 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:43:57.657446    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:00.834817 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:00.834777    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:00.933857 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:00.933825    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:01.359745 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:01.359708    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:01.466610 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:01.466578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:01.953404 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:01.953374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:02.082555 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:02.082501    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:06.503612 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:06.503575    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:44:10.284905 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:10.284866    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:10.817217 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:10.817183    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:11.137301 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:11.137225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:11.328172 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:11.328146    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:13.766041 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:13.766007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:13.859172 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:13.859142    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:14.259853 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:14.259815    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:14.668763 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:14.668728    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:14.795542 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:14.795505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:14.893417 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:14.893378    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:21.596043 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:21.596006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:44:28.473804 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:28.473770    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:31.313129 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:31.313094    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8"]
Jul 29 19:44:31.313516 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:31.313411    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb745af-616e-4ec3-adc8-7c185493f0c3" containerName="revoke-keys"
Jul 29 19:44:31.313516 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:31.313422    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb745af-616e-4ec3-adc8-7c185493f0c3" containerName="revoke-keys"
Jul 29 19:44:31.313516 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:31.313483    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fb745af-616e-4ec3-adc8-7c185493f0c3" containerName="revoke-keys"
Jul 29 19:44:31.317824 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:31.317803    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8"
Jul 29 19:44:31.321561 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:31.321538    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:44:31.321679 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:31.321621    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nq9q2\""
Jul 29 19:44:31.327661 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:31.327630    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8"]
Jul 29 19:44:31.418426 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:31.418390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8\" (UID: \"f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8"
Jul 29 19:44:31.519008 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:31.518962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8\" (UID: \"f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8"
Jul 29 19:44:31.519555 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:31.519536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8\" (UID: \"f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8"
Jul 29 19:44:31.629394 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:31.629332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8"
Jul 29 19:44:31.756140 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:31.756108    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8"]
Jul 29 19:44:31.759025 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:44:31.758981    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d8c49a_75e0_4ab2_8af9_31c7d5d7f1a0.slice/crio-85f263266fddf36a68f1e3ed1b625b13dc1ca815df60c2d8fc8f252170ff8192 WatchSource:0}: Error finding container 85f263266fddf36a68f1e3ed1b625b13dc1ca815df60c2d8fc8f252170ff8192: Status 404 returned error can't find the container with id 85f263266fddf36a68f1e3ed1b625b13dc1ca815df60c2d8fc8f252170ff8192
Jul 29 19:44:32.101561 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:32.101532    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8" event={"ID":"f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0","Type":"ContainerStarted","Data":"a011d3444e010ab7dfacb52e743377574bac8775ebe945bced08888eadcf0179"}
Jul 29 19:44:32.101680 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:32.101586    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8" event={"ID":"f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0","Type":"ContainerStarted","Data":"85f263266fddf36a68f1e3ed1b625b13dc1ca815df60c2d8fc8f252170ff8192"}
Jul 29 19:44:32.119622 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:32.119582    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8" podStartSLOduration=1.119568738 podStartE2EDuration="1.119568738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:44:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:44:32.11832177 +0000 UTC m=+2646.963051743" watchObservedRunningTime="2026-07-29 19:44:32.119568738 +0000 UTC m=+2646.964298711"
Jul 29 19:44:33.107526 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:33.107493    2563 generic.go:356] "Generic (PLEG): container finished" podID="f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0" containerID="a011d3444e010ab7dfacb52e743377574bac8775ebe945bced08888eadcf0179" exitCode=0
Jul 29 19:44:33.107917 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:33.107579    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8" event={"ID":"f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0","Type":"ContainerDied","Data":"a011d3444e010ab7dfacb52e743377574bac8775ebe945bced08888eadcf0179"}
Jul 29 19:44:34.239917 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:34.239893    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8"
Jul 29 19:44:34.338412 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:34.338384    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0-maas-api-service-ca\") pod \"f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0\" (UID: \"f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0\") "
Jul 29 19:44:34.338729 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:34.338707    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0" (UID: "f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:44:34.439006 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:34.438968    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0-maas-api-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:44:35.116513 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:35.116480    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8"
Jul 29 19:44:35.116688 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:35.116519    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8" event={"ID":"f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0","Type":"ContainerDied","Data":"85f263266fddf36a68f1e3ed1b625b13dc1ca815df60c2d8fc8f252170ff8192"}
Jul 29 19:44:35.116688 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:35.116572    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85f263266fddf36a68f1e3ed1b625b13dc1ca815df60c2d8fc8f252170ff8192"
Jul 29 19:44:42.247429 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:42.247397    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:42.328422 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:42.328390    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:42.402460 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:42.402429    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:42.431661 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:42.431628    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8"]
Jul 29 19:44:42.437846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:42.437826    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9e7a39-rq2s8"]
Jul 29 19:44:42.503439 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:42.503380    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:42.802657 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:42.802582    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:43.664042 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:43.663982    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0" path="/var/lib/kubelet/pods/f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0/volumes"
Jul 29 19:44:46.498619 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:46.498585    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:44:49.013538 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.013495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:49.118560 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.118524    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:49.254157 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.254125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:49.506084 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.506048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:44:49.602700 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.602660    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb"]
Jul 29 19:44:49.603139 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.603120    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0" containerName="revoke-keys"
Jul 29 19:44:49.603139 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.603140    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0" containerName="revoke-keys"
Jul 29 19:44:49.603300 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.603206    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1d8c49a-75e0-4ab2-8af9-31c7d5d7f1a0" containerName="revoke-keys"
Jul 29 19:44:49.607378 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.607358    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb"
Jul 29 19:44:49.610361 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.610344    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nq9q2\""
Jul 29 19:44:49.610452 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.610363    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:44:49.615105 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.615081    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb"]
Jul 29 19:44:49.653504 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.653475    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/339ee55b-3d5e-4d08-b694-4a167fc95118-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb\" (UID: \"339ee55b-3d5e-4d08-b694-4a167fc95118\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb"
Jul 29 19:44:49.753890 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.753861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/339ee55b-3d5e-4d08-b694-4a167fc95118-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb\" (UID: \"339ee55b-3d5e-4d08-b694-4a167fc95118\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb"
Jul 29 19:44:49.754514 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.754496    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/339ee55b-3d5e-4d08-b694-4a167fc95118-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb\" (UID: \"339ee55b-3d5e-4d08-b694-4a167fc95118\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb"
Jul 29 19:44:49.918474 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:49.918446    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb"
Jul 29 19:44:50.073546 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:50.073522    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb"]
Jul 29 19:44:50.075374 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:44:50.075343    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod339ee55b_3d5e_4d08_b694_4a167fc95118.slice/crio-7487150bbb52f823ac78b26cc1b953ecf0bf1143abe32b3c26c6b29fc077b369 WatchSource:0}: Error finding container 7487150bbb52f823ac78b26cc1b953ecf0bf1143abe32b3c26c6b29fc077b369: Status 404 returned error can't find the container with id 7487150bbb52f823ac78b26cc1b953ecf0bf1143abe32b3c26c6b29fc077b369
Jul 29 19:44:50.188647 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:50.188562    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb" event={"ID":"339ee55b-3d5e-4d08-b694-4a167fc95118","Type":"ContainerStarted","Data":"7487150bbb52f823ac78b26cc1b953ecf0bf1143abe32b3c26c6b29fc077b369"}
Jul 29 19:44:51.195153 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:51.195120    2563 generic.go:356] "Generic (PLEG): container finished" podID="339ee55b-3d5e-4d08-b694-4a167fc95118" containerID="6e538ce34908734e5f74be641e7b5cfa8681582a46c54162a2dece781be55514" exitCode=0
Jul 29 19:44:51.195533 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:51.195203    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb" event={"ID":"339ee55b-3d5e-4d08-b694-4a167fc95118","Type":"ContainerDied","Data":"6e538ce34908734e5f74be641e7b5cfa8681582a46c54162a2dece781be55514"}
Jul 29 19:44:52.321877 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:52.321853    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb"
Jul 29 19:44:52.377688 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:52.377662    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/339ee55b-3d5e-4d08-b694-4a167fc95118-maas-api-service-ca\") pod \"339ee55b-3d5e-4d08-b694-4a167fc95118\" (UID: \"339ee55b-3d5e-4d08-b694-4a167fc95118\") "
Jul 29 19:44:52.378112 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:52.378086    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/339ee55b-3d5e-4d08-b694-4a167fc95118-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "339ee55b-3d5e-4d08-b694-4a167fc95118" (UID: "339ee55b-3d5e-4d08-b694-4a167fc95118"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:44:52.479052 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:52.478966    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/339ee55b-3d5e-4d08-b694-4a167fc95118-maas-api-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:44:53.204969 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:53.204933    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb"
Jul 29 19:44:53.205509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:53.204933    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb" event={"ID":"339ee55b-3d5e-4d08-b694-4a167fc95118","Type":"ContainerDied","Data":"7487150bbb52f823ac78b26cc1b953ecf0bf1143abe32b3c26c6b29fc077b369"}
Jul 29 19:44:53.205509 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:44:53.205387    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7487150bbb52f823ac78b26cc1b953ecf0bf1143abe32b3c26c6b29fc077b369"
Jul 29 19:45:00.135503 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.135470    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xwcvx"]
Jul 29 19:45:00.135962 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.135781    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="339ee55b-3d5e-4d08-b694-4a167fc95118" containerName="revoke-keys"
Jul 29 19:45:00.135962 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.135793    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="339ee55b-3d5e-4d08-b694-4a167fc95118" containerName="revoke-keys"
Jul 29 19:45:00.135962 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.135842    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="339ee55b-3d5e-4d08-b694-4a167fc95118" containerName="revoke-keys"
Jul 29 19:45:00.139320 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.139269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xwcvx"
Jul 29 19:45:00.140323 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.140290    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-f9937e-29755905-qpg5d"]
Jul 29 19:45:00.142721 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.142705    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nq9q2\""
Jul 29 19:45:00.143425 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.143407    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-f9937e-29755905-qpg5d"
Jul 29 19:45:00.149899 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.149883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xwcvx"
Jul 29 19:45:00.157461 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.157430    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xwcvx"]
Jul 29 19:45:00.158623 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.158592    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-f9937e-29755905-qpg5d"
Jul 29 19:45:00.159880 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.159857    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-f9937e-29755905-qpg5d"]
Jul 29 19:45:00.182113 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.182081    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:00.224053 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.223575    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-f9937e-29755905-qpg5d"]
Jul 29 19:45:00.288805 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.288687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:00.330582 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:45:00.330536    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94ae127_c58c_4991_b098_547f8c56fcff.slice/crio-2b4d38232c4a90100ca1250663440942713364a72464bbc6ffd9697d9bb9ba2f WatchSource:0}: Error finding container 2b4d38232c4a90100ca1250663440942713364a72464bbc6ffd9697d9bb9ba2f: Status 404 returned error can't find the container with id 2b4d38232c4a90100ca1250663440942713364a72464bbc6ffd9697d9bb9ba2f
Jul 29 19:45:00.330878 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.330852    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xwcvx"]
Jul 29 19:45:00.385831 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.385771    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:00.401704 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.401680    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb"]
Jul 29 19:45:00.405603 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.405577    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f9937e-8h9qb"]
Jul 29 19:45:00.490861 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.490831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:00.547196 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.547175    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-f9937e-29755905-qpg5d"]
Jul 29 19:45:00.549326 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:45:00.549298    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f9dfba_a25d_457d_b896_99208b14c288.slice/crio-411fa1220d347b07558c20251a1474169059c06e47224783c4daf4795e303016 WatchSource:0}: Error finding container 411fa1220d347b07558c20251a1474169059c06e47224783c4daf4795e303016: Status 404 returned error can't find the container with id 411fa1220d347b07558c20251a1474169059c06e47224783c4daf4795e303016
Jul 29 19:45:00.781771 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:00.781741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:01.255011 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:01.254969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-f9937e-29755905-qpg5d" event={"ID":"10f9dfba-a25d-457d-b896-99208b14c288","Type":"ContainerStarted","Data":"a58da624cf3c75ddc684b0a06652c1e968b8b0287605937bcde5f5a1bff448b3"}
Jul 29 19:45:01.255385 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:01.255033    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-f9937e-29755905-qpg5d" event={"ID":"10f9dfba-a25d-457d-b896-99208b14c288","Type":"ContainerStarted","Data":"411fa1220d347b07558c20251a1474169059c06e47224783c4daf4795e303016"}
Jul 29 19:45:01.256474 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:01.256445    2563 generic.go:356] "Generic (PLEG): container finished" podID="d94ae127-c58c-4991-b098-547f8c56fcff" containerID="ecf353631439820f3560b69ef8d7928a466b76afbfa007a1de7ea20b46964a7d" exitCode=0
Jul 29 19:45:01.256571 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:01.256496    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xwcvx" event={"ID":"d94ae127-c58c-4991-b098-547f8c56fcff","Type":"ContainerDied","Data":"ecf353631439820f3560b69ef8d7928a466b76afbfa007a1de7ea20b46964a7d"}
Jul 29 19:45:01.256571 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:01.256529    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xwcvx" event={"ID":"d94ae127-c58c-4991-b098-547f8c56fcff","Type":"ContainerStarted","Data":"2b4d38232c4a90100ca1250663440942713364a72464bbc6ffd9697d9bb9ba2f"}
Jul 29 19:45:01.376352 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:01.376326    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-f9937e-29755905-qpg5d"
Jul 29 19:45:01.663969 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:01.663941    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="339ee55b-3d5e-4d08-b694-4a167fc95118" path="/var/lib/kubelet/pods/339ee55b-3d5e-4d08-b694-4a167fc95118/volumes"
Jul 29 19:45:02.261984 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:02.261948    2563 generic.go:356] "Generic (PLEG): container finished" podID="10f9dfba-a25d-457d-b896-99208b14c288" containerID="a58da624cf3c75ddc684b0a06652c1e968b8b0287605937bcde5f5a1bff448b3" exitCode=6
Jul 29 19:45:02.262482 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:02.262006    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-f9937e-29755905-qpg5d"
Jul 29 19:45:02.262482 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:02.262037    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-f9937e-29755905-qpg5d" event={"ID":"10f9dfba-a25d-457d-b896-99208b14c288","Type":"ContainerDied","Data":"a58da624cf3c75ddc684b0a06652c1e968b8b0287605937bcde5f5a1bff448b3"}
Jul 29 19:45:02.262482 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:02.262088    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-f9937e-29755905-qpg5d" event={"ID":"10f9dfba-a25d-457d-b896-99208b14c288","Type":"ContainerDied","Data":"411fa1220d347b07558c20251a1474169059c06e47224783c4daf4795e303016"}
Jul 29 19:45:02.262482 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:02.262111    2563 scope.go:117] "RemoveContainer" containerID="a58da624cf3c75ddc684b0a06652c1e968b8b0287605937bcde5f5a1bff448b3"
Jul 29 19:45:02.270197 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:02.270178    2563 scope.go:117] "RemoveContainer" containerID="a58da624cf3c75ddc684b0a06652c1e968b8b0287605937bcde5f5a1bff448b3"
Jul 29 19:45:02.270530 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:45:02.270513    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a58da624cf3c75ddc684b0a06652c1e968b8b0287605937bcde5f5a1bff448b3\": container with ID starting with a58da624cf3c75ddc684b0a06652c1e968b8b0287605937bcde5f5a1bff448b3 not found: ID does not exist" containerID="a58da624cf3c75ddc684b0a06652c1e968b8b0287605937bcde5f5a1bff448b3"
Jul 29 19:45:02.270600 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:02.270542    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58da624cf3c75ddc684b0a06652c1e968b8b0287605937bcde5f5a1bff448b3"} err="failed to get container status \"a58da624cf3c75ddc684b0a06652c1e968b8b0287605937bcde5f5a1bff448b3\": rpc error: code = NotFound desc = could not find container \"a58da624cf3c75ddc684b0a06652c1e968b8b0287605937bcde5f5a1bff448b3\": container with ID starting with a58da624cf3c75ddc684b0a06652c1e968b8b0287605937bcde5f5a1bff448b3 not found: ID does not exist"
Jul 29 19:45:02.282224 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:02.282200    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-f9937e-29755905-qpg5d"]
Jul 29 19:45:02.285698 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:02.285672    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-f9937e-29755905-qpg5d"]
Jul 29 19:45:02.381739 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:02.381718    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xwcvx"
Jul 29 19:45:03.269344 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:03.269312    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xwcvx"
Jul 29 19:45:03.269724 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:03.269359    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xwcvx" event={"ID":"d94ae127-c58c-4991-b098-547f8c56fcff","Type":"ContainerDied","Data":"2b4d38232c4a90100ca1250663440942713364a72464bbc6ffd9697d9bb9ba2f"}
Jul 29 19:45:03.269724 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:03.269404    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b4d38232c4a90100ca1250663440942713364a72464bbc6ffd9697d9bb9ba2f"
Jul 29 19:45:03.664548 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:03.664511    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10f9dfba-a25d-457d-b896-99208b14c288" path="/var/lib/kubelet/pods/10f9dfba-a25d-457d-b896-99208b14c288/volumes"
Jul 29 19:45:04.311451 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:04.311418    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:45:06.727139 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:06.727106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:06.829731 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:06.829700    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:06.981938 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:06.981862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:07.200015 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:07.199960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:07.521333 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:07.521303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:07.908960 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:07.908883    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:08.011253 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:08.011223    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:11.172500 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:11.172462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:11.416008 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:11.415966    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:11.528137 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:11.528060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:12.025784 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:12.025749    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:12.139540 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:12.139502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:15.602014 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:15.601954    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:45:25.809956 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:25.809925    2563 scope.go:117] "RemoveContainer" containerID="6d0fc87e5c9a48c971373a48bda46c8c18ea067634b4d99d09b122b6b0063116"
Jul 29 19:45:31.498257 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:31.498216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:36.048932 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:36.048896    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:36.405753 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:36.405674    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:36.732866 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:36.732831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:36.949776 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:36.949742    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:39.295336 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:39.295300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:39.402250 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:39.402214    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:39.503748 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:39.503718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:39.800116 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:39.800081    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:40.300917 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:40.300878    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:40.397977 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:40.397943    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:45:46.098290 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:45:46.098257    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:46:04.276939 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:04.276904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:23.805392 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.805361    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"]
Jul 29 19:46:23.805871 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.805641    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d94ae127-c58c-4991-b098-547f8c56fcff" containerName="cleanup"
Jul 29 19:46:23.805871 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.805651    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d94ae127-c58c-4991-b098-547f8c56fcff" containerName="cleanup"
Jul 29 19:46:23.805871 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.805663    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10f9dfba-a25d-457d-b896-99208b14c288" containerName="cleanup"
Jul 29 19:46:23.805871 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.805670    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="10f9dfba-a25d-457d-b896-99208b14c288" containerName="cleanup"
Jul 29 19:46:23.805871 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.805731    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d94ae127-c58c-4991-b098-547f8c56fcff" containerName="cleanup"
Jul 29 19:46:23.805871 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.805739    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="10f9dfba-a25d-457d-b896-99208b14c288" containerName="cleanup"
Jul 29 19:46:23.808659 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.808639    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.812186 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.812167    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8e241a\"/\"kube-root-ca.crt\""
Jul 29 19:46:23.813473 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.813451    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8e241a\"/\"auth-test-model-8e241a-kserve-self-signed-certs\""
Jul 29 19:46:23.813593 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.813514    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8e241a\"/\"openshift-service-ca.crt\""
Jul 29 19:46:23.813712 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.813691    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8e241a\"/\"default-dockercfg-s79p8\""
Jul 29 19:46:23.825520 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.825499    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"]
Jul 29 19:46:23.856659 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.856634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:23.893938 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.893921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-dshm\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.894053 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.893951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90754873-7bc6-47c8-929e-8c235898a70a-tls-certs\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.894053 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.893972    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-model-cache\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.894131 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.894087    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-home\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.894166 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.894151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-tmp-dir\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.894204 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.894179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czfg9\" (UniqueName: \"kubernetes.io/projected/90754873-7bc6-47c8-929e-8c235898a70a-kube-api-access-czfg9\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.995342 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.995308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-dshm\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.995507 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.995363    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90754873-7bc6-47c8-929e-8c235898a70a-tls-certs\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.995507 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.995468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-model-cache\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.995631 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.995521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-home\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.995631 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.995564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-tmp-dir\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.995631 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.995586    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czfg9\" (UniqueName: \"kubernetes.io/projected/90754873-7bc6-47c8-929e-8c235898a70a-kube-api-access-czfg9\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.995887 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.995854    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-model-cache\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.996023 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.995888    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-home\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.996023 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.995916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-tmp-dir\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.997688 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.997667    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-dshm\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:23.997921 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:23.997904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90754873-7bc6-47c8-929e-8c235898a70a-tls-certs\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:24.004075 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:24.004054    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czfg9\" (UniqueName: \"kubernetes.io/projected/90754873-7bc6-47c8-929e-8c235898a70a-kube-api-access-czfg9\") pod \"auth-test-model-8e241a-kserve-7d66488479-zlkfx\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") " pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:24.118545 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:24.118483    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:24.251219 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:24.251194    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"]
Jul 29 19:46:24.253120 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:46:24.253085    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90754873_7bc6_47c8_929e_8c235898a70a.slice/crio-b6529c6fa6e225f84b7109fa83aa7eaf19585db2a3f4bdcd87ac0d188d286131 WatchSource:0}: Error finding container b6529c6fa6e225f84b7109fa83aa7eaf19585db2a3f4bdcd87ac0d188d286131: Status 404 returned error can't find the container with id b6529c6fa6e225f84b7109fa83aa7eaf19585db2a3f4bdcd87ac0d188d286131
Jul 29 19:46:24.404774 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:24.404701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:24.623825 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:24.623789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx" event={"ID":"90754873-7bc6-47c8-929e-8c235898a70a","Type":"ContainerStarted","Data":"f6c7cbbeb5eebbb96a529bb423b52b31b2c24be9417dbc85fdf5599a441f9012"}
Jul 29 19:46:24.623977 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:24.623833    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx" event={"ID":"90754873-7bc6-47c8-929e-8c235898a70a","Type":"ContainerStarted","Data":"b6529c6fa6e225f84b7109fa83aa7eaf19585db2a3f4bdcd87ac0d188d286131"}
Jul 29 19:46:24.644952 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:24.644903    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx" podStartSLOduration=1.6448891030000001 podStartE2EDuration="1.644889103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:46:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:46:24.642223031 +0000 UTC m=+2759.486953003" watchObservedRunningTime="2026-07-29 19:46:24.644889103 +0000 UTC m=+2759.489619075"
Jul 29 19:46:25.913201 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:25.913166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:26.016037 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:26.015984    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:27.242047 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:27.242011    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:46:34.119193 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:34.119147    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:34.119586 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:34.119225    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:34.131767 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:34.131745    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:34.677160 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:34.677126    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:46:43.241219 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:43.241184    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:46:46.802139 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:46:46.802104    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:47:15.998378 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:47:15.998341    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:47:33.909929 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:47:33.909895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:47:36.535848 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:47:36.535817    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:47:49.914856 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:47:49.914823    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:48:01.296819 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:48:01.296788    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:48:16.593750 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:48:16.593718    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:48:30.297225 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:48:30.297186    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:48:44.082348 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:48:44.082307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:48:45.503576 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:48:45.503538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:48:50.512068 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:48:50.512030    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:49:03.815042 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:49:03.815004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:49:15.700437 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:49:15.700403    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:49:25.858495 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:49:25.858465    2563 scope.go:117] "RemoveContainer" containerID="1fa4f39402acb81957ce2ac13f27da4af8088f0fdfc3704c6dfe0352aa07d485"
Jul 29 19:49:30.404491 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:49:30.404451    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:49:42.434772 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:49:42.434727    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:42.494830 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:49:42.494803    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:49:48.709719 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:49:48.709639    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:50:10.911542 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:50:10.911510    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:50:23.794844 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:50:23.794812    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:50:25.874710 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:50:25.874683    2563 scope.go:117] "RemoveContainer" containerID="3598e67867afb714643074648c6add9de151badbcc6c1d877ba962bed8eb2366"
Jul 29 19:50:34.293288 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:50:34.293256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:34.360205 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:50:34.360177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:39.448220 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:50:39.448186    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:44.398029 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:50:44.397980    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:50:47.294078 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:50:47.294043    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"]
Jul 29 19:50:47.317914 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:50:47.317884    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:48.241902 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:50:48.241867    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:50:51.426341 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:50:51.426311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:51:00.597599 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:00.597567    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:51:02.312387 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.312328    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx" podUID="90754873-7bc6-47c8-929e-8c235898a70a" containerName="main" containerID="cri-o://f6c7cbbeb5eebbb96a529bb423b52b31b2c24be9417dbc85fdf5599a441f9012" gracePeriod=45
Jul 29 19:51:02.559801 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.559777    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:51:02.631191 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.631108    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-tmp-dir\") pod \"90754873-7bc6-47c8-929e-8c235898a70a\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") "
Jul 29 19:51:02.631191 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.631155    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-model-cache\") pod \"90754873-7bc6-47c8-929e-8c235898a70a\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") "
Jul 29 19:51:02.631191 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.631183    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90754873-7bc6-47c8-929e-8c235898a70a-tls-certs\") pod \"90754873-7bc6-47c8-929e-8c235898a70a\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") "
Jul 29 19:51:02.631472 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.631234    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-home\") pod \"90754873-7bc6-47c8-929e-8c235898a70a\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") "
Jul 29 19:51:02.631472 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.631271    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-dshm\") pod \"90754873-7bc6-47c8-929e-8c235898a70a\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") "
Jul 29 19:51:02.631472 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.631396    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czfg9\" (UniqueName: \"kubernetes.io/projected/90754873-7bc6-47c8-929e-8c235898a70a-kube-api-access-czfg9\") pod \"90754873-7bc6-47c8-929e-8c235898a70a\" (UID: \"90754873-7bc6-47c8-929e-8c235898a70a\") "
Jul 29 19:51:02.631620 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.631444    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-model-cache" (OuterVolumeSpecName: "model-cache") pod "90754873-7bc6-47c8-929e-8c235898a70a" (UID: "90754873-7bc6-47c8-929e-8c235898a70a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:51:02.631620 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.631481    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "90754873-7bc6-47c8-929e-8c235898a70a" (UID: "90754873-7bc6-47c8-929e-8c235898a70a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:51:02.631620 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.631486    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-home" (OuterVolumeSpecName: "home") pod "90754873-7bc6-47c8-929e-8c235898a70a" (UID: "90754873-7bc6-47c8-929e-8c235898a70a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:51:02.631775 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.631707    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-tmp-dir\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:51:02.631775 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.631726    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-model-cache\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:51:02.631775 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.631742    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-home\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:51:02.633574 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.633550    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90754873-7bc6-47c8-929e-8c235898a70a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "90754873-7bc6-47c8-929e-8c235898a70a" (UID: "90754873-7bc6-47c8-929e-8c235898a70a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:51:02.633653 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.633606    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-dshm" (OuterVolumeSpecName: "dshm") pod "90754873-7bc6-47c8-929e-8c235898a70a" (UID: "90754873-7bc6-47c8-929e-8c235898a70a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:51:02.633693 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.633671    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90754873-7bc6-47c8-929e-8c235898a70a-kube-api-access-czfg9" (OuterVolumeSpecName: "kube-api-access-czfg9") pod "90754873-7bc6-47c8-929e-8c235898a70a" (UID: "90754873-7bc6-47c8-929e-8c235898a70a"). InnerVolumeSpecName "kube-api-access-czfg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:51:02.732347 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.732310    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90754873-7bc6-47c8-929e-8c235898a70a-tls-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:51:02.732347 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.732339    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90754873-7bc6-47c8-929e-8c235898a70a-dshm\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:51:02.732347 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.732348    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czfg9\" (UniqueName: \"kubernetes.io/projected/90754873-7bc6-47c8-929e-8c235898a70a-kube-api-access-czfg9\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:51:02.809424 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.809395    2563 generic.go:356] "Generic (PLEG): container finished" podID="90754873-7bc6-47c8-929e-8c235898a70a" containerID="f6c7cbbeb5eebbb96a529bb423b52b31b2c24be9417dbc85fdf5599a441f9012" exitCode=0
Jul 29 19:51:02.809562 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.809442    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"
Jul 29 19:51:02.809562 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.809487    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx" event={"ID":"90754873-7bc6-47c8-929e-8c235898a70a","Type":"ContainerDied","Data":"f6c7cbbeb5eebbb96a529bb423b52b31b2c24be9417dbc85fdf5599a441f9012"}
Jul 29 19:51:02.809562 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.809532    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx" event={"ID":"90754873-7bc6-47c8-929e-8c235898a70a","Type":"ContainerDied","Data":"b6529c6fa6e225f84b7109fa83aa7eaf19585db2a3f4bdcd87ac0d188d286131"}
Jul 29 19:51:02.809562 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.809553    2563 scope.go:117] "RemoveContainer" containerID="f6c7cbbeb5eebbb96a529bb423b52b31b2c24be9417dbc85fdf5599a441f9012"
Jul 29 19:51:02.818211 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.818195    2563 scope.go:117] "RemoveContainer" containerID="f6c7cbbeb5eebbb96a529bb423b52b31b2c24be9417dbc85fdf5599a441f9012"
Jul 29 19:51:02.818485 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:51:02.818466    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6c7cbbeb5eebbb96a529bb423b52b31b2c24be9417dbc85fdf5599a441f9012\": container with ID starting with f6c7cbbeb5eebbb96a529bb423b52b31b2c24be9417dbc85fdf5599a441f9012 not found: ID does not exist" containerID="f6c7cbbeb5eebbb96a529bb423b52b31b2c24be9417dbc85fdf5599a441f9012"
Jul 29 19:51:02.818550 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.818498    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c7cbbeb5eebbb96a529bb423b52b31b2c24be9417dbc85fdf5599a441f9012"} err="failed to get container status \"f6c7cbbeb5eebbb96a529bb423b52b31b2c24be9417dbc85fdf5599a441f9012\": rpc error: code = NotFound desc = could not find container \"f6c7cbbeb5eebbb96a529bb423b52b31b2c24be9417dbc85fdf5599a441f9012\": container with ID starting with f6c7cbbeb5eebbb96a529bb423b52b31b2c24be9417dbc85fdf5599a441f9012 not found: ID does not exist"
Jul 29 19:51:02.841721 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.841693    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"]
Jul 29 19:51:02.843866 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:02.843842    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8e241a/auth-test-model-8e241a-kserve-7d66488479-zlkfx"]
Jul 29 19:51:03.664079 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:03.664046    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90754873-7bc6-47c8-929e-8c235898a70a" path="/var/lib/kubelet/pods/90754873-7bc6-47c8-929e-8c235898a70a/volumes"
Jul 29 19:51:13.101618 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.101579    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"]
Jul 29 19:51:13.102127 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.102106    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90754873-7bc6-47c8-929e-8c235898a70a" containerName="main"
Jul 29 19:51:13.102178 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.102131    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="90754873-7bc6-47c8-929e-8c235898a70a" containerName="main"
Jul 29 19:51:13.102237 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.102225    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="90754873-7bc6-47c8-929e-8c235898a70a" containerName="main"
Jul 29 19:51:13.105254 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.105234    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.109327 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.109298    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-808386\"/\"kube-root-ca.crt\""
Jul 29 19:51:13.109443 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.109301    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-808386\"/\"default-dockercfg-vtvdg\""
Jul 29 19:51:13.109443 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.109379    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-808386\"/\"openshift-service-ca.crt\""
Jul 29 19:51:13.109443 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.109352    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-808386\"/\"sub-test-model-808386-kserve-self-signed-certs\""
Jul 29 19:51:13.112719 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.112698    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"]
Jul 29 19:51:13.135981 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.135959    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:51:13.218405 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.218378    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lng59\" (UniqueName: \"kubernetes.io/projected/77124cb6-cc38-4152-8ec4-943b64d93a02-kube-api-access-lng59\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.218531 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.218414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-model-cache\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.218531 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.218478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-home\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.218531 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.218494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77124cb6-cc38-4152-8ec4-943b64d93a02-tls-certs\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.218638 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.218587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-dshm\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.218638 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.218620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-tmp-dir\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.319918 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.319895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-home\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.320058 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.319923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77124cb6-cc38-4152-8ec4-943b64d93a02-tls-certs\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.320058 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.319970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-dshm\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.320058 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.320015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-tmp-dir\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.320058 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.320054    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lng59\" (UniqueName: \"kubernetes.io/projected/77124cb6-cc38-4152-8ec4-943b64d93a02-kube-api-access-lng59\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.320261 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.320084    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-model-cache\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.320361 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.320336    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-home\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.320498 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.320406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-model-cache\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.320498 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.320464    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-tmp-dir\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.322062 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.322045    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-dshm\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.322474 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.322459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77124cb6-cc38-4152-8ec4-943b64d93a02-tls-certs\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.328793 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.328770    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lng59\" (UniqueName: \"kubernetes.io/projected/77124cb6-cc38-4152-8ec4-943b64d93a02-kube-api-access-lng59\") pod \"sub-test-model-808386-kserve-bf5b647f7-526lw\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") " pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.417287 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.417254    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:13.548050 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.548026    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"]
Jul 29 19:51:13.550516 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:51:13.550488    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77124cb6_cc38_4152_8ec4_943b64d93a02.slice/crio-00f7947998c193b03f9b570a5d9ab4702fe118cf2d41c444dcf029c05ca2d03d WatchSource:0}: Error finding container 00f7947998c193b03f9b570a5d9ab4702fe118cf2d41c444dcf029c05ca2d03d: Status 404 returned error can't find the container with id 00f7947998c193b03f9b570a5d9ab4702fe118cf2d41c444dcf029c05ca2d03d
Jul 29 19:51:13.857157 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.857066    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw" event={"ID":"77124cb6-cc38-4152-8ec4-943b64d93a02","Type":"ContainerStarted","Data":"2894eec746aa9e9190384563142242e7be3a09290d4dd7d989109f1cc6484b4e"}
Jul 29 19:51:13.857157 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.857111    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw" event={"ID":"77124cb6-cc38-4152-8ec4-943b64d93a02","Type":"ContainerStarted","Data":"00f7947998c193b03f9b570a5d9ab4702fe118cf2d41c444dcf029c05ca2d03d"}
Jul 29 19:51:13.875029 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:13.874948    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw" podStartSLOduration=0.874934487 podStartE2EDuration="874.934487ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:51:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:51:13.873698414 +0000 UTC m=+3048.718428385" watchObservedRunningTime="2026-07-29 19:51:13.874934487 +0000 UTC m=+3048.719664458"
Jul 29 19:51:16.402439 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:16.402400    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:51:23.417809 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:23.417734    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:23.418183 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:23.417816    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:23.430516 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:23.430490    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:23.912005 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:23.911969    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:51:25.892354 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:25.892323    2563 scope.go:117] "RemoveContainer" containerID="6e538ce34908734e5f74be641e7b5cfa8681582a46c54162a2dece781be55514"
Jul 29 19:51:25.899623 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:25.899603    2563 scope.go:117] "RemoveContainer" containerID="a011d3444e010ab7dfacb52e743377574bac8775ebe945bced08888eadcf0179"
Jul 29 19:51:56.907970 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:51:56.907932    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:52:15.793339 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:15.793303    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:52:21.521227 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:21.521195    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:22.506054 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:22.506023    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"]
Jul 29 19:52:22.526201 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:22.526168    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:28.785158 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:28.785123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:34.251575 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:34.251540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:34.631579 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:34.631502    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:52:37.524963 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.524917    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw" podUID="77124cb6-cc38-4152-8ec4-943b64d93a02" containerName="main" containerID="cri-o://2894eec746aa9e9190384563142242e7be3a09290d4dd7d989109f1cc6484b4e" gracePeriod=45
Jul 29 19:52:37.763059 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.763037    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:52:37.904006 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.903909    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-dshm\") pod \"77124cb6-cc38-4152-8ec4-943b64d93a02\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") "
Jul 29 19:52:37.904006 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.903962    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-model-cache\") pod \"77124cb6-cc38-4152-8ec4-943b64d93a02\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") "
Jul 29 19:52:37.904006 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.903979    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77124cb6-cc38-4152-8ec4-943b64d93a02-tls-certs\") pod \"77124cb6-cc38-4152-8ec4-943b64d93a02\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") "
Jul 29 19:52:37.904293 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.904017    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lng59\" (UniqueName: \"kubernetes.io/projected/77124cb6-cc38-4152-8ec4-943b64d93a02-kube-api-access-lng59\") pod \"77124cb6-cc38-4152-8ec4-943b64d93a02\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") "
Jul 29 19:52:37.904293 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.904036    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-home\") pod \"77124cb6-cc38-4152-8ec4-943b64d93a02\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") "
Jul 29 19:52:37.904293 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.904060    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-tmp-dir\") pod \"77124cb6-cc38-4152-8ec4-943b64d93a02\" (UID: \"77124cb6-cc38-4152-8ec4-943b64d93a02\") "
Jul 29 19:52:37.904293 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.904244    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-model-cache" (OuterVolumeSpecName: "model-cache") pod "77124cb6-cc38-4152-8ec4-943b64d93a02" (UID: "77124cb6-cc38-4152-8ec4-943b64d93a02"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:37.904503 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.904363    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-model-cache\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:52:37.904503 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.904395    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-home" (OuterVolumeSpecName: "home") pod "77124cb6-cc38-4152-8ec4-943b64d93a02" (UID: "77124cb6-cc38-4152-8ec4-943b64d93a02"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:37.904503 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.904412    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "77124cb6-cc38-4152-8ec4-943b64d93a02" (UID: "77124cb6-cc38-4152-8ec4-943b64d93a02"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:37.906170 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.906143    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-dshm" (OuterVolumeSpecName: "dshm") pod "77124cb6-cc38-4152-8ec4-943b64d93a02" (UID: "77124cb6-cc38-4152-8ec4-943b64d93a02"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:52:37.906277 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.906202    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77124cb6-cc38-4152-8ec4-943b64d93a02-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "77124cb6-cc38-4152-8ec4-943b64d93a02" (UID: "77124cb6-cc38-4152-8ec4-943b64d93a02"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:52:37.906277 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:37.906233    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77124cb6-cc38-4152-8ec4-943b64d93a02-kube-api-access-lng59" (OuterVolumeSpecName: "kube-api-access-lng59") pod "77124cb6-cc38-4152-8ec4-943b64d93a02" (UID: "77124cb6-cc38-4152-8ec4-943b64d93a02"). InnerVolumeSpecName "kube-api-access-lng59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:52:38.005667 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:38.005642    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-dshm\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:52:38.005667 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:38.005664    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77124cb6-cc38-4152-8ec4-943b64d93a02-tls-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:52:38.005822 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:38.005674    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lng59\" (UniqueName: \"kubernetes.io/projected/77124cb6-cc38-4152-8ec4-943b64d93a02-kube-api-access-lng59\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:52:38.005822 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:38.005682    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-home\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:52:38.005822 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:38.005691    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77124cb6-cc38-4152-8ec4-943b64d93a02-tmp-dir\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:52:38.217160 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:38.217130    2563 generic.go:356] "Generic (PLEG): container finished" podID="77124cb6-cc38-4152-8ec4-943b64d93a02" containerID="2894eec746aa9e9190384563142242e7be3a09290d4dd7d989109f1cc6484b4e" exitCode=0
Jul 29 19:52:38.217338 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:38.217170    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"
Jul 29 19:52:38.217338 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:38.217216    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw" event={"ID":"77124cb6-cc38-4152-8ec4-943b64d93a02","Type":"ContainerDied","Data":"2894eec746aa9e9190384563142242e7be3a09290d4dd7d989109f1cc6484b4e"}
Jul 29 19:52:38.217338 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:38.217261    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw" event={"ID":"77124cb6-cc38-4152-8ec4-943b64d93a02","Type":"ContainerDied","Data":"00f7947998c193b03f9b570a5d9ab4702fe118cf2d41c444dcf029c05ca2d03d"}
Jul 29 19:52:38.217338 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:38.217287    2563 scope.go:117] "RemoveContainer" containerID="2894eec746aa9e9190384563142242e7be3a09290d4dd7d989109f1cc6484b4e"
Jul 29 19:52:38.227092 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:38.227075    2563 scope.go:117] "RemoveContainer" containerID="2894eec746aa9e9190384563142242e7be3a09290d4dd7d989109f1cc6484b4e"
Jul 29 19:52:38.227346 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:52:38.227328    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2894eec746aa9e9190384563142242e7be3a09290d4dd7d989109f1cc6484b4e\": container with ID starting with 2894eec746aa9e9190384563142242e7be3a09290d4dd7d989109f1cc6484b4e not found: ID does not exist" containerID="2894eec746aa9e9190384563142242e7be3a09290d4dd7d989109f1cc6484b4e"
Jul 29 19:52:38.227400 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:38.227358    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2894eec746aa9e9190384563142242e7be3a09290d4dd7d989109f1cc6484b4e"} err="failed to get container status \"2894eec746aa9e9190384563142242e7be3a09290d4dd7d989109f1cc6484b4e\": rpc error: code = NotFound desc = could not find container \"2894eec746aa9e9190384563142242e7be3a09290d4dd7d989109f1cc6484b4e\": container with ID starting with 2894eec746aa9e9190384563142242e7be3a09290d4dd7d989109f1cc6484b4e not found: ID does not exist"
Jul 29 19:52:38.239831 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:38.239806    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"]
Jul 29 19:52:38.243595 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:38.243576    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-808386/sub-test-model-808386-kserve-bf5b647f7-526lw"]
Jul 29 19:52:39.664339 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:39.664305    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77124cb6-cc38-4152-8ec4-943b64d93a02" path="/var/lib/kubelet/pods/77124cb6-cc38-4152-8ec4-943b64d93a02/volumes"
Jul 29 19:52:44.303380 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:44.303342    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:52:58.193600 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.193563    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"]
Jul 29 19:52:58.193973 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.193860    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77124cb6-cc38-4152-8ec4-943b64d93a02" containerName="main"
Jul 29 19:52:58.193973 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.193876    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="77124cb6-cc38-4152-8ec4-943b64d93a02" containerName="main"
Jul 29 19:52:58.193973 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.193941    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="77124cb6-cc38-4152-8ec4-943b64d93a02" containerName="main"
Jul 29 19:52:58.198117 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.198095    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.202224 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.202193    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-808386\"/\"kube-root-ca.crt\""
Jul 29 19:52:58.202350 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.202205    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-808386\"/\"default-dockercfg-vtvdg\""
Jul 29 19:52:58.202350 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.202235    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-808386\"/\"openshift-service-ca.crt\""
Jul 29 19:52:58.202350 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.202205    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-808386\"/\"rate-test-model-808386-kserve-self-signed-certs\""
Jul 29 19:52:58.206895 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.206873    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"]
Jul 29 19:52:58.227266 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.227242    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:52:58.268446 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.268424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-home\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.268567 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.268450    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-tmp-dir\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.268567 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.268477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-dshm\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.268567 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.268527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-model-cache\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.268567 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.268549    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hk2x\" (UniqueName: \"kubernetes.io/projected/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-kube-api-access-5hk2x\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.268705 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.268632    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-tls-certs\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.369767 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.369737    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-home\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.369767 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.369764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-tmp-dir\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.369981 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.369792    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-dshm\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.369981 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.369821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-model-cache\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.369981 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.369843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hk2x\" (UniqueName: \"kubernetes.io/projected/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-kube-api-access-5hk2x\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.369981 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.369874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-tls-certs\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.370218 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.370195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-home\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.370218 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.370212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-tmp-dir\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.370344 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.370317    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-model-cache\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.372145 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.372121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-dshm\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.372434 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.372414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-tls-certs\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.378476 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.378453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hk2x\" (UniqueName: \"kubernetes.io/projected/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-kube-api-access-5hk2x\") pod \"rate-test-model-808386-kserve-67cbfc5b6c-wsw5f\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") " pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.508045 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.507943    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:52:58.649329 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:58.649297    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"]
Jul 29 19:52:58.652429 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:52:58.652403    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ad54e4d_4eb8_46a2_a041_d99ce4ea95ea.slice/crio-6cbd263c119e206c05816e9f11e8c563d9825069fe90d7c6e0997eb2205c6747 WatchSource:0}: Error finding container 6cbd263c119e206c05816e9f11e8c563d9825069fe90d7c6e0997eb2205c6747: Status 404 returned error can't find the container with id 6cbd263c119e206c05816e9f11e8c563d9825069fe90d7c6e0997eb2205c6747
Jul 29 19:52:59.308148 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:59.308112    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f" event={"ID":"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea","Type":"ContainerStarted","Data":"62540e67d1d3ad1fbac538b2d39080b6ee893339174805b67004ba76f5399423"}
Jul 29 19:52:59.308148 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:59.308153    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f" event={"ID":"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea","Type":"ContainerStarted","Data":"6cbd263c119e206c05816e9f11e8c563d9825069fe90d7c6e0997eb2205c6747"}
Jul 29 19:52:59.325895 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:52:59.325845    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f" podStartSLOduration=1.325830469 podStartE2EDuration="1.325830469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:52:59.325323541 +0000 UTC m=+3154.170053536" watchObservedRunningTime="2026-07-29 19:52:59.325830469 +0000 UTC m=+3154.170560442"
Jul 29 19:53:02.000543 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:53:01.996555    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:53:08.508805 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:53:08.508773    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:53:08.509233 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:53:08.508823    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:53:08.521462 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:53:08.521434    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:53:09.358494 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:53:09.358464    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:53:41.500260 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:53:41.500226    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:54:01.414065 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:01.414030    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:54:07.652539 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:07.652506    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:08.285643 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:08.285605    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"]
Jul 29 19:54:08.899543 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:08.899511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:16.100708 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:16.100676    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7638-140520098650128"]
Jul 29 19:54:16.103741 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:16.103723    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:16.106552 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:16.106531    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lhphn\""
Jul 29 19:54:16.111223 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:16.111205    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-140520098650128"]
Jul 29 19:54:16.195791 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:16.195755    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdmvn\" (UniqueName: \"kubernetes.io/projected/57945ec1-7bb1-4e4e-b5d0-aa8be01c4735-kube-api-access-xdmvn\") pod \"test-curl-7638-140520098650128\" (UID: \"57945ec1-7bb1-4e4e-b5d0-aa8be01c4735\") " pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:16.296616 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:16.296575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdmvn\" (UniqueName: \"kubernetes.io/projected/57945ec1-7bb1-4e4e-b5d0-aa8be01c4735-kube-api-access-xdmvn\") pod \"test-curl-7638-140520098650128\" (UID: \"57945ec1-7bb1-4e4e-b5d0-aa8be01c4735\") " pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:16.305623 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:16.305599    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdmvn\" (UniqueName: \"kubernetes.io/projected/57945ec1-7bb1-4e4e-b5d0-aa8be01c4735-kube-api-access-xdmvn\") pod \"test-curl-7638-140520098650128\" (UID: \"57945ec1-7bb1-4e4e-b5d0-aa8be01c4735\") " pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:16.413920 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:16.413898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:16.537744 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:16.537714    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-140520098650128"]
Jul 29 19:54:16.540143 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:54:16.540117    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57945ec1_7bb1_4e4e_b5d0_aa8be01c4735.slice/crio-5b4a7c9f51eea3c56d7cd008affa0fe3c9e792f18bcc37ea297ff9bfca1c12ea WatchSource:0}: Error finding container 5b4a7c9f51eea3c56d7cd008affa0fe3c9e792f18bcc37ea297ff9bfca1c12ea: Status 404 returned error can't find the container with id 5b4a7c9f51eea3c56d7cd008affa0fe3c9e792f18bcc37ea297ff9bfca1c12ea
Jul 29 19:54:16.541499 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:16.541479    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:54:16.633695 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:16.633667    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-140520098650128" event={"ID":"57945ec1-7bb1-4e4e-b5d0-aa8be01c4735","Type":"ContainerStarted","Data":"5b4a7c9f51eea3c56d7cd008affa0fe3c9e792f18bcc37ea297ff9bfca1c12ea"}
Jul 29 19:54:17.638938 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:17.638847    2563 generic.go:356] "Generic (PLEG): container finished" podID="57945ec1-7bb1-4e4e-b5d0-aa8be01c4735" containerID="d344cdc76e4e7645f4c53e1bbf9d1f8fb4cff834261cfef34857db84cac30287" exitCode=0
Jul 29 19:54:17.638938 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:17.638908    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-140520098650128" event={"ID":"57945ec1-7bb1-4e4e-b5d0-aa8be01c4735","Type":"ContainerDied","Data":"d344cdc76e4e7645f4c53e1bbf9d1f8fb4cff834261cfef34857db84cac30287"}
Jul 29 19:54:18.764716 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:18.764695    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:18.788407 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:18.788382    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7638-140520098650128_57945ec1-7bb1-4e4e-b5d0-aa8be01c4735/test-curl-7638-140520098650128/0.log"
Jul 29 19:54:18.813208 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:18.813184    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7638-140520098650128"]
Jul 29 19:54:18.816962 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:18.816937    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdmvn\" (UniqueName: \"kubernetes.io/projected/57945ec1-7bb1-4e4e-b5d0-aa8be01c4735-kube-api-access-xdmvn\") pod \"57945ec1-7bb1-4e4e-b5d0-aa8be01c4735\" (UID: \"57945ec1-7bb1-4e4e-b5d0-aa8be01c4735\") "
Jul 29 19:54:18.818282 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:18.818255    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7638-140520098650128"]
Jul 29 19:54:18.819020 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:18.818984    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57945ec1-7bb1-4e4e-b5d0-aa8be01c4735-kube-api-access-xdmvn" (OuterVolumeSpecName: "kube-api-access-xdmvn") pod "57945ec1-7bb1-4e4e-b5d0-aa8be01c4735" (UID: "57945ec1-7bb1-4e4e-b5d0-aa8be01c4735"). InnerVolumeSpecName "kube-api-access-xdmvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:54:18.918245 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:18.918221    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdmvn\" (UniqueName: \"kubernetes.io/projected/57945ec1-7bb1-4e4e-b5d0-aa8be01c4735-kube-api-access-xdmvn\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:54:18.937162 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:18.937135    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7638-140520098650128"]
Jul 29 19:54:18.937438 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:18.937424    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57945ec1-7bb1-4e4e-b5d0-aa8be01c4735" containerName="test-curl-7638-140520098650128"
Jul 29 19:54:18.937494 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:18.937440    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="57945ec1-7bb1-4e4e-b5d0-aa8be01c4735" containerName="test-curl-7638-140520098650128"
Jul 29 19:54:18.937494 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:18.937488    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="57945ec1-7bb1-4e4e-b5d0-aa8be01c4735" containerName="test-curl-7638-140520098650128"
Jul 29 19:54:18.940196 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:18.940180    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:18.947231 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:18.947209    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-140520098650128"]
Jul 29 19:54:19.018955 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:19.018925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vrvh\" (UniqueName: \"kubernetes.io/projected/b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5-kube-api-access-5vrvh\") pod \"test-curl-7638-140520098650128\" (UID: \"b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5\") " pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:19.119704 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:19.119675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vrvh\" (UniqueName: \"kubernetes.io/projected/b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5-kube-api-access-5vrvh\") pod \"test-curl-7638-140520098650128\" (UID: \"b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5\") " pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:19.128743 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:19.128703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vrvh\" (UniqueName: \"kubernetes.io/projected/b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5-kube-api-access-5vrvh\") pod \"test-curl-7638-140520098650128\" (UID: \"b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5\") " pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:19.249316 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:19.249249    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:19.372971 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:19.372946    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-140520098650128"]
Jul 29 19:54:19.375575 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:54:19.375542    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8422aa4_b66d_4e92_ae67_ba6b5fa4aed5.slice/crio-fc9371c280ab9d183bb8d1550c8001cd87d7588fc24d0e0aafa9b733f4aca3ef WatchSource:0}: Error finding container fc9371c280ab9d183bb8d1550c8001cd87d7588fc24d0e0aafa9b733f4aca3ef: Status 404 returned error can't find the container with id fc9371c280ab9d183bb8d1550c8001cd87d7588fc24d0e0aafa9b733f4aca3ef
Jul 29 19:54:19.392596 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:19.392575    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:54:19.647759 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:19.647679    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-140520098650128" event={"ID":"b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5","Type":"ContainerStarted","Data":"fc9371c280ab9d183bb8d1550c8001cd87d7588fc24d0e0aafa9b733f4aca3ef"}
Jul 29 19:54:19.648793 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:19.648768    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b4a7c9f51eea3c56d7cd008affa0fe3c9e792f18bcc37ea297ff9bfca1c12ea"
Jul 29 19:54:19.648793 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:19.648794    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:19.660691 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:19.660659    2563 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7638-140520098650128" oldPodUID="57945ec1-7bb1-4e4e-b5d0-aa8be01c4735" podUID="b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5"
Jul 29 19:54:19.663879 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:19.663857    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57945ec1-7bb1-4e4e-b5d0-aa8be01c4735" path="/var/lib/kubelet/pods/57945ec1-7bb1-4e4e-b5d0-aa8be01c4735/volumes"
Jul 29 19:54:20.653819 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:20.653785    2563 generic.go:356] "Generic (PLEG): container finished" podID="b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5" containerID="7deeb260f192ff7781dea87ec29242808659d41ea9529f1d161d8f3c9c0dc058" exitCode=0
Jul 29 19:54:20.654210 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:20.653873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-140520098650128" event={"ID":"b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5","Type":"ContainerDied","Data":"7deeb260f192ff7781dea87ec29242808659d41ea9529f1d161d8f3c9c0dc058"}
Jul 29 19:54:21.787839 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:21.787815    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:21.806884 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:21.806859    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7638-140520098650128_b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5/test-curl-7638-140520098650128/0.log"
Jul 29 19:54:21.829285 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:21.829259    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7638-140520098650128"]
Jul 29 19:54:21.831605 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:21.831585    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7638-140520098650128"]
Jul 29 19:54:21.842090 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:21.842067    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vrvh\" (UniqueName: \"kubernetes.io/projected/b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5-kube-api-access-5vrvh\") pod \"b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5\" (UID: \"b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5\") "
Jul 29 19:54:21.844056 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:21.844032    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5-kube-api-access-5vrvh" (OuterVolumeSpecName: "kube-api-access-5vrvh") pod "b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5" (UID: "b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5"). InnerVolumeSpecName "kube-api-access-5vrvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:54:21.942604 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:21.942579    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vrvh\" (UniqueName: \"kubernetes.io/projected/b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5-kube-api-access-5vrvh\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:54:22.663353 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:22.663324    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc9371c280ab9d183bb8d1550c8001cd87d7588fc24d0e0aafa9b733f4aca3ef"
Jul 29 19:54:22.663353 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:22.663354    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:22.673152 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:54:22.673129    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-140520098650128\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5" pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:23.304596 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.304556    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f" podUID="4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea" containerName="main" containerID="cri-o://62540e67d1d3ad1fbac538b2d39080b6ee893339174805b67004ba76f5399423" gracePeriod=45
Jul 29 19:54:23.549695 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.549670    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:54:23.552205 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:54:23.552180    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-140520098650128\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5" pod="opendatahub/test-curl-7638-140520098650128"
Jul 29 19:54:23.656162 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.656084    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-tmp-dir\") pod \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") "
Jul 29 19:54:23.656162 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.656115    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-model-cache\") pod \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") "
Jul 29 19:54:23.656162 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.656132    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-tls-certs\") pod \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") "
Jul 29 19:54:23.656162 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.656153    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-dshm\") pod \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") "
Jul 29 19:54:23.656484 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.656200    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-home\") pod \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") "
Jul 29 19:54:23.656484 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.656301    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hk2x\" (UniqueName: \"kubernetes.io/projected/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-kube-api-access-5hk2x\") pod \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\" (UID: \"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea\") "
Jul 29 19:54:23.656484 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.656389    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-model-cache" (OuterVolumeSpecName: "model-cache") pod "4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea" (UID: "4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:54:23.656484 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.656403    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea" (UID: "4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:54:23.656662 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.656551    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-home" (OuterVolumeSpecName: "home") pod "4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea" (UID: "4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:54:23.656662 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.656574    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-tmp-dir\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:54:23.656662 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.656593    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-model-cache\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:54:23.658240 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.658216    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-dshm" (OuterVolumeSpecName: "dshm") pod "4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea" (UID: "4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:54:23.658325 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.658285    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea" (UID: "4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:54:23.658325 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.658311    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-kube-api-access-5hk2x" (OuterVolumeSpecName: "kube-api-access-5hk2x") pod "4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea" (UID: "4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea"). InnerVolumeSpecName "kube-api-access-5hk2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:54:23.663495 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.663468    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5" path="/var/lib/kubelet/pods/b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5/volumes"
Jul 29 19:54:23.668872 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.668848    2563 generic.go:356] "Generic (PLEG): container finished" podID="4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea" containerID="62540e67d1d3ad1fbac538b2d39080b6ee893339174805b67004ba76f5399423" exitCode=0
Jul 29 19:54:23.668971 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.668885    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"
Jul 29 19:54:23.668971 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.668934    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f" event={"ID":"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea","Type":"ContainerDied","Data":"62540e67d1d3ad1fbac538b2d39080b6ee893339174805b67004ba76f5399423"}
Jul 29 19:54:23.669062 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.668977    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f" event={"ID":"4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea","Type":"ContainerDied","Data":"6cbd263c119e206c05816e9f11e8c563d9825069fe90d7c6e0997eb2205c6747"}
Jul 29 19:54:23.669062 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.669016    2563 scope.go:117] "RemoveContainer" containerID="62540e67d1d3ad1fbac538b2d39080b6ee893339174805b67004ba76f5399423"
Jul 29 19:54:23.677851 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.677833    2563 scope.go:117] "RemoveContainer" containerID="62540e67d1d3ad1fbac538b2d39080b6ee893339174805b67004ba76f5399423"
Jul 29 19:54:23.678112 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:54:23.678091    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62540e67d1d3ad1fbac538b2d39080b6ee893339174805b67004ba76f5399423\": container with ID starting with 62540e67d1d3ad1fbac538b2d39080b6ee893339174805b67004ba76f5399423 not found: ID does not exist" containerID="62540e67d1d3ad1fbac538b2d39080b6ee893339174805b67004ba76f5399423"
Jul 29 19:54:23.678178 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.678119    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62540e67d1d3ad1fbac538b2d39080b6ee893339174805b67004ba76f5399423"} err="failed to get container status \"62540e67d1d3ad1fbac538b2d39080b6ee893339174805b67004ba76f5399423\": rpc error: code = NotFound desc = could not find container \"62540e67d1d3ad1fbac538b2d39080b6ee893339174805b67004ba76f5399423\": container with ID starting with 62540e67d1d3ad1fbac538b2d39080b6ee893339174805b67004ba76f5399423 not found: ID does not exist"
Jul 29 19:54:23.688076 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.687982    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"]
Jul 29 19:54:23.692069 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.692049    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-808386/rate-test-model-808386-kserve-67cbfc5b6c-wsw5f"]
Jul 29 19:54:23.757189 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.757164    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-tls-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:54:23.757189 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.757186    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-dshm\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:54:23.757309 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.757198    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-home\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:54:23.757309 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:23.757209    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hk2x\" (UniqueName: \"kubernetes.io/projected/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea-kube-api-access-5hk2x\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:54:25.664261 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:25.664223    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea" path="/var/lib/kubelet/pods/4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea/volumes"
Jul 29 19:54:27.773980 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.773950    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"]
Jul 29 19:54:27.774378 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.774274    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea" containerName="main"
Jul 29 19:54:27.774378 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.774287    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea" containerName="main"
Jul 29 19:54:27.774378 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.774300    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5" containerName="test-curl-7638-140520098650128"
Jul 29 19:54:27.774378 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.774305    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5" containerName="test-curl-7638-140520098650128"
Jul 29 19:54:27.774378 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.774356    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ad54e4d-4eb8-46a2-a041-d99ce4ea95ea" containerName="main"
Jul 29 19:54:27.774378 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.774367    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8422aa4-b66d-4e92-ae67-ba6b5fa4aed5" containerName="test-curl-7638-140520098650128"
Jul 29 19:54:27.778675 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.778656    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.781539 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.781519    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-9d9f53-openshift-default-dockercfg-zgg5r\""
Jul 29 19:54:27.788633 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.788613    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"]
Jul 29 19:54:27.888475 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.888445    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-envoy\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.888631 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.888488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istiod-ca-cert\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.888631 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.888511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d84sv\" (UniqueName: \"kubernetes.io/projected/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-kube-api-access-d84sv\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.888631 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.888536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-workload-socket\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.888631 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.888576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-credential-socket\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.888631 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.888600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-token\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.888631 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.888617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-data\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.888823 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.888635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-workload-certs\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.888823 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.888650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-podinfo\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.989972 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.989942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-envoy\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.990147 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.989978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istiod-ca-cert\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.990147 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.990013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d84sv\" (UniqueName: \"kubernetes.io/projected/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-kube-api-access-d84sv\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.990147 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.990030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-workload-socket\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.990147 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.990051    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-credential-socket\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.990147 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.990075    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-token\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.990147 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.990095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-data\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.990147 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.990113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-workload-certs\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.990147 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.990135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-podinfo\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.990562 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.990486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-data\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.990562 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.990548    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-workload-certs\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.990783 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.990763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-workload-socket\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.990854 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.990795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istiod-ca-cert\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.990891 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.990858    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-credential-socket\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.992233 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.992214    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-envoy\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:27.992451 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:27.992435    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-podinfo\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:28.000834 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:28.000804    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-token\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:28.001059 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:28.001040    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d84sv\" (UniqueName: \"kubernetes.io/projected/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-kube-api-access-d84sv\") pod \"e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") " pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:28.090039 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:28.089957    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:28.236460 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:28.236434    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"]
Jul 29 19:54:28.238099 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:54:28.238064    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72cabce4_ba9b_49e4_b9ba_b57a0c3a9e1f.slice/crio-bf1bddcaa423fa5212ad06832a548500893fc6ec09740ef1ea73d622e0c6e67b WatchSource:0}: Error finding container bf1bddcaa423fa5212ad06832a548500893fc6ec09740ef1ea73d622e0c6e67b: Status 404 returned error can't find the container with id bf1bddcaa423fa5212ad06832a548500893fc6ec09740ef1ea73d622e0c6e67b
Jul 29 19:54:28.451299 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:28.451265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:28.548021 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:28.547957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:28.693572 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:28.693543    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6" event={"ID":"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f","Type":"ContainerStarted","Data":"bf1bddcaa423fa5212ad06832a548500893fc6ec09740ef1ea73d622e0c6e67b"}
Jul 29 19:54:31.064119 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:31.064082    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:54:31.064384 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:31.064155    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:54:31.064384 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:31.064186    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:54:31.708347 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:31.708311    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6" event={"ID":"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f","Type":"ContainerStarted","Data":"1844e5cd37b8a03c5a168639b6dc1508869856d2f2b2691ef2cabc96937ad72a"}
Jul 29 19:54:31.729846 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:31.729799    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6" podStartSLOduration=1.9060946699999999 podStartE2EDuration="4.729786527s" totalImagesPullingTime="2.823691857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:54:31.728431388 +0000 UTC m=+3246.573161384" watchObservedRunningTime="2026-07-29 19:54:31.729786527 +0000 UTC m=+3246.574516499"
Jul 29 19:54:32.090623 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:32.090550    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:32.095376 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:32.095353    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:32.712389 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:32.712359    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:32.713168 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:32.713144    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:33.656174 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:33.656140    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:33.751177 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:33.751146    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:33.849587 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:33.849542    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:34.227839 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:34.227811    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:34.343946 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:34.343915    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:34.440473 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:34.440437    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:38.401289 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:38.401259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:54:46.773185 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:46.773150    2563 generic.go:356] "Generic (PLEG): container finished" podID="72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" containerID="1844e5cd37b8a03c5a168639b6dc1508869856d2f2b2691ef2cabc96937ad72a" exitCode=0
Jul 29 19:54:46.773604 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:46.773224    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6" event={"ID":"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f","Type":"ContainerDied","Data":"1844e5cd37b8a03c5a168639b6dc1508869856d2f2b2691ef2cabc96937ad72a"}
Jul 29 19:54:46.773604 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:46.773566    2563 scope.go:117] "RemoveContainer" containerID="1844e5cd37b8a03c5a168639b6dc1508869856d2f2b2691ef2cabc96937ad72a"
Jul 29 19:54:46.775597 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:46.775565    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:54:46.775700 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:46.775636    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:54:46.775700 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:46.775678    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:54:47.712781 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:47.712732    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:47.782046 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:47.781985    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6" event={"ID":"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f","Type":"ContainerStarted","Data":"124aa76ef6852fd1854b00292d6c26c5785e72e70fe3fa828c1f0808d1ef3621"}
Jul 29 19:54:48.091163 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:48.091063    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:48.092460 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:48.092093    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 29 19:54:48.092460 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:48.092153    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6" podUID="72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 29 19:54:49.091089 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:49.091050    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 29 19:54:49.092138 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:49.092104    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6" podUID="72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 29 19:54:50.090734 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:50.090696    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 29 19:54:50.091074 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:50.091037    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6" podUID="72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 29 19:54:51.090938 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:51.090890    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 29 19:54:51.091453 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:51.090959    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6" podUID="72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 29 19:54:52.094533 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:52.094501    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:52.094904 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:52.094765    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:52.095343 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:52.095325    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:54:58.654781 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:58.654747    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:59.314294 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:59.314262    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:59.618192 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:59.618109    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:54:59.936592 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:54:59.936559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:02.638924 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:02.638885    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:02.737807 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:02.737765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:02.856256 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:02.856228    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:02.991361 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:02.991330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:03.306369 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:03.306292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:03.392535 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:03.392497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:12.605756 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:12.605722    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:55:27.617745 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:27.617706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:29.642798 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:29.642763    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mh8gw"]
Jul 29 19:55:29.646228 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:29.646207    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mh8gw"
Jul 29 19:55:29.648945 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:29.648928    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zvfpr\""
Jul 29 19:55:29.654381 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:29.654335    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mh8gw"]
Jul 29 19:55:29.729617 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:29.729589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x5rp\" (UniqueName: \"kubernetes.io/projected/898f8ca9-e848-41dd-ae57-0074809fb5b6-kube-api-access-7x5rp\") pod \"kuadrant-operator-catalog-mh8gw\" (UID: \"898f8ca9-e848-41dd-ae57-0074809fb5b6\") " pod="kuadrant-system/kuadrant-operator-catalog-mh8gw"
Jul 29 19:55:29.830855 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:29.830814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x5rp\" (UniqueName: \"kubernetes.io/projected/898f8ca9-e848-41dd-ae57-0074809fb5b6-kube-api-access-7x5rp\") pod \"kuadrant-operator-catalog-mh8gw\" (UID: \"898f8ca9-e848-41dd-ae57-0074809fb5b6\") " pod="kuadrant-system/kuadrant-operator-catalog-mh8gw"
Jul 29 19:55:29.839428 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:29.839407    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x5rp\" (UniqueName: \"kubernetes.io/projected/898f8ca9-e848-41dd-ae57-0074809fb5b6-kube-api-access-7x5rp\") pod \"kuadrant-operator-catalog-mh8gw\" (UID: \"898f8ca9-e848-41dd-ae57-0074809fb5b6\") " pod="kuadrant-system/kuadrant-operator-catalog-mh8gw"
Jul 29 19:55:29.957627 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:29.957598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mh8gw"
Jul 29 19:55:30.086506 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:30.086340    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mh8gw"]
Jul 29 19:55:30.089065 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:55:30.089030    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod898f8ca9_e848_41dd_ae57_0074809fb5b6.slice/crio-b27a8d5ac4bf5fcea75c2546f205c2c7e244ba246a3cd9b2819ccc61fb712d00 WatchSource:0}: Error finding container b27a8d5ac4bf5fcea75c2546f205c2c7e244ba246a3cd9b2819ccc61fb712d00: Status 404 returned error can't find the container with id b27a8d5ac4bf5fcea75c2546f205c2c7e244ba246a3cd9b2819ccc61fb712d00
Jul 29 19:55:30.974925 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:30.974889    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mh8gw" event={"ID":"898f8ca9-e848-41dd-ae57-0074809fb5b6","Type":"ContainerStarted","Data":"b27a8d5ac4bf5fcea75c2546f205c2c7e244ba246a3cd9b2819ccc61fb712d00"}
Jul 29 19:55:32.985774 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:32.985741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mh8gw" event={"ID":"898f8ca9-e848-41dd-ae57-0074809fb5b6","Type":"ContainerStarted","Data":"f40b2f9430440dae45a338e1d5584b5349455d32c0e037459d6459bee989eeb1"}
Jul 29 19:55:33.002900 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:33.002853    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mh8gw" podStartSLOduration=1.800674484 podStartE2EDuration="4.002838866s" totalImagesPullingTime="2.202164382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:55:33.001772146 +0000 UTC m=+3307.846502111" watchObservedRunningTime="2026-07-29 19:55:33.002838866 +0000 UTC m=+3307.847568840"
Jul 29 19:55:39.957758 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:39.957719    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mh8gw"
Jul 29 19:55:39.958202 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:39.957817    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mh8gw"
Jul 29 19:55:39.979395 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:39.979364    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mh8gw"
Jul 29 19:55:40.040370 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:40.040345    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mh8gw"
Jul 29 19:55:40.204519 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:40.204484    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mh8gw"]
Jul 29 19:55:41.381417 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.381381    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"]
Jul 29 19:55:41.384715 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.384697    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.388569 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.388547    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-9d9f53\"/\"default-dockercfg-cn2wj\""
Jul 29 19:55:41.388569 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.388556    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-9d9f53\"/\"openshift-service-ca.crt\""
Jul 29 19:55:41.388763 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.388574    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-9d9f53\"/\"kube-root-ca.crt\""
Jul 29 19:55:41.388763 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.388555    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-9d9f53\"/\"ipp-route-9d9f53-kserve-self-signed-certs\""
Jul 29 19:55:41.395760 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.395735    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"]
Jul 29 19:55:41.412213 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.412162    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:55:41.427498 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.427477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-dshm\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.427601 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.427514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtb45\" (UniqueName: \"kubernetes.io/projected/276876ae-3bee-4232-bd83-b8c9e8831661-kube-api-access-gtb45\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.427601 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.427544    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/276876ae-3bee-4232-bd83-b8c9e8831661-tls-certs\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.427601 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.427598    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-tmp-dir\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.427721 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.427618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-home\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.427721 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.427636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-model-cache\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.528535 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.528511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-tmp-dir\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.528679 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.528545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-home\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.528679 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.528565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-model-cache\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.528679 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.528607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-dshm\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.528679 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.528632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtb45\" (UniqueName: \"kubernetes.io/projected/276876ae-3bee-4232-bd83-b8c9e8831661-kube-api-access-gtb45\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.528679 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.528659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/276876ae-3bee-4232-bd83-b8c9e8831661-tls-certs\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.528986 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.528966    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-tmp-dir\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.529083 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.529020    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-home\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.529083 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.529057    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-model-cache\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.530865 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.530846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-dshm\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.531157 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.531142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/276876ae-3bee-4232-bd83-b8c9e8831661-tls-certs\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.537678 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.537655    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtb45\" (UniqueName: \"kubernetes.io/projected/276876ae-3bee-4232-bd83-b8c9e8831661-kube-api-access-gtb45\") pod \"ipp-route-9d9f53-kserve-6df569dc47-bzlcx\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") " pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.695247 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.695207    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:41.825646 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:41.825621    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"]
Jul 29 19:55:41.827634 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:55:41.827604    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod276876ae_3bee_4232_bd83_b8c9e8831661.slice/crio-de1dd130fc405d359875336f5b05310d090e020157d5a06ba904654492cd9ff1 WatchSource:0}: Error finding container de1dd130fc405d359875336f5b05310d090e020157d5a06ba904654492cd9ff1: Status 404 returned error can't find the container with id de1dd130fc405d359875336f5b05310d090e020157d5a06ba904654492cd9ff1
Jul 29 19:55:42.029685 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:42.029599    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx" event={"ID":"276876ae-3bee-4232-bd83-b8c9e8831661","Type":"ContainerStarted","Data":"883127e0f9ab651baf578b63987ebed8de09e21b4b9cba0f8be861e783b1cf7b"}
Jul 29 19:55:42.029685 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:42.029659    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx" event={"ID":"276876ae-3bee-4232-bd83-b8c9e8831661","Type":"ContainerStarted","Data":"de1dd130fc405d359875336f5b05310d090e020157d5a06ba904654492cd9ff1"}
Jul 29 19:55:42.029884 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:42.029702    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-mh8gw" podUID="898f8ca9-e848-41dd-ae57-0074809fb5b6" containerName="registry-server" containerID="cri-o://f40b2f9430440dae45a338e1d5584b5349455d32c0e037459d6459bee989eeb1" gracePeriod=2
Jul 29 19:55:42.047351 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:42.047306    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx" podStartSLOduration=1.047288155 podStartE2EDuration="1.047288155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:55:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:55:42.046458865 +0000 UTC m=+3316.891188838" watchObservedRunningTime="2026-07-29 19:55:42.047288155 +0000 UTC m=+3316.892018130"
Jul 29 19:55:42.260691 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:42.260667    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mh8gw"
Jul 29 19:55:42.335680 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:42.335604    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7x5rp\" (UniqueName: \"kubernetes.io/projected/898f8ca9-e848-41dd-ae57-0074809fb5b6-kube-api-access-7x5rp\") pod \"898f8ca9-e848-41dd-ae57-0074809fb5b6\" (UID: \"898f8ca9-e848-41dd-ae57-0074809fb5b6\") "
Jul 29 19:55:42.337707 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:42.337687    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/898f8ca9-e848-41dd-ae57-0074809fb5b6-kube-api-access-7x5rp" (OuterVolumeSpecName: "kube-api-access-7x5rp") pod "898f8ca9-e848-41dd-ae57-0074809fb5b6" (UID: "898f8ca9-e848-41dd-ae57-0074809fb5b6"). InnerVolumeSpecName "kube-api-access-7x5rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:55:42.436467 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:42.436443    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x5rp\" (UniqueName: \"kubernetes.io/projected/898f8ca9-e848-41dd-ae57-0074809fb5b6-kube-api-access-7x5rp\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:55:43.041832 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:43.041797    2563 generic.go:356] "Generic (PLEG): container finished" podID="898f8ca9-e848-41dd-ae57-0074809fb5b6" containerID="f40b2f9430440dae45a338e1d5584b5349455d32c0e037459d6459bee989eeb1" exitCode=0
Jul 29 19:55:43.042038 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:43.041848    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mh8gw"
Jul 29 19:55:43.042038 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:43.041882    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mh8gw" event={"ID":"898f8ca9-e848-41dd-ae57-0074809fb5b6","Type":"ContainerDied","Data":"f40b2f9430440dae45a338e1d5584b5349455d32c0e037459d6459bee989eeb1"}
Jul 29 19:55:43.042038 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:43.041947    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mh8gw" event={"ID":"898f8ca9-e848-41dd-ae57-0074809fb5b6","Type":"ContainerDied","Data":"b27a8d5ac4bf5fcea75c2546f205c2c7e244ba246a3cd9b2819ccc61fb712d00"}
Jul 29 19:55:43.042038 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:43.041967    2563 scope.go:117] "RemoveContainer" containerID="f40b2f9430440dae45a338e1d5584b5349455d32c0e037459d6459bee989eeb1"
Jul 29 19:55:43.051187 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:43.051122    2563 scope.go:117] "RemoveContainer" containerID="f40b2f9430440dae45a338e1d5584b5349455d32c0e037459d6459bee989eeb1"
Jul 29 19:55:43.051386 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:55:43.051368    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f40b2f9430440dae45a338e1d5584b5349455d32c0e037459d6459bee989eeb1\": container with ID starting with f40b2f9430440dae45a338e1d5584b5349455d32c0e037459d6459bee989eeb1 not found: ID does not exist" containerID="f40b2f9430440dae45a338e1d5584b5349455d32c0e037459d6459bee989eeb1"
Jul 29 19:55:43.051435 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:43.051394    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f40b2f9430440dae45a338e1d5584b5349455d32c0e037459d6459bee989eeb1"} err="failed to get container status \"f40b2f9430440dae45a338e1d5584b5349455d32c0e037459d6459bee989eeb1\": rpc error: code = NotFound desc = could not find container \"f40b2f9430440dae45a338e1d5584b5349455d32c0e037459d6459bee989eeb1\": container with ID starting with f40b2f9430440dae45a338e1d5584b5349455d32c0e037459d6459bee989eeb1 not found: ID does not exist"
Jul 29 19:55:43.062970 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:43.062945    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mh8gw"]
Jul 29 19:55:43.066051 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:43.066025    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mh8gw"]
Jul 29 19:55:43.664827 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:43.664795    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="898f8ca9-e848-41dd-ae57-0074809fb5b6" path="/var/lib/kubelet/pods/898f8ca9-e848-41dd-ae57-0074809fb5b6/volumes"
Jul 29 19:55:45.497192 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:45.497156    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:55:51.696047 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:51.695942    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:51.696047 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:51.696013    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:51.708703 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:51.708679    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:55:52.090905 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:55:52.090821    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:56:11.304280 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:11.304171    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:56:22.002921 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.002886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:22.308063 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.307975    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"]
Jul 29 19:56:22.308311 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.308298    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="898f8ca9-e848-41dd-ae57-0074809fb5b6" containerName="registry-server"
Jul 29 19:56:22.308358 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.308315    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="898f8ca9-e848-41dd-ae57-0074809fb5b6" containerName="registry-server"
Jul 29 19:56:22.308394 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.308388    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="898f8ca9-e848-41dd-ae57-0074809fb5b6" containerName="registry-server"
Jul 29 19:56:22.311444 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.311419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.314467 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.314444    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-040fde-openshift-default-dockercfg-h87p7\""
Jul 29 19:56:22.328367 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.328342    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"]
Jul 29 19:56:22.341469 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.341445    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:22.462087 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.462056    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-workload-socket\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.462246 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.462100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istiod-ca-cert\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.462246 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.462164    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-workload-certs\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.462246 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.462211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh6th\" (UniqueName: \"kubernetes.io/projected/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-kube-api-access-rh6th\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.462246 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.462240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-envoy\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.462386 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.462338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-credential-socket\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.462420 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.462395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-podinfo\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.462453 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.462418    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-data\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.462489 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.462478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-token\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.529570 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.529532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:22.563781 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.563712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-credential-socket\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.563781 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.563762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-podinfo\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.563966 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.563793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-data\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.563966 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.563835    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-token\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.563966 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.563878    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-workload-socket\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.563966 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.563913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istiod-ca-cert\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.563966 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.563942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-workload-certs\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.564260 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.564016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh6th\" (UniqueName: \"kubernetes.io/projected/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-kube-api-access-rh6th\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.564260 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.564059    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-envoy\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.564260 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.564180    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-credential-socket\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.564428 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.564372    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-workload-socket\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.564428 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.564384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-data\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.564428 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.564403    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-workload-certs\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.564734 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.564715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istiod-ca-cert\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.566147 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.566125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-envoy\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.566351 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.566335    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-podinfo\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.572554 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.572533    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-token\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.572966 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.572948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh6th\" (UniqueName: \"kubernetes.io/projected/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-kube-api-access-rh6th\") pod \"e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") " pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.621942 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.621917    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:22.755174 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.755130    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"]
Jul 29 19:56:22.758085 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:56:22.758058    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24dbd0df_45ca_4db9_bdff_4fef1cc0bace.slice/crio-5fea64586bbe683c12275ce26aca7e124e1d2e88a6fcb4a4016ba46366810b15 WatchSource:0}: Error finding container 5fea64586bbe683c12275ce26aca7e124e1d2e88a6fcb4a4016ba46366810b15: Status 404 returned error can't find the container with id 5fea64586bbe683c12275ce26aca7e124e1d2e88a6fcb4a4016ba46366810b15
Jul 29 19:56:22.760662 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.760631    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:56:22.760742 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.760699    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:56:22.760742 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:22.760726    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:56:23.220932 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:23.220895    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p" event={"ID":"24dbd0df-45ca-4db9-bdff-4fef1cc0bace","Type":"ContainerStarted","Data":"ad304f0abd49ebdfa4768dfb32f9671e70dfff8240b71341f39ff168535776f0"}
Jul 29 19:56:23.221385 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:23.220970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p" event={"ID":"24dbd0df-45ca-4db9-bdff-4fef1cc0bace","Type":"ContainerStarted","Data":"5fea64586bbe683c12275ce26aca7e124e1d2e88a6fcb4a4016ba46366810b15"}
Jul 29 19:56:23.241593 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:23.241521    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p" podStartSLOduration=1.241505766 podStartE2EDuration="1.241505766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:56:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:56:23.239892443 +0000 UTC m=+3358.084622416" watchObservedRunningTime="2026-07-29 19:56:23.241505766 +0000 UTC m=+3358.086235738"
Jul 29 19:56:23.622867 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:23.622778    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:23.627763 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:23.627739    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:24.225441 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:24.225410    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:24.226241 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:24.226224    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:25.146194 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:25.146159    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:25.244909 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:25.244877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:25.426121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:25.426089    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:25.703968 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:25.703868    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:26.028012 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:26.027946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:26.124743 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:26.124694    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:29.923844 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:29.923809    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:56:38.308391 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:38.308355    2563 generic.go:356] "Generic (PLEG): container finished" podID="24dbd0df-45ca-4db9-bdff-4fef1cc0bace" containerID="ad304f0abd49ebdfa4768dfb32f9671e70dfff8240b71341f39ff168535776f0" exitCode=0
Jul 29 19:56:38.308796 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:38.308428    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p" event={"ID":"24dbd0df-45ca-4db9-bdff-4fef1cc0bace","Type":"ContainerDied","Data":"ad304f0abd49ebdfa4768dfb32f9671e70dfff8240b71341f39ff168535776f0"}
Jul 29 19:56:38.308842 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:38.308810    2563 scope.go:117] "RemoveContainer" containerID="ad304f0abd49ebdfa4768dfb32f9671e70dfff8240b71341f39ff168535776f0"
Jul 29 19:56:38.309893 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:38.309869    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:56:38.309944 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:38.309928    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:56:38.309983 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:38.309960    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 19:56:39.225858 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:39.225820    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:39.314610 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:39.314575    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p" event={"ID":"24dbd0df-45ca-4db9-bdff-4fef1cc0bace","Type":"ContainerStarted","Data":"a8e1d2af0da2f5e9ff3789532b2a72de69c69d40152d0ba89dfa962012f73709"}
Jul 29 19:56:39.622967 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:39.622875    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:39.624041 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:39.624014    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 19:56:39.624147 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:39.624065    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p" podUID="24dbd0df-45ca-4db9-bdff-4fef1cc0bace" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 19:56:40.623195 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:40.623156    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 19:56:40.623578 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:40.623210    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p" podUID="24dbd0df-45ca-4db9-bdff-4fef1cc0bace" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 19:56:41.623214 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:41.623172    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 19:56:41.623618 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:41.623264    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p" podUID="24dbd0df-45ca-4db9-bdff-4fef1cc0bace" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 19:56:42.622828 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:42.622787    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 19:56:42.623100 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:42.622857    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p" podUID="24dbd0df-45ca-4db9-bdff-4fef1cc0bace" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 19:56:43.626259 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:43.626228    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:43.626625 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:43.626597    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:43.627333 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:43.627313    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:56:50.151113 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:50.151078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:50.915237 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:50.915207    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7"]
Jul 29 19:56:50.918685 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:50.918665    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7"
Jul 29 19:56:50.922725 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:50.922704    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:56:50.922843 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:50.922739    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nq9q2\""
Jul 29 19:56:50.928894 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:50.928872    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7"]
Jul 29 19:56:51.009277 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:51.009244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c622f0c8-250c-4563-ab5c-c11b2c58d45c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7\" (UID: \"c622f0c8-250c-4563-ab5c-c11b2c58d45c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7"
Jul 29 19:56:51.110523 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:51.110488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c622f0c8-250c-4563-ab5c-c11b2c58d45c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7\" (UID: \"c622f0c8-250c-4563-ab5c-c11b2c58d45c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7"
Jul 29 19:56:51.111167 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:51.111148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c622f0c8-250c-4563-ab5c-c11b2c58d45c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7\" (UID: \"c622f0c8-250c-4563-ab5c-c11b2c58d45c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7"
Jul 29 19:56:51.230410 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:51.230329    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7"
Jul 29 19:56:51.364780 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:51.364751    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7"]
Jul 29 19:56:51.366460 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:56:51.366438    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc622f0c8_250c_4563_ab5c_c11b2c58d45c.slice/crio-95bfe28da0d83edadb9d50ce048a4822adc19af0eeb384a6363cdbb2aa5c4b7c WatchSource:0}: Error finding container 95bfe28da0d83edadb9d50ce048a4822adc19af0eeb384a6363cdbb2aa5c4b7c: Status 404 returned error can't find the container with id 95bfe28da0d83edadb9d50ce048a4822adc19af0eeb384a6363cdbb2aa5c4b7c
Jul 29 19:56:52.375049 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:52.374944    2563 generic.go:356] "Generic (PLEG): container finished" podID="c622f0c8-250c-4563-ab5c-c11b2c58d45c" containerID="19dfb1637c46267fb4c4e3e2223d6b62ccc3abe42110906a3e5b802bea397283" exitCode=0
Jul 29 19:56:52.375049 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:52.375033    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7" event={"ID":"c622f0c8-250c-4563-ab5c-c11b2c58d45c","Type":"ContainerDied","Data":"19dfb1637c46267fb4c4e3e2223d6b62ccc3abe42110906a3e5b802bea397283"}
Jul 29 19:56:52.375417 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:52.375085    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7" event={"ID":"c622f0c8-250c-4563-ab5c-c11b2c58d45c","Type":"ContainerStarted","Data":"95bfe28da0d83edadb9d50ce048a4822adc19af0eeb384a6363cdbb2aa5c4b7c"}
Jul 29 19:56:53.509666 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:53.509637    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7"
Jul 29 19:56:53.525310 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:53.525283    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c622f0c8-250c-4563-ab5c-c11b2c58d45c-maas-api-service-ca\") pod \"c622f0c8-250c-4563-ab5c-c11b2c58d45c\" (UID: \"c622f0c8-250c-4563-ab5c-c11b2c58d45c\") "
Jul 29 19:56:53.525635 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:53.525611    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c622f0c8-250c-4563-ab5c-c11b2c58d45c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c622f0c8-250c-4563-ab5c-c11b2c58d45c" (UID: "c622f0c8-250c-4563-ab5c-c11b2c58d45c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:56:53.626792 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:53.626763    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c622f0c8-250c-4563-ab5c-c11b2c58d45c-maas-api-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:56:54.385156 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:54.385127    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7"
Jul 29 19:56:54.385156 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:54.385132    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7" event={"ID":"c622f0c8-250c-4563-ab5c-c11b2c58d45c","Type":"ContainerDied","Data":"95bfe28da0d83edadb9d50ce048a4822adc19af0eeb384a6363cdbb2aa5c4b7c"}
Jul 29 19:56:54.385372 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:54.385184    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95bfe28da0d83edadb9d50ce048a4822adc19af0eeb384a6363cdbb2aa5c4b7c"
Jul 29 19:56:55.897519 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:55.897487    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:55.965784 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:55.965752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:56.042271 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:56.042237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:56.066177 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:56.066153    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7"]
Jul 29 19:56:56.068848 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:56.068823    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-040fde-qf5p7"]
Jul 29 19:56:56.113666 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:56.113614    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:56.437301 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:56.437270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:56:57.663771 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:56:57.663739    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c622f0c8-250c-4563-ab5c-c11b2c58d45c" path="/var/lib/kubelet/pods/c622f0c8-250c-4563-ab5c-c11b2c58d45c/volumes"
Jul 29 19:57:00.610505 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:00.610472    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:57:02.543325 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:02.543296    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:57:02.617672 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:02.617641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:57:02.787408 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:02.787369    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"]
Jul 29 19:57:02.787753 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:02.787698    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p" podUID="24dbd0df-45ca-4db9-bdff-4fef1cc0bace" containerName="istio-proxy" containerID="cri-o://a8e1d2af0da2f5e9ff3789532b2a72de69c69d40152d0ba89dfa962012f73709" gracePeriod=30
Jul 29 19:57:02.808390 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:02.808307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:57:03.030613 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:03.030582    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:57:06.419370 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:06.419340    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd"]
Jul 29 19:57:06.419737 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:06.419633    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c622f0c8-250c-4563-ab5c-c11b2c58d45c" containerName="revoke-keys"
Jul 29 19:57:06.419737 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:06.419643    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c622f0c8-250c-4563-ab5c-c11b2c58d45c" containerName="revoke-keys"
Jul 29 19:57:06.419737 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:06.419725    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c622f0c8-250c-4563-ab5c-c11b2c58d45c" containerName="revoke-keys"
Jul 29 19:57:06.423599 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:06.423582    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd"
Jul 29 19:57:06.426472 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:06.426448    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:57:06.426571 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:06.426451    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nq9q2\""
Jul 29 19:57:06.430141 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:06.430119    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd"]
Jul 29 19:57:06.531064 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:06.531038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e97c19-5dd2-46fe-8391-dfef642e6ce3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd\" (UID: \"46e97c19-5dd2-46fe-8391-dfef642e6ce3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd"
Jul 29 19:57:06.632143 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:06.632114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e97c19-5dd2-46fe-8391-dfef642e6ce3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd\" (UID: \"46e97c19-5dd2-46fe-8391-dfef642e6ce3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd"
Jul 29 19:57:06.632713 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:06.632693    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e97c19-5dd2-46fe-8391-dfef642e6ce3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd\" (UID: \"46e97c19-5dd2-46fe-8391-dfef642e6ce3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd"
Jul 29 19:57:06.735341 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:06.735274    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd"
Jul 29 19:57:06.882185 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:06.882158    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd"]
Jul 29 19:57:06.884308 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:57:06.884273    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46e97c19_5dd2_46fe_8391_dfef642e6ce3.slice/crio-9b7198a2ef853d0b1ca9c1d823ea3a3261ebd6931a3b45959c722f23382e0943 WatchSource:0}: Error finding container 9b7198a2ef853d0b1ca9c1d823ea3a3261ebd6931a3b45959c722f23382e0943: Status 404 returned error can't find the container with id 9b7198a2ef853d0b1ca9c1d823ea3a3261ebd6931a3b45959c722f23382e0943
Jul 29 19:57:07.442862 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:07.442829    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd" event={"ID":"46e97c19-5dd2-46fe-8391-dfef642e6ce3","Type":"ContainerStarted","Data":"83cb5196078732d102b7867f64bbb23894bda0d09a665060c7908f1bd805a5a0"}
Jul 29 19:57:07.443281 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:07.442880    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd" event={"ID":"46e97c19-5dd2-46fe-8391-dfef642e6ce3","Type":"ContainerStarted","Data":"9b7198a2ef853d0b1ca9c1d823ea3a3261ebd6931a3b45959c722f23382e0943"}
Jul 29 19:57:07.461703 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:07.461656    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd" podStartSLOduration=1.461643421 podStartE2EDuration="1.461643421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:57:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:57:07.459509023 +0000 UTC m=+3402.304238994" watchObservedRunningTime="2026-07-29 19:57:07.461643421 +0000 UTC m=+3402.306373393"
Jul 29 19:57:08.040299 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.040275    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:57:08.143776 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.143705    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istiod-ca-cert\") pod \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") "
Jul 29 19:57:08.143776 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.143765    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-credential-socket\") pod \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") "
Jul 29 19:57:08.144010 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.143805    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-workload-socket\") pod \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") "
Jul 29 19:57:08.144010 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.143843    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh6th\" (UniqueName: \"kubernetes.io/projected/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-kube-api-access-rh6th\") pod \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") "
Jul 29 19:57:08.144010 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.143873    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-token\") pod \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") "
Jul 29 19:57:08.144010 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.143921    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-data\") pod \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") "
Jul 29 19:57:08.144010 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.143950    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-podinfo\") pod \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") "
Jul 29 19:57:08.144010 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.143987    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-envoy\") pod \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") "
Jul 29 19:57:08.144313 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.144058    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-workload-certs\") pod \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\" (UID: \"24dbd0df-45ca-4db9-bdff-4fef1cc0bace\") "
Jul 29 19:57:08.144313 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.144151    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "24dbd0df-45ca-4db9-bdff-4fef1cc0bace" (UID: "24dbd0df-45ca-4db9-bdff-4fef1cc0bace"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:57:08.144313 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.144204    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "24dbd0df-45ca-4db9-bdff-4fef1cc0bace" (UID: "24dbd0df-45ca-4db9-bdff-4fef1cc0bace"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:57:08.144449 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.144359    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:08.144449 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.144379    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:08.144449 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.144385    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "24dbd0df-45ca-4db9-bdff-4fef1cc0bace" (UID: "24dbd0df-45ca-4db9-bdff-4fef1cc0bace"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:57:08.144588 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.144536    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "24dbd0df-45ca-4db9-bdff-4fef1cc0bace" (UID: "24dbd0df-45ca-4db9-bdff-4fef1cc0bace"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:57:08.145035 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.145005    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-data" (OuterVolumeSpecName: "istio-data") pod "24dbd0df-45ca-4db9-bdff-4fef1cc0bace" (UID: "24dbd0df-45ca-4db9-bdff-4fef1cc0bace"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:57:08.146355 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.146334    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "24dbd0df-45ca-4db9-bdff-4fef1cc0bace" (UID: "24dbd0df-45ca-4db9-bdff-4fef1cc0bace"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:57:08.146434 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.146390    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "24dbd0df-45ca-4db9-bdff-4fef1cc0bace" (UID: "24dbd0df-45ca-4db9-bdff-4fef1cc0bace"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 19:57:08.146434 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.146392    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-kube-api-access-rh6th" (OuterVolumeSpecName: "kube-api-access-rh6th") pod "24dbd0df-45ca-4db9-bdff-4fef1cc0bace" (UID: "24dbd0df-45ca-4db9-bdff-4fef1cc0bace"). InnerVolumeSpecName "kube-api-access-rh6th". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:57:08.146434 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.146419    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-token" (OuterVolumeSpecName: "istio-token") pod "24dbd0df-45ca-4db9-bdff-4fef1cc0bace" (UID: "24dbd0df-45ca-4db9-bdff-4fef1cc0bace"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:57:08.245732 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.245702    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:08.245732 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.245728    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:08.245885 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.245742    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh6th\" (UniqueName: \"kubernetes.io/projected/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-kube-api-access-rh6th\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:08.245885 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.245755    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:08.245885 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.245766    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:08.245885 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.245777    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:08.245885 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.245787    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24dbd0df-45ca-4db9-bdff-4fef1cc0bace-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:08.450287 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.450254    2563 generic.go:356] "Generic (PLEG): container finished" podID="46e97c19-5dd2-46fe-8391-dfef642e6ce3" containerID="83cb5196078732d102b7867f64bbb23894bda0d09a665060c7908f1bd805a5a0" exitCode=0
Jul 29 19:57:08.450682 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.450325    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd" event={"ID":"46e97c19-5dd2-46fe-8391-dfef642e6ce3","Type":"ContainerDied","Data":"83cb5196078732d102b7867f64bbb23894bda0d09a665060c7908f1bd805a5a0"}
Jul 29 19:57:08.452040 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.452016    2563 generic.go:356] "Generic (PLEG): container finished" podID="24dbd0df-45ca-4db9-bdff-4fef1cc0bace" containerID="a8e1d2af0da2f5e9ff3789532b2a72de69c69d40152d0ba89dfa962012f73709" exitCode=0
Jul 29 19:57:08.452147 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.452081    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p" event={"ID":"24dbd0df-45ca-4db9-bdff-4fef1cc0bace","Type":"ContainerDied","Data":"a8e1d2af0da2f5e9ff3789532b2a72de69c69d40152d0ba89dfa962012f73709"}
Jul 29 19:57:08.452147 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.452117    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"
Jul 29 19:57:08.452147 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.452126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p" event={"ID":"24dbd0df-45ca-4db9-bdff-4fef1cc0bace","Type":"ContainerDied","Data":"5fea64586bbe683c12275ce26aca7e124e1d2e88a6fcb4a4016ba46366810b15"}
Jul 29 19:57:08.452252 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.452158    2563 scope.go:117] "RemoveContainer" containerID="a8e1d2af0da2f5e9ff3789532b2a72de69c69d40152d0ba89dfa962012f73709"
Jul 29 19:57:08.461942 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.461920    2563 scope.go:117] "RemoveContainer" containerID="ad304f0abd49ebdfa4768dfb32f9671e70dfff8240b71341f39ff168535776f0"
Jul 29 19:57:08.470798 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.470781    2563 scope.go:117] "RemoveContainer" containerID="a8e1d2af0da2f5e9ff3789532b2a72de69c69d40152d0ba89dfa962012f73709"
Jul 29 19:57:08.471084 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:57:08.471059    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8e1d2af0da2f5e9ff3789532b2a72de69c69d40152d0ba89dfa962012f73709\": container with ID starting with a8e1d2af0da2f5e9ff3789532b2a72de69c69d40152d0ba89dfa962012f73709 not found: ID does not exist" containerID="a8e1d2af0da2f5e9ff3789532b2a72de69c69d40152d0ba89dfa962012f73709"
Jul 29 19:57:08.471148 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.471094    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8e1d2af0da2f5e9ff3789532b2a72de69c69d40152d0ba89dfa962012f73709"} err="failed to get container status \"a8e1d2af0da2f5e9ff3789532b2a72de69c69d40152d0ba89dfa962012f73709\": rpc error: code = NotFound desc = could not find container \"a8e1d2af0da2f5e9ff3789532b2a72de69c69d40152d0ba89dfa962012f73709\": container with ID starting with a8e1d2af0da2f5e9ff3789532b2a72de69c69d40152d0ba89dfa962012f73709 not found: ID does not exist"
Jul 29 19:57:08.471148 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.471111    2563 scope.go:117] "RemoveContainer" containerID="ad304f0abd49ebdfa4768dfb32f9671e70dfff8240b71341f39ff168535776f0"
Jul 29 19:57:08.471382 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:57:08.471364    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad304f0abd49ebdfa4768dfb32f9671e70dfff8240b71341f39ff168535776f0\": container with ID starting with ad304f0abd49ebdfa4768dfb32f9671e70dfff8240b71341f39ff168535776f0 not found: ID does not exist" containerID="ad304f0abd49ebdfa4768dfb32f9671e70dfff8240b71341f39ff168535776f0"
Jul 29 19:57:08.471449 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.471387    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad304f0abd49ebdfa4768dfb32f9671e70dfff8240b71341f39ff168535776f0"} err="failed to get container status \"ad304f0abd49ebdfa4768dfb32f9671e70dfff8240b71341f39ff168535776f0\": rpc error: code = NotFound desc = could not find container \"ad304f0abd49ebdfa4768dfb32f9671e70dfff8240b71341f39ff168535776f0\": container with ID starting with ad304f0abd49ebdfa4768dfb32f9671e70dfff8240b71341f39ff168535776f0 not found: ID does not exist"
Jul 29 19:57:08.480224 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.480200    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"]
Jul 29 19:57:08.483987 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:08.483968    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-040fde-openshift-default-65c7bc4486-5ls9p"]
Jul 29 19:57:09.597192 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:09.597164    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd"
Jul 29 19:57:09.657976 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:09.657948    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e97c19-5dd2-46fe-8391-dfef642e6ce3-maas-api-service-ca\") pod \"46e97c19-5dd2-46fe-8391-dfef642e6ce3\" (UID: \"46e97c19-5dd2-46fe-8391-dfef642e6ce3\") "
Jul 29 19:57:09.658291 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:09.658272    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46e97c19-5dd2-46fe-8391-dfef642e6ce3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "46e97c19-5dd2-46fe-8391-dfef642e6ce3" (UID: "46e97c19-5dd2-46fe-8391-dfef642e6ce3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:57:09.664279 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:09.664257    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24dbd0df-45ca-4db9-bdff-4fef1cc0bace" path="/var/lib/kubelet/pods/24dbd0df-45ca-4db9-bdff-4fef1cc0bace/volumes"
Jul 29 19:57:09.758936 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:09.758868    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46e97c19-5dd2-46fe-8391-dfef642e6ce3-maas-api-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:10.464388 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:10.464357    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd"
Jul 29 19:57:10.464388 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:10.464380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd" event={"ID":"46e97c19-5dd2-46fe-8391-dfef642e6ce3","Type":"ContainerDied","Data":"9b7198a2ef853d0b1ca9c1d823ea3a3261ebd6931a3b45959c722f23382e0943"}
Jul 29 19:57:10.464652 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:10.464420    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b7198a2ef853d0b1ca9c1d823ea3a3261ebd6931a3b45959c722f23382e0943"
Jul 29 19:57:19.692871 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:19.692788    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:57:21.829534 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:21.829498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:57:21.904926 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:21.904896    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:57:21.976766 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:21.976730    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:57:21.993877 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:21.993848    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd"]
Jul 29 19:57:21.996224 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:21.996201    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9d9f53-zx5wd"]
Jul 29 19:57:22.077223 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:22.077190    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:57:22.361077 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:22.361042    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:57:23.663630 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:23.663596    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46e97c19-5dd2-46fe-8391-dfef642e6ce3" path="/var/lib/kubelet/pods/46e97c19-5dd2-46fe-8391-dfef642e6ce3/volumes"
Jul 29 19:57:27.341467 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:27.341429    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"]
Jul 29 19:57:27.389498 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:27.389469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:57:33.106022 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:33.104956    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:57:33.966884 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:33.966844    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:57:34.068261 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:34.068228    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:57:42.360713 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.360655    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx" podUID="276876ae-3bee-4232-bd83-b8c9e8831661" containerName="main" containerID="cri-o://883127e0f9ab651baf578b63987ebed8de09e21b4b9cba0f8be861e783b1cf7b" gracePeriod=45
Jul 29 19:57:42.607310 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.607288    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:57:42.610139 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.610116    2563 generic.go:356] "Generic (PLEG): container finished" podID="276876ae-3bee-4232-bd83-b8c9e8831661" containerID="883127e0f9ab651baf578b63987ebed8de09e21b4b9cba0f8be861e783b1cf7b" exitCode=0
Jul 29 19:57:42.610257 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.610156    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"
Jul 29 19:57:42.610257 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.610171    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx" event={"ID":"276876ae-3bee-4232-bd83-b8c9e8831661","Type":"ContainerDied","Data":"883127e0f9ab651baf578b63987ebed8de09e21b4b9cba0f8be861e783b1cf7b"}
Jul 29 19:57:42.610257 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.610199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx" event={"ID":"276876ae-3bee-4232-bd83-b8c9e8831661","Type":"ContainerDied","Data":"de1dd130fc405d359875336f5b05310d090e020157d5a06ba904654492cd9ff1"}
Jul 29 19:57:42.610257 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.610216    2563 scope.go:117] "RemoveContainer" containerID="883127e0f9ab651baf578b63987ebed8de09e21b4b9cba0f8be861e783b1cf7b"
Jul 29 19:57:42.617918 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.617902    2563 scope.go:117] "RemoveContainer" containerID="883127e0f9ab651baf578b63987ebed8de09e21b4b9cba0f8be861e783b1cf7b"
Jul 29 19:57:42.618187 ip-10-0-130-75 kubenswrapper[2563]: E0729 19:57:42.618168    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"883127e0f9ab651baf578b63987ebed8de09e21b4b9cba0f8be861e783b1cf7b\": container with ID starting with 883127e0f9ab651baf578b63987ebed8de09e21b4b9cba0f8be861e783b1cf7b not found: ID does not exist" containerID="883127e0f9ab651baf578b63987ebed8de09e21b4b9cba0f8be861e783b1cf7b"
Jul 29 19:57:42.618233 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.618197    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"883127e0f9ab651baf578b63987ebed8de09e21b4b9cba0f8be861e783b1cf7b"} err="failed to get container status \"883127e0f9ab651baf578b63987ebed8de09e21b4b9cba0f8be861e783b1cf7b\": rpc error: code = NotFound desc = could not find container \"883127e0f9ab651baf578b63987ebed8de09e21b4b9cba0f8be861e783b1cf7b\": container with ID starting with 883127e0f9ab651baf578b63987ebed8de09e21b4b9cba0f8be861e783b1cf7b not found: ID does not exist"
Jul 29 19:57:42.734732 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.734702    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-home\") pod \"276876ae-3bee-4232-bd83-b8c9e8831661\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") "
Jul 29 19:57:42.734893 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.734749    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/276876ae-3bee-4232-bd83-b8c9e8831661-tls-certs\") pod \"276876ae-3bee-4232-bd83-b8c9e8831661\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") "
Jul 29 19:57:42.734893 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.734788    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-tmp-dir\") pod \"276876ae-3bee-4232-bd83-b8c9e8831661\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") "
Jul 29 19:57:42.734893 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.734810    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtb45\" (UniqueName: \"kubernetes.io/projected/276876ae-3bee-4232-bd83-b8c9e8831661-kube-api-access-gtb45\") pod \"276876ae-3bee-4232-bd83-b8c9e8831661\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") "
Jul 29 19:57:42.734893 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.734875    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-dshm\") pod \"276876ae-3bee-4232-bd83-b8c9e8831661\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") "
Jul 29 19:57:42.735127 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.734897    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-model-cache\") pod \"276876ae-3bee-4232-bd83-b8c9e8831661\" (UID: \"276876ae-3bee-4232-bd83-b8c9e8831661\") "
Jul 29 19:57:42.735127 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.735055    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-home" (OuterVolumeSpecName: "home") pod "276876ae-3bee-4232-bd83-b8c9e8831661" (UID: "276876ae-3bee-4232-bd83-b8c9e8831661"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:57:42.735127 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.735074    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "276876ae-3bee-4232-bd83-b8c9e8831661" (UID: "276876ae-3bee-4232-bd83-b8c9e8831661"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:57:42.735289 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.735231    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-model-cache" (OuterVolumeSpecName: "model-cache") pod "276876ae-3bee-4232-bd83-b8c9e8831661" (UID: "276876ae-3bee-4232-bd83-b8c9e8831661"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:57:42.737093 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.737059    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-dshm" (OuterVolumeSpecName: "dshm") pod "276876ae-3bee-4232-bd83-b8c9e8831661" (UID: "276876ae-3bee-4232-bd83-b8c9e8831661"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:57:42.737093 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.737088    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/276876ae-3bee-4232-bd83-b8c9e8831661-kube-api-access-gtb45" (OuterVolumeSpecName: "kube-api-access-gtb45") pod "276876ae-3bee-4232-bd83-b8c9e8831661" (UID: "276876ae-3bee-4232-bd83-b8c9e8831661"). InnerVolumeSpecName "kube-api-access-gtb45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:57:42.737251 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.737121    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/276876ae-3bee-4232-bd83-b8c9e8831661-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "276876ae-3bee-4232-bd83-b8c9e8831661" (UID: "276876ae-3bee-4232-bd83-b8c9e8831661"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:57:42.836327 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.836300    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-home\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:42.836327 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.836322    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/276876ae-3bee-4232-bd83-b8c9e8831661-tls-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:42.836327 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.836333    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-tmp-dir\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:42.836529 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.836342    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtb45\" (UniqueName: \"kubernetes.io/projected/276876ae-3bee-4232-bd83-b8c9e8831661-kube-api-access-gtb45\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:42.836529 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.836349    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-dshm\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:42.836529 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.836371    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/276876ae-3bee-4232-bd83-b8c9e8831661-model-cache\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:57:42.931645 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.931616    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"]
Jul 29 19:57:42.935837 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:42.935816    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-9d9f53/ipp-route-9d9f53-kserve-6df569dc47-bzlcx"]
Jul 29 19:57:43.663290 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:57:43.663260    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="276876ae-3bee-4232-bd83-b8c9e8831661" path="/var/lib/kubelet/pods/276876ae-3bee-4232-bd83-b8c9e8831661/volumes"
Jul 29 19:58:03.703679 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:03.703640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:04.469269 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:04.469232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:09.349045 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:09.349010    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:10.291132 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.291096    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:10.359477 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.359444    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:10.581583 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.581492    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"]
Jul 29 19:58:10.581800 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.581775    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6" podUID="72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" containerName="istio-proxy" containerID="cri-o://124aa76ef6852fd1854b00292d6c26c5785e72e70fe3fa828c1f0808d1ef3621" gracePeriod=30
Jul 29 19:58:10.608415 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.608388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:10.948073 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.948043    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2"]
Jul 29 19:58:10.948377 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.948365    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46e97c19-5dd2-46fe-8391-dfef642e6ce3" containerName="revoke-keys"
Jul 29 19:58:10.948422 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.948379    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="46e97c19-5dd2-46fe-8391-dfef642e6ce3" containerName="revoke-keys"
Jul 29 19:58:10.948422 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.948389    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="276876ae-3bee-4232-bd83-b8c9e8831661" containerName="main"
Jul 29 19:58:10.948422 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.948394    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="276876ae-3bee-4232-bd83-b8c9e8831661" containerName="main"
Jul 29 19:58:10.948422 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.948403    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24dbd0df-45ca-4db9-bdff-4fef1cc0bace" containerName="istio-proxy"
Jul 29 19:58:10.948422 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.948411    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24dbd0df-45ca-4db9-bdff-4fef1cc0bace" containerName="istio-proxy"
Jul 29 19:58:10.948422 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.948420    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24dbd0df-45ca-4db9-bdff-4fef1cc0bace" containerName="istio-proxy"
Jul 29 19:58:10.948604 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.948428    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24dbd0df-45ca-4db9-bdff-4fef1cc0bace" containerName="istio-proxy"
Jul 29 19:58:10.948604 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.948473    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="24dbd0df-45ca-4db9-bdff-4fef1cc0bace" containerName="istio-proxy"
Jul 29 19:58:10.948604 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.948481    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="46e97c19-5dd2-46fe-8391-dfef642e6ce3" containerName="revoke-keys"
Jul 29 19:58:10.948604 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.948490    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="276876ae-3bee-4232-bd83-b8c9e8831661" containerName="main"
Jul 29 19:58:10.948604 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.948499    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="24dbd0df-45ca-4db9-bdff-4fef1cc0bace" containerName="istio-proxy"
Jul 29 19:58:10.951371 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.951356    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2"
Jul 29 19:58:10.954144 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.954124    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:58:10.954244 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.954207    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nq9q2\""
Jul 29 19:58:10.961189 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.961163    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2"]
Jul 29 19:58:10.987922 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:10.987899    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:11.059223 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:11.059197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/401c5f6d-b9e2-4768-99f9-e89d315dc875-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2\" (UID: \"401c5f6d-b9e2-4768-99f9-e89d315dc875\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2"
Jul 29 19:58:11.159845 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:11.159807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/401c5f6d-b9e2-4768-99f9-e89d315dc875-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2\" (UID: \"401c5f6d-b9e2-4768-99f9-e89d315dc875\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2"
Jul 29 19:58:11.160419 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:11.160402    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/401c5f6d-b9e2-4768-99f9-e89d315dc875-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2\" (UID: \"401c5f6d-b9e2-4768-99f9-e89d315dc875\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2"
Jul 29 19:58:11.261723 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:11.261655    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2"
Jul 29 19:58:11.401240 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:11.401215    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2"]
Jul 29 19:58:11.403430 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:58:11.403402    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401c5f6d_b9e2_4768_99f9_e89d315dc875.slice/crio-8f2446a5001147f4c6ab8533408e81d6839093c5483624dfef61a85bdf5dd1f0 WatchSource:0}: Error finding container 8f2446a5001147f4c6ab8533408e81d6839093c5483624dfef61a85bdf5dd1f0: Status 404 returned error can't find the container with id 8f2446a5001147f4c6ab8533408e81d6839093c5483624dfef61a85bdf5dd1f0
Jul 29 19:58:11.732259 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:11.732221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2" event={"ID":"401c5f6d-b9e2-4768-99f9-e89d315dc875","Type":"ContainerStarted","Data":"04fb766e9a626b4b2394c4f66472beba6b3ee869529e4700ded1fe56944d51dc"}
Jul 29 19:58:11.732430 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:11.732272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2" event={"ID":"401c5f6d-b9e2-4768-99f9-e89d315dc875","Type":"ContainerStarted","Data":"8f2446a5001147f4c6ab8533408e81d6839093c5483624dfef61a85bdf5dd1f0"}
Jul 29 19:58:11.749544 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:11.749498    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2" podStartSLOduration=1.749484045 podStartE2EDuration="1.749484045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:58:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:58:11.747559105 +0000 UTC m=+3466.592289090" watchObservedRunningTime="2026-07-29 19:58:11.749484045 +0000 UTC m=+3466.594214017"
Jul 29 19:58:12.738113 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:12.738076    2563 generic.go:356] "Generic (PLEG): container finished" podID="401c5f6d-b9e2-4768-99f9-e89d315dc875" containerID="04fb766e9a626b4b2394c4f66472beba6b3ee869529e4700ded1fe56944d51dc" exitCode=0
Jul 29 19:58:12.738481 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:12.738124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2" event={"ID":"401c5f6d-b9e2-4768-99f9-e89d315dc875","Type":"ContainerDied","Data":"04fb766e9a626b4b2394c4f66472beba6b3ee869529e4700ded1fe56944d51dc"}
Jul 29 19:58:13.868587 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:13.868563    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2"
Jul 29 19:58:13.987493 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:13.987465    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/401c5f6d-b9e2-4768-99f9-e89d315dc875-maas-api-service-ca\") pod \"401c5f6d-b9e2-4768-99f9-e89d315dc875\" (UID: \"401c5f6d-b9e2-4768-99f9-e89d315dc875\") "
Jul 29 19:58:13.987823 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:13.987801    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/401c5f6d-b9e2-4768-99f9-e89d315dc875-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "401c5f6d-b9e2-4768-99f9-e89d315dc875" (UID: "401c5f6d-b9e2-4768-99f9-e89d315dc875"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:58:14.088621 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:14.088541    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/401c5f6d-b9e2-4768-99f9-e89d315dc875-maas-api-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:58:14.747396 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:14.747355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2" event={"ID":"401c5f6d-b9e2-4768-99f9-e89d315dc875","Type":"ContainerDied","Data":"8f2446a5001147f4c6ab8533408e81d6839093c5483624dfef61a85bdf5dd1f0"}
Jul 29 19:58:14.747568 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:14.747405    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f2446a5001147f4c6ab8533408e81d6839093c5483624dfef61a85bdf5dd1f0"
Jul 29 19:58:14.747568 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:14.747368    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2"
Jul 29 19:58:15.755052 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:15.755024    2563 generic.go:356] "Generic (PLEG): container finished" podID="72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" containerID="124aa76ef6852fd1854b00292d6c26c5785e72e70fe3fa828c1f0808d1ef3621" exitCode=0
Jul 29 19:58:15.755462 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:15.755104    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6" event={"ID":"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f","Type":"ContainerDied","Data":"124aa76ef6852fd1854b00292d6c26c5785e72e70fe3fa828c1f0808d1ef3621"}
Jul 29 19:58:15.755462 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:15.755181    2563 scope.go:117] "RemoveContainer" containerID="1844e5cd37b8a03c5a168639b6dc1508869856d2f2b2691ef2cabc96937ad72a"
Jul 29 19:58:15.848681 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:15.848623    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:58:16.021664 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.021632    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-workload-socket\") pod \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") "
Jul 29 19:58:16.021847 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.021683    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-envoy\") pod \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") "
Jul 29 19:58:16.021847 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.021707    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-workload-certs\") pod \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") "
Jul 29 19:58:16.021847 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.021744    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d84sv\" (UniqueName: \"kubernetes.io/projected/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-kube-api-access-d84sv\") pod \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") "
Jul 29 19:58:16.021847 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.021770    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-credential-socket\") pod \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") "
Jul 29 19:58:16.021847 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.021798    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-data\") pod \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") "
Jul 29 19:58:16.021847 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.021822    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-podinfo\") pod \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") "
Jul 29 19:58:16.022186 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.021848    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istiod-ca-cert\") pod \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") "
Jul 29 19:58:16.022186 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.021879    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" (UID: "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:58:16.022186 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.021894    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-token\") pod \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\" (UID: \"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f\") "
Jul 29 19:58:16.022186 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.022122    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" (UID: "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:58:16.022406 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.022323    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:58:16.022406 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.022341    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:58:16.022406 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.022320    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" (UID: "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:58:16.022564 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.022400    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" (UID: "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:58:16.022860 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.022833    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-data" (OuterVolumeSpecName: "istio-data") pod "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" (UID: "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:58:16.024121 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.024094    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" (UID: "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:58:16.024239 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.024131    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-kube-api-access-d84sv" (OuterVolumeSpecName: "kube-api-access-d84sv") pod "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" (UID: "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f"). InnerVolumeSpecName "kube-api-access-d84sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:58:16.024239 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.024143    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-token" (OuterVolumeSpecName: "istio-token") pod "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" (UID: "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:58:16.024239 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.024176    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" (UID: "72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 19:58:16.123488 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.123421    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:58:16.123488 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.123442    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:58:16.123488 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.123451    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d84sv\" (UniqueName: \"kubernetes.io/projected/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-kube-api-access-d84sv\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:58:16.123488 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.123459    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:58:16.123488 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.123467    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:58:16.123488 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.123474    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:58:16.123488 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.123482    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:58:16.760661 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.760633    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"
Jul 29 19:58:16.761073 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.760631    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6" event={"ID":"72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f","Type":"ContainerDied","Data":"bf1bddcaa423fa5212ad06832a548500893fc6ec09740ef1ea73d622e0c6e67b"}
Jul 29 19:58:16.761073 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.760766    2563 scope.go:117] "RemoveContainer" containerID="124aa76ef6852fd1854b00292d6c26c5785e72e70fe3fa828c1f0808d1ef3621"
Jul 29 19:58:16.789714 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.789678    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"]
Jul 29 19:58:16.794285 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:16.794261    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-9d9f53-openshift-default-bd9d69b6b-s6bv6"]
Jul 29 19:58:17.664055 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:17.664020    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" path="/var/lib/kubelet/pods/72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f/volumes"
Jul 29 19:58:21.522596 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:21.522562    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:21.600241 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:21.600205    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:21.664002 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:21.663971    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:21.676183 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:21.676157    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2"]
Jul 29 19:58:21.679105 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:21.679082    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f36365-t6wj2"]
Jul 29 19:58:21.764808 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:21.764767    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:22.058277 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:22.058243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:23.663461 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:23.663431    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="401c5f6d-b9e2-4768-99f9-e89d315dc875" path="/var/lib/kubelet/pods/401c5f6d-b9e2-4768-99f9-e89d315dc875/volumes"
Jul 29 19:58:24.794289 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:24.794254    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:58:28.034127 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.034091    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:28.134460 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.134432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:28.306519 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.306434    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:28.535634 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.535599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:28.691676 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.691607    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df"]
Jul 29 19:58:28.692040 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.692022    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" containerName="istio-proxy"
Jul 29 19:58:28.692140 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.692042    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" containerName="istio-proxy"
Jul 29 19:58:28.692140 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.692062    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" containerName="istio-proxy"
Jul 29 19:58:28.692140 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.692070    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" containerName="istio-proxy"
Jul 29 19:58:28.692140 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.692098    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="401c5f6d-b9e2-4768-99f9-e89d315dc875" containerName="revoke-keys"
Jul 29 19:58:28.692140 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.692107    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="401c5f6d-b9e2-4768-99f9-e89d315dc875" containerName="revoke-keys"
Jul 29 19:58:28.692387 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.692185    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" containerName="istio-proxy"
Jul 29 19:58:28.692387 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.692200    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="401c5f6d-b9e2-4768-99f9-e89d315dc875" containerName="revoke-keys"
Jul 29 19:58:28.696447 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.696426    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df"
Jul 29 19:58:28.699129 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.699107    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:58:28.699218 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.699120    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nq9q2\""
Jul 29 19:58:28.702853 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.702831    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df"]
Jul 29 19:58:28.725246 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.725221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8984e9-3049-495a-bc9b-15bb49c736a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df\" (UID: \"0e8984e9-3049-495a-bc9b-15bb49c736a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df"
Jul 29 19:58:28.826070 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.826043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8984e9-3049-495a-bc9b-15bb49c736a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df\" (UID: \"0e8984e9-3049-495a-bc9b-15bb49c736a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df"
Jul 29 19:58:28.826602 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:28.826584    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8984e9-3049-495a-bc9b-15bb49c736a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df\" (UID: \"0e8984e9-3049-495a-bc9b-15bb49c736a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df"
Jul 29 19:58:29.008144 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:29.008056    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df"
Jul 29 19:58:29.136432 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:29.136413    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df"]
Jul 29 19:58:29.138638 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:58:29.138613    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8984e9_3049_495a_bc9b_15bb49c736a0.slice/crio-71f0089ac0f0c479db69727d2b752e523ee34effb612dc2e270c16a06256f03a WatchSource:0}: Error finding container 71f0089ac0f0c479db69727d2b752e523ee34effb612dc2e270c16a06256f03a: Status 404 returned error can't find the container with id 71f0089ac0f0c479db69727d2b752e523ee34effb612dc2e270c16a06256f03a
Jul 29 19:58:29.819561 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:29.819530    2563 generic.go:356] "Generic (PLEG): container finished" podID="0e8984e9-3049-495a-bc9b-15bb49c736a0" containerID="ed5f34e07a06757655240ae8fde08f98300fb8b4e864372900097238804f3644" exitCode=0
Jul 29 19:58:29.819716 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:29.819599    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df" event={"ID":"0e8984e9-3049-495a-bc9b-15bb49c736a0","Type":"ContainerDied","Data":"ed5f34e07a06757655240ae8fde08f98300fb8b4e864372900097238804f3644"}
Jul 29 19:58:29.819716 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:29.819657    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df" event={"ID":"0e8984e9-3049-495a-bc9b-15bb49c736a0","Type":"ContainerStarted","Data":"71f0089ac0f0c479db69727d2b752e523ee34effb612dc2e270c16a06256f03a"}
Jul 29 19:58:30.951495 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:30.951472    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df"
Jul 29 19:58:31.044534 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:31.044503    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8984e9-3049-495a-bc9b-15bb49c736a0-maas-api-service-ca\") pod \"0e8984e9-3049-495a-bc9b-15bb49c736a0\" (UID: \"0e8984e9-3049-495a-bc9b-15bb49c736a0\") "
Jul 29 19:58:31.044879 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:31.044857    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e8984e9-3049-495a-bc9b-15bb49c736a0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0e8984e9-3049-495a-bc9b-15bb49c736a0" (UID: "0e8984e9-3049-495a-bc9b-15bb49c736a0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:58:31.145853 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:31.145776    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8984e9-3049-495a-bc9b-15bb49c736a0-maas-api-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:58:31.828854 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:31.828829    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df"
Jul 29 19:58:31.829041 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:31.828871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df" event={"ID":"0e8984e9-3049-495a-bc9b-15bb49c736a0","Type":"ContainerDied","Data":"71f0089ac0f0c479db69727d2b752e523ee34effb612dc2e270c16a06256f03a"}
Jul 29 19:58:31.829041 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:31.828917    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71f0089ac0f0c479db69727d2b752e523ee34effb612dc2e270c16a06256f03a"
Jul 29 19:58:39.070608 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:39.070575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:39.170603 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:39.170571    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:39.208911 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:39.208879    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df"]
Jul 29 19:58:39.210875 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:39.210851    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8e241a-rm6df"]
Jul 29 19:58:39.227995 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:39.227971    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:39.594285 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:39.594255    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:39.663765 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:39.663732    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e8984e9-3049-495a-bc9b-15bb49c736a0" path="/var/lib/kubelet/pods/0e8984e9-3049-495a-bc9b-15bb49c736a0/volumes"
Jul 29 19:58:42.290753 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:42.290720    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:58:45.461518 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:45.461450    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:45.561000 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:45.560953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:45.701280 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:45.701248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:45.929389 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:45.929360    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:46.046068 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.046034    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6"]
Jul 29 19:58:46.046358 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.046347    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8984e9-3049-495a-bc9b-15bb49c736a0" containerName="revoke-keys"
Jul 29 19:58:46.046402 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.046360    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8984e9-3049-495a-bc9b-15bb49c736a0" containerName="revoke-keys"
Jul 29 19:58:46.046436 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.046421    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e8984e9-3049-495a-bc9b-15bb49c736a0" containerName="revoke-keys"
Jul 29 19:58:46.046436 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.046431    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="72cabce4-ba9b-49e4-b9ba-b57a0c3a9e1f" containerName="istio-proxy"
Jul 29 19:58:46.049316 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.049301    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6"
Jul 29 19:58:46.051898 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.051876    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:58:46.052030 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.051876    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nq9q2\""
Jul 29 19:58:46.056716 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.056561    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6"]
Jul 29 19:58:46.160169 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.160131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-808386-zx9n6\" (UID: \"30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6"
Jul 29 19:58:46.260966 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.260885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-808386-zx9n6\" (UID: \"30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6"
Jul 29 19:58:46.261554 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.261529    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-808386-zx9n6\" (UID: \"30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6"
Jul 29 19:58:46.360245 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.360216    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6"
Jul 29 19:58:46.492464 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.492428    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6"]
Jul 29 19:58:46.495372 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:58:46.495343    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30678fb9_0d25_47a6_8d8f_2b3a0e4d5b4b.slice/crio-7240cc1a78232e86da90d6e4b97c6224faddb0baba131f52d9948caed1a484f9 WatchSource:0}: Error finding container 7240cc1a78232e86da90d6e4b97c6224faddb0baba131f52d9948caed1a484f9: Status 404 returned error can't find the container with id 7240cc1a78232e86da90d6e4b97c6224faddb0baba131f52d9948caed1a484f9
Jul 29 19:58:46.895106 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.895018    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6" event={"ID":"30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b","Type":"ContainerStarted","Data":"b45fabb6a0120ba2e05803060b4c1da5d2191cfe3d524f8b5a53bc3af4e0581c"}
Jul 29 19:58:46.895106 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.895077    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6" event={"ID":"30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b","Type":"ContainerStarted","Data":"7240cc1a78232e86da90d6e4b97c6224faddb0baba131f52d9948caed1a484f9"}
Jul 29 19:58:46.911095 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:46.911043    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6" podStartSLOduration=0.911024318 podStartE2EDuration="911.024318ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:58:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:58:46.910867909 +0000 UTC m=+3501.755597893" watchObservedRunningTime="2026-07-29 19:58:46.911024318 +0000 UTC m=+3501.755754292"
Jul 29 19:58:47.900380 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:47.900344    2563 generic.go:356] "Generic (PLEG): container finished" podID="30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b" containerID="b45fabb6a0120ba2e05803060b4c1da5d2191cfe3d524f8b5a53bc3af4e0581c" exitCode=0
Jul 29 19:58:47.900770 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:47.900440    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6" event={"ID":"30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b","Type":"ContainerDied","Data":"b45fabb6a0120ba2e05803060b4c1da5d2191cfe3d524f8b5a53bc3af4e0581c"}
Jul 29 19:58:49.038184 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:49.038161    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6"
Jul 29 19:58:49.081576 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:49.081543    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b-maas-api-service-ca\") pod \"30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b\" (UID: \"30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b\") "
Jul 29 19:58:49.081889 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:49.081858    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b" (UID: "30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:58:49.182705 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:49.182681    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b-maas-api-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\""
Jul 29 19:58:49.911597 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:49.911562    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6" event={"ID":"30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b","Type":"ContainerDied","Data":"7240cc1a78232e86da90d6e4b97c6224faddb0baba131f52d9948caed1a484f9"}
Jul 29 19:58:49.911597 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:49.911583    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6"
Jul 29 19:58:49.911812 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:49.911616    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7240cc1a78232e86da90d6e4b97c6224faddb0baba131f52d9948caed1a484f9"
Jul 29 19:58:56.574111 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:56.574078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:56.673730 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:56.673697    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:56.721209 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:56.721182    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6"]
Jul 29 19:58:56.724287 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:56.724266    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-808386-zx9n6"]
Jul 29 19:58:56.734309 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:56.734282    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:57.095463 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:57.095432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:58:57.663860 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:57.663821    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b" path="/var/lib/kubelet/pods/30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b/volumes"
Jul 29 19:58:59.599368 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:58:59.599335    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-r424q"]
Jul 29 19:59:02.950281 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:02.950245    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:59:03.050137 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:03.050101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:59:03.203465 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:03.203378    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:59:03.438109 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:03.438060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:59:10.009011 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:10.008970    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5_a395f60c-f0bc-497a-bdbf-d47ad69f89f2/copy-manifests/0.log"
Jul 29 19:59:10.020264 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:10.020240    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5_a395f60c-f0bc-497a-bdbf-d47ad69f89f2/manager/0.log"
Jul 29 19:59:10.719089 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:10.719062    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755905-xwcvx_d94ae127-c58c-4991-b098-547f8c56fcff/cleanup/0.log"
Jul 29 19:59:12.763013 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:12.762970    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-r424q_a18f5230-981c-4b71-b7f1-f77f729563e4/limitador/0.log"
Jul 29 19:59:13.330225 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:13.330193    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4m4fk_88049de3-a881-4cd7-ae76-d8518789bca5/discovery/0.log"
Jul 29 19:59:14.001301 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:14.001272    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b8dd8f79f-j8jln_1172b25f-71d3-458d-8043-da0b367e9fb7/router/0.log"
Jul 29 19:59:14.539694 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:14.539663    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-8zsks_a0580d6b-0599-4625-8aa0-101c8bd4f7d6/main/0.log"
Jul 29 19:59:14.650221 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:14.650197    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn8vbq_ce23ec97-98c8-4c06-a3d9-792f0c408098/main/0.log"
Jul 29 19:59:20.677673 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:20.677596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:59:21.775471 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:21.775360    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log" limit=1024
Jul 29 19:59:23.596415 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:23.596385    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kld88_52668d46-bc7a-467b-b228-1739e7837240/global-pull-secret-syncer/0.log"
Jul 29 19:59:23.695581 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:23.695555    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4x2jv_028e766d-fc88-4f58-a69e-7c02dff9a90a/konnectivity-agent/0.log"
Jul 29 19:59:23.814903 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:23.814879    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-75.ec2.internal_cfe6536f353a8e0145bc66b1c5423231/haproxy/0.log"
Jul 29 19:59:29.979625 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:29.979589    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-r424q_a18f5230-981c-4b71-b7f1-f77f729563e4/limitador/0.log"
Jul 29 19:59:31.994110 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:31.994067    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-9wdf5_cfd18709-2511-4539-9633-3f6aefe7b480/kube-state-metrics/0.log"
Jul 29 19:59:32.019940 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:32.019912    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-9wdf5_cfd18709-2511-4539-9633-3f6aefe7b480/kube-rbac-proxy-main/0.log"
Jul 29 19:59:32.043930 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:32.043893    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-9wdf5_cfd18709-2511-4539-9633-3f6aefe7b480/kube-rbac-proxy-self/0.log"
Jul 29 19:59:32.072719 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:32.072693    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-cddcd899c-ps2vj_eca76a6d-3b3d-4e24-bae3-36509e61a1b5/metrics-server/0.log"
Jul 29 19:59:32.291815 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:32.291728    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rrgn8_1e991238-d1bb-4e3e-a778-b5c462096033/node-exporter/0.log"
Jul 29 19:59:32.313965 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:32.313940    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rrgn8_1e991238-d1bb-4e3e-a778-b5c462096033/kube-rbac-proxy/0.log"
Jul 29 19:59:32.336869 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:32.336851    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rrgn8_1e991238-d1bb-4e3e-a778-b5c462096033/init-textfile/0.log"
Jul 29 19:59:33.511128 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.511096    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"]
Jul 29 19:59:33.511492 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.511388    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b" containerName="revoke-keys"
Jul 29 19:59:33.511492 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.511399    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b" containerName="revoke-keys"
Jul 29 19:59:33.511492 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.511461    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="30678fb9-0d25-47a6-8d8f-2b3a0e4d5b4b" containerName="revoke-keys"
Jul 29 19:59:33.514493 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.514472    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.517086 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.517067    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kxqqs\"/\"kube-root-ca.crt\""
Jul 29 19:59:33.518210 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.518193    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kxqqs\"/\"openshift-service-ca.crt\""
Jul 29 19:59:33.518282 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.518193    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kxqqs\"/\"default-dockercfg-tgndr\""
Jul 29 19:59:33.526498 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.526472    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"]
Jul 29 19:59:33.546059 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.546032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-sys\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.546170 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.546073    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjcrb\" (UniqueName: \"kubernetes.io/projected/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-kube-api-access-wjcrb\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.546170 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.546103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-podres\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.546170 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.546120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-lib-modules\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.546170 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.546145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-proc\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.646647 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.646600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-sys\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.646647 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.646654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjcrb\" (UniqueName: \"kubernetes.io/projected/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-kube-api-access-wjcrb\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.646868 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.646696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-podres\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.646868 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.646718    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-sys\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.646868 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.646722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-lib-modules\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.646868 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.646787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-proc\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.646868 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.646835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-podres\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.646868 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.646838    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-lib-modules\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.647094 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.646875    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-proc\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.655154 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.655133    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjcrb\" (UniqueName: \"kubernetes.io/projected/336ab30d-5441-4e10-a9c3-6a0979e4a7aa-kube-api-access-wjcrb\") pod \"perf-node-gather-daemonset-78tm5\" (UID: \"336ab30d-5441-4e10-a9c3-6a0979e4a7aa\") " pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.825274 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.825201    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:33.949610 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:33.949563    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"]
Jul 29 19:59:33.951775 ip-10-0-130-75 kubenswrapper[2563]: W0729 19:59:33.951745    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod336ab30d_5441_4e10_a9c3_6a0979e4a7aa.slice/crio-d8caf7375638a6f464c01fd6f87643b56ddc493400d152d69648d95c7939260a WatchSource:0}: Error finding container d8caf7375638a6f464c01fd6f87643b56ddc493400d152d69648d95c7939260a: Status 404 returned error can't find the container with id d8caf7375638a6f464c01fd6f87643b56ddc493400d152d69648d95c7939260a
Jul 29 19:59:34.108215 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:34.108137    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5" event={"ID":"336ab30d-5441-4e10-a9c3-6a0979e4a7aa","Type":"ContainerStarted","Data":"fe01ff01264651970b79f1bb8988fef2974ab098ec16c1bd35c83eb08ec512f6"}
Jul 29 19:59:34.108215 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:34.108185    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5" event={"ID":"336ab30d-5441-4e10-a9c3-6a0979e4a7aa","Type":"ContainerStarted","Data":"d8caf7375638a6f464c01fd6f87643b56ddc493400d152d69648d95c7939260a"}
Jul 29 19:59:34.108374 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:34.108256    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:34.123917 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:34.123871    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5" podStartSLOduration=1.123856206 podStartE2EDuration="1.123856206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:59:34.122688791 +0000 UTC m=+3548.967418768" watchObservedRunningTime="2026-07-29 19:59:34.123856206 +0000 UTC m=+3548.968586215"
Jul 29 19:59:35.242895 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:35.242867    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-596775b77-psqn7_89211e3f-bb93-4903-9993-ba32b8b63a79/console/0.log"
Jul 29 19:59:36.956007 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:36.955976    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f8mw5_bf416666-de96-435e-a000-b4fa34920d59/dns/0.log"
Jul 29 19:59:36.979780 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:36.979755    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f8mw5_bf416666-de96-435e-a000-b4fa34920d59/kube-rbac-proxy/0.log"
Jul 29 19:59:37.088612 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:37.088587    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8w67g_2641c276-30f3-4887-8935-5baecd3a3ef7/dns-node-resolver/0.log"
Jul 29 19:59:37.649142 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:37.649114    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6645fdd8c7-4tf9l_53f4ee95-9177-4484-962f-307f8346032f/registry/0.log"
Jul 29 19:59:37.710107 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:37.710077    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mklk5_09767a94-1353-451e-81e2-bc2b3c443aef/node-ca/0.log"
Jul 29 19:59:38.909545 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:38.909512    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4m4fk_88049de3-a881-4cd7-ae76-d8518789bca5/discovery/0.log"
Jul 29 19:59:39.116816 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:39.116779    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b8dd8f79f-j8jln_1172b25f-71d3-458d-8043-da0b367e9fb7/router/0.log"
Jul 29 19:59:39.940671 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:39.940642    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hnc98_b7e65e6f-91cd-4f99-a3c8-24370c517877/serve-healthcheck-canary/0.log"
Jul 29 19:59:40.122342 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:40.122315    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kxqqs/perf-node-gather-daemonset-78tm5"
Jul 29 19:59:40.592728 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:40.592702    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qc2w8_2f631933-134e-4f16-9006-c1d944e83e8a/kube-rbac-proxy/0.log"
Jul 29 19:59:40.620331 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:40.620301    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qc2w8_2f631933-134e-4f16-9006-c1d944e83e8a/exporter/0.log"
Jul 29 19:59:40.643395 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:40.643377    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qc2w8_2f631933-134e-4f16-9006-c1d944e83e8a/extractor/0.log"
Jul 29 19:59:43.773031 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:43.773002    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5_a395f60c-f0bc-497a-bdbf-d47ad69f89f2/manager/0.log"
Jul 29 19:59:43.795459 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:43.795434    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b7c5ccf8f-wrzv5_a395f60c-f0bc-497a-bdbf-d47ad69f89f2/copy-manifests/0.log"
Jul 29 19:59:45.104508 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:45.104476    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79b99cb5c6-rqxjm_b1b1a5a1-8cdc-4f68-bca3-0aa4fc6d05ed/manager/0.log"
Jul 29 19:59:45.238457 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:45.238376    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4m4fk_88049de3-a881-4cd7-ae76-d8518789bca5/discovery/0.log"
Jul 29 19:59:45.412743 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:45.412713    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b8dd8f79f-j8jln_1172b25f-71d3-458d-8043-da0b367e9fb7/router/0.log"
Jul 29 19:59:46.942057 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:46.942029    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-4m4fk_88049de3-a881-4cd7-ae76-d8518789bca5/discovery/0.log"
Jul 29 19:59:47.116572 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:47.116541    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b8dd8f79f-j8jln_1172b25f-71d3-458d-8043-da0b367e9fb7/router/0.log"
Jul 29 19:59:50.361101 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:50.361070    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-hqbf8_6805d1cc-921d-492c-b367-ca06d873e471/migrator/0.log"
Jul 29 19:59:50.383428 ip-10-0-130-75 kubenswrapper[2563]: I0729 19:59:50.383402    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-hqbf8_6805d1cc-921d-492c-b367-ca06d873e471/graceful-termination/0.log"