Jul 29 01:09:29.241891 ip-10-0-130-167 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 01:09:29.662408 ip-10-0-130-167 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:09:29.662408 ip-10-0-130-167 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 01:09:29.662408 ip-10-0-130-167 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:09:29.662408 ip-10-0-130-167 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 01:09:29.662408 ip-10-0-130-167 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:09:29.663489 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.663375    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 01:09:29.669523 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669506    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:29.669523 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669520    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:29.669523 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669523    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:29.669523 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669527    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669531    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669534    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669538    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669541    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669544    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669546    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669549    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669551    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669554    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669556    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669559    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669561    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669564    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669566    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669569    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669571    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669574    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669576    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669579    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:29.669656 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669581    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669584    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669586    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669589    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669592    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669594    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669597    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669600    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669604    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669620    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669623    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669625    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669628    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669631    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669634    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669638    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669642    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669644    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669647    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:29.670125 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669650    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669652    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669655    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669657    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669660    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669664    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669667    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669669    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669672    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669675    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669678    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669680    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669683    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669686    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669688    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669691    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669693    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669696    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669699    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669701    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:29.670580 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669704    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669706    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669709    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669711    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669714    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669716    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669719    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669723    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669726    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669729    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669732    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669734    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669737    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669740    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669742    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669746    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669751    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669755    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669758    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:29.671073 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669761    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669764    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669767    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669770    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669773    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669775    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669778    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669781    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669784    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669786    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669789    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669792    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669794    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669797    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669799    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669802    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669804    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.669807    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670496    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:29.671532 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670503    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670507    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670510    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670512    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670516    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670518    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670521    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670523    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670526    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670528    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670531    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670534    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670536    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670539    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670541    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670544    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670548    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670552    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:29.671997 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670555    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670559    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670563    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670566    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670569    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670572    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670575    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670578    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670581    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670585    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670588    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670591    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670594    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670597    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670600    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670603    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670606    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670623    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670626    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:29.672456 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670629    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670632    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670635    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670637    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670640    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670642    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670645    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670647    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670650    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670653    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670655    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670657    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670660    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670662    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670665    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670667    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670671    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670673    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670676    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670679    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:29.672972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670682    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670685    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670687    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670690    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670693    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670695    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670698    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670700    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670703    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670706    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670709    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670712    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670715    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670718    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670720    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670723    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670726    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670728    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670731    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670733    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:29.673463 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670736    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670738    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670741    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670744    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670747    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670749    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670752    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670754    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670757    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670759    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670762    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670764    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670767    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670769    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670772    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670774    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670776    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670779    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670782    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670784    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:29.673969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.670786    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672146    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672152    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672155    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672159    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672162    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672166    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672169    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672172    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672175    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672177    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672180    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672183    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672186    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672188    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672191    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672194    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672197    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672199    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672202    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:29.674451 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672204    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672207    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672210    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672212    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672215    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672217    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672220    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672222    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672225    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672227    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672229    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672232    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672234    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672237    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672239    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672242    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672245    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672247    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672250    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672253    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:29.674972 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672256    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672258    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672261    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672264    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672266    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672269    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672272    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672274    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672277    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672279    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672282    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672284    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672287    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672289    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672292    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672294    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672297    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672300    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672302    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672305    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:29.675457 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672307    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672310    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672312    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672314    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672317    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672319    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672322    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672324    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672327    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672329    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672332    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672336    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672339    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672342    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672345    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672348    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672351    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672354    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672356    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:29.675952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672359    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672361    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672365    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672369    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672371    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672373    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672376    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672379    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672381    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672384    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672388    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672391    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672394    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672397    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672399    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672402    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672404    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672407    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672409    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:29.676433 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672412    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.672414    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672477    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672484    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672490    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672494    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672498    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672502    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672506    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672510    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672513    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672516    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672520    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672523    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672526    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672529    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672532    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672535    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672538    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672541    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672544    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672547    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672550    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672553    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 01:09:29.676914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672557    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672560    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672563    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672566    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672569    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672572    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672575    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672578    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672581    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672583    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672587    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672590    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672593    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672596    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672599    2558 flags.go:64] FLAG: --enable-server="true"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672602    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672620    2558 flags.go:64] FLAG: --event-burst="100"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672623    2558 flags.go:64] FLAG: --event-qps="50"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672626    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672632    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672635    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672639    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672642    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672645    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672648    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 29 01:09:29.677567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672651    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672654    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672656    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672659    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672662    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672665    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672668    2558 flags.go:64] FLAG: --feature-gates=""
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672672    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672674    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672677    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672680    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672683    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672686    2558 flags.go:64] FLAG: --help="false"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672696    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-130-167.ec2.internal"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672699    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672702    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672705    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672709    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672712    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672715    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672718    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672721    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672724    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 01:09:29.678179 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672727    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672730    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672733    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672737    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672740    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672744    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672747    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672749    2558 flags.go:64] FLAG: --lock-file=""
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672752    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672755    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672758    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672764    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672767    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672769    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672772    2558 flags.go:64] FLAG: --logging-format="text"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672775    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672778    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672781    2558 flags.go:64] FLAG: --manifest-url=""
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672784    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672788    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672791    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672796    2558 flags.go:64] FLAG: --max-pods="110"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672799    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672802    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672804    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 01:09:29.678873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672807    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672810    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672813    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672816    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672823    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672826    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672829    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672832    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672835    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672840    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672843    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672848    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672851    2558 flags.go:64] FLAG: --port="10250"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672853    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672856    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03f3949b5e4265b0b"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672859    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672862    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672865    2558 flags.go:64] FLAG: --register-node="true"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672868    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672872    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672875    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672877    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672880    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672884    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672887    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 01:09:29.679500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672890    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672893    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672896    2558 flags.go:64] FLAG: --runonce="false"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672898    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672901    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672904    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672907    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672910    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672913    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672915    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672918    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672921    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672924    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672927    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672929    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672932    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672935    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672938    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672946    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672949    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672952    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672955    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672958    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672961    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672963    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 01:09:29.680133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672966    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672969    2558 flags.go:64] FLAG: --v="2"
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672973    2558 flags.go:64] FLAG: --version="false"
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672977    2558 flags.go:64] FLAG: --vmodule=""
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672980    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.672984    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673097    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673101    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673103    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673106    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673108    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673111    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673114    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673117    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673119    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673122    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673125    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673128    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673130    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673133    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673135    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:29.680754 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673138    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673147    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673151    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673155    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673160    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673163    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673166    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673169    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673171    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673174    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673176    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673179    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673181    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673184    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673186    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673189    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673191    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673194    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673197    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673199    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:29.681304 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673202    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673204    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673207    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673209    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673212    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673214    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673217    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673219    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673222    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673224    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673227    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673229    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673232    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673234    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673237    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673239    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673247    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673251    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673254    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:29.681889 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673257    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673261    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673264    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673267    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673269    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673272    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673275    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673278    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673280    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673284    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673287    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673289    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673292    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673294    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673297    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673299    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673302    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673304    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673307    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673309    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:29.682361 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673312    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673314    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673317    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673319    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673322    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673324    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673327    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673329    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673331    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673337    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673340    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673342    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673345    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673349    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673352    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673355    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673357    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673360    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673363    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673365    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:29.682862 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673368    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673371    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673373    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673376    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.673378    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.674275    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.680835    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.680849    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.680869    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.680874    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680945    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680950    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680954    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680957    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680960    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:29.683342 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680963    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680966    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680969    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680972    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680975    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680978    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680981    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680983    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680986    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680989    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680994    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.680997    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681000    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681003    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681006    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681009    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681012    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681014    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681017    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:29.683718 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681020    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681023    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681026    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681029    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681032    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681036    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681038    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681041    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681044    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681047    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681049    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681052    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681054    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681057    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681059    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681062    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681064    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681067    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681070    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681072    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:29.684176 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681075    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681077    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681080    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681082    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681085    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681088    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681090    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681094    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681097    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681100    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681103    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681106    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681108    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681111    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681113    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681116    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681118    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681122    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681125    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681129    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:29.684670 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681132    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681134    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681137    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681147    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681151    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681154    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681156    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681159    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681162    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681165    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681167    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681170    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681173    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681175    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681178    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681181    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681183    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681186    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681188    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:29.685168 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681190    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681193    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681196    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681198    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681201    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681203    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681206    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681208    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681211    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681213    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681216    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681219    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681222    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681225    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681227    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:29.685643 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681230    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.681235    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681356    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681362    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681365    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681368    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681371    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681373    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681376    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681378    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681381    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681383    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681387    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681389    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681392    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:29.686005 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681395    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681397    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681400    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681403    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681405    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681408    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681410    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681413    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681415    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681418    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681420    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681423    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681425    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681428    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681430    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681433    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681436    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681439    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681441    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681444    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:29.686376 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681446    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681449    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681451    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681454    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681458    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681462    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681464    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681468    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681472    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681475    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681477    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681480    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681483    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681486    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681489    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681491    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681494    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681496    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681499    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:29.686952 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681501    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681504    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681506    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681509    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681512    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681515    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681517    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681520    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681522    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681525    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681528    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681530    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681533    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681535    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681538    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681540    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681543    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681545    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681548    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:29.687403 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681550    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681553    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681555    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681558    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681560    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681563    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681565    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681568    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681570    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681573    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681575    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681578    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681580    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681583    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681585    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681588    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681590    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681593    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681595    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681597    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:29.687871 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681600    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:29.688359 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681602    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:29.688359 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681605    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:29.688359 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681622    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:29.688359 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681626    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:29.688359 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681630    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:29.688359 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681634    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:29.688359 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:29.681637    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:29.688359 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.681642    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:09:29.688359 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.681743    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 01:09:29.688359 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.683691    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 01:09:29.688359 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.685500    2558 server.go:1019] "Starting client certificate rotation"
Jul 29 01:09:29.688359 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.685602    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 01:09:29.688359 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.685651    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 01:09:29.688697 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.688403    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 01:09:29.691780 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.691754    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 01:09:29.704146 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.704132    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 29 01:09:29.706094 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.706080    2558 log.go:25] "Validated CRI v1 image API"
Jul 29 01:09:29.706881 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.706868    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 01:09:29.712267 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.712249    2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 97303732-fd9b-43dd-8f6b-3011d3180cac:/dev/nvme0n1p3 c0bb6d91-c146-41f0-98fb-1f39dde1fd40:/dev/nvme0n1p4]
Jul 29 01:09:29.712330 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.712267    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 01:09:29.715959 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.715940    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 01:09:29.717354 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.717245    2558 manager.go:216] Machine: {Timestamp:2026-07-29 01:09:29.715830974 +0000 UTC m=+0.356829859 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111088 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26f1423c4e9defc6d46b8f258a9e73 SystemUUID:ec26f142-3c4e-9def-c6d4-6b8f258a9e73 BootID:e85bab49-64b2-4f3a-99e9-5f5969c87758 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8e:9c:28:bf:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8e:9c:28:bf:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:de:a7:cb:be:31 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 01:09:29.717354 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.717351    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 01:09:29.717464 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.717421    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 01:09:29.720624 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.720594    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 01:09:29.720776 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.720626    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-167.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 01:09:29.721375 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.721365    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 01:09:29.721414 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.721378    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 01:09:29.721414 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.721385    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 01:09:29.722050 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.722039    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 01:09:29.723298 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.723288    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 01:09:29.726152 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.726140    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 01:09:29.726302 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.726292    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 01:09:29.726342 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.726322    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 01:09:29.726342 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.726331    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 01:09:29.726403 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.726344    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 01:09:29.726403 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.726354    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 29 01:09:29.726403 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.726362    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 01:09:29.726675 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.726662    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 01:09:29.726740 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.726679    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 01:09:29.729217 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.729204    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 01:09:29.731735 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.731718    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 01:09:29.731833 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.731752    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 01:09:29.733258 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.733241    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 01:09:29.733345 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.733262    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 01:09:29.733345 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.733272    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 01:09:29.733345 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.733280    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 01:09:29.733345 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.733291    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 01:09:29.733345 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.733299    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 01:09:29.733345 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.733310    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 01:09:29.733345 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.733318    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 01:09:29.733345 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.733327    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 01:09:29.733345 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.733336    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 01:09:29.733345 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.733348    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 01:09:29.733765 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.733357    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 01:09:29.733765 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.733390    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 01:09:29.733765 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.733399    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 01:09:29.735242 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.735219    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-167.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 01:09:29.735730 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:29.735709    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 01:09:29.735730 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:29.735706    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 01:09:29.736568 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.736553    2558 server.go:1268] "Started kubelet"
Jul 29 01:09:29.737021 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.736661    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 01:09:29.737021 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.736710    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 01:09:29.737021 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.736743    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 01:09:29.737443 ip-10-0-130-167 systemd[1]: Started Kubernetes Kubelet.
Jul 29 01:09:29.738712 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.738699    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 01:09:29.741846 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.741825    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 01:09:29.742079 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:29.741066    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-167.ec2.internal.18c69d6767231c9f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-167.ec2.internal,UID:ip-10-0-130-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-167.ec2.internal,},FirstTimestamp:2026-07-29 01:09:29.736527007 +0000 UTC m=+0.377525939,LastTimestamp:2026-07-29 01:09:29.736527007 +0000 UTC m=+0.377525939,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-167.ec2.internal,}"
Jul 29 01:09:29.742999 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:29.742980    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 01:09:29.746622 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.746597    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x988h"
Jul 29 01:09:29.748544 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.748530    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 01:09:29.748588 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.748561    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 01:09:29.748759 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:29.748653    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-167.ec2.internal\" not found"
Jul 29 01:09:29.749112 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.749096    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 01:09:29.749263 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.749245    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 01:09:29.749263 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.749261    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 01:09:29.749404 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.749347    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 01:09:29.749404 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.749358    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 01:09:29.749404 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.749347    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 01:09:29.749404 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.749377    2558 factory.go:55] Registering systemd factory
Jul 29 01:09:29.749404 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.749385    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 29 01:09:29.749642 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.749575    2558 factory.go:153] Registering CRI-O factory
Jul 29 01:09:29.749642 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.749588    2558 factory.go:223] Registration of the crio container factory successfully
Jul 29 01:09:29.749642 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.749623    2558 factory.go:103] Registering Raw factory
Jul 29 01:09:29.749642 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.749636    2558 manager.go:1196] Started watching for new ooms in manager
Jul 29 01:09:29.750019 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.749997    2558 manager.go:349] Starting recovery of all containers
Jul 29 01:09:29.757091 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.757067    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x988h"
Jul 29 01:09:29.759454 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:29.759426    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 01:09:29.759555 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:29.759466    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 01:09:29.763181 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.763164    2558 manager.go:354] Recovery completed
Jul 29 01:09:29.768394 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.768381    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:29.769929 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.769909    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:29.769989 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.769942    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:29.769989 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.769955    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:29.770591 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.770477    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 01:09:29.770676 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.770598    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 01:09:29.770676 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.770631    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 01:09:29.770676 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.770487    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:29.771294 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.771277    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:29.771351 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.771304    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:29.771351 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.771313    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:29.771700 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.771688    2558 policy_none.go:49] "None policy: Start"
Jul 29 01:09:29.771754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.771706    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 01:09:29.771754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.771720    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 01:09:29.772736 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.772722    2558 policy_none.go:47] "Start"
Jul 29 01:09:29.811160 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.811147    2558 manager.go:337] "Starting Device Plugin manager"
Jul 29 01:09:29.811252 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:29.811179    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 01:09:29.811252 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.811189    2558 server.go:87] "Starting device plugin registration server"
Jul 29 01:09:29.811458 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.811444    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 01:09:29.811512 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.811459    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 01:09:29.811575 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.811543    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 01:09:29.811645 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.811632    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 01:09:29.811645 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:29.811643    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 01:09:29.812229 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:29.812209    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 01:09:29.812310 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:29.812246    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-167.ec2.internal\" not found"
Jul 29 01:09:31.030589 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.030558    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 01:09:31.031715 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.031699    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 01:09:31.031789 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.031735    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 01:09:31.031789 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.031752    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 01:09:31.031789 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:31.031783    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 01:09:31.034140 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.034123    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:31.053044 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.052992    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:31.053879 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.053865    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:31.053952 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.053894    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:31.053952 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.053904    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:31.053952 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.053923    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.077679 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.077663    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.077741 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:31.077682    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-167.ec2.internal\": node \"ip-10-0-130-167.ec2.internal\" not found"
Jul 29 01:09:31.132776 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.132757    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-167.ec2.internal"]
Jul 29 01:09:31.132852 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.132827    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:31.134766 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.134754    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:31.134828 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.134780    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:31.134828 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.134793    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:31.136126 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.136114    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:31.136264 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.136248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.136316 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.136286    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:31.136956 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.136939    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:31.137047 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.136971    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:31.137047 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.136976    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:31.137047 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.137007    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:31.137047 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.137021    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:31.137047 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.136981    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:31.138293 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.138277    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.138373 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.138314    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:31.139114 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.139099    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:31.139216 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.139123    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:31.139216 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.139132    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:31.143502 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:31.143485    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-167.ec2.internal\" not found"
Jul 29 01:09:31.160748 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:31.160729    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-167.ec2.internal\" not found" node="ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.165113 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:31.165099    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-167.ec2.internal\" not found" node="ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.190791 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.190769    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3f38f3724504444c25ead0317dd3441-config\") pod \"kube-apiserver-proxy-ip-10-0-130-167.ec2.internal\" (UID: \"d3f38f3724504444c25ead0317dd3441\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.190875 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.190802    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f0aa2a89687e58353bebdc31185ae62a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal\" (UID: \"f0aa2a89687e58353bebdc31185ae62a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.190875 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.190818    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0aa2a89687e58353bebdc31185ae62a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal\" (UID: \"f0aa2a89687e58353bebdc31185ae62a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.244581 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:31.244563    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-167.ec2.internal\" not found"
Jul 29 01:09:31.291028 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.291005    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3f38f3724504444c25ead0317dd3441-config\") pod \"kube-apiserver-proxy-ip-10-0-130-167.ec2.internal\" (UID: \"d3f38f3724504444c25ead0317dd3441\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.291122 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.291031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f0aa2a89687e58353bebdc31185ae62a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal\" (UID: \"f0aa2a89687e58353bebdc31185ae62a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.291122 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.291047    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0aa2a89687e58353bebdc31185ae62a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal\" (UID: \"f0aa2a89687e58353bebdc31185ae62a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.291122 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.291084    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0aa2a89687e58353bebdc31185ae62a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal\" (UID: \"f0aa2a89687e58353bebdc31185ae62a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.291270 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.291117    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3f38f3724504444c25ead0317dd3441-config\") pod \"kube-apiserver-proxy-ip-10-0-130-167.ec2.internal\" (UID: \"d3f38f3724504444c25ead0317dd3441\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.291270 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.291119    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f0aa2a89687e58353bebdc31185ae62a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal\" (UID: \"f0aa2a89687e58353bebdc31185ae62a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.345099 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:31.345052    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-167.ec2.internal\" not found"
Jul 29 01:09:31.445578 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:31.445543    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-167.ec2.internal\" not found"
Jul 29 01:09:31.463713 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.463695    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.468405 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.468329    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.545777 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:31.545751    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-167.ec2.internal\" not found"
Jul 29 01:09:31.646243 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:31.646192    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-167.ec2.internal\" not found"
Jul 29 01:09:31.746596 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:31.746576    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-167.ec2.internal\" not found"
Jul 29 01:09:31.762765 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.762748    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:31.825228 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.825204    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 01:09:31.825703 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.825326    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 01:09:31.825703 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.825372    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 01:09:31.847433 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:31.847418    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-167.ec2.internal\" not found"
Jul 29 01:09:31.902389 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.902330    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 01:04:30 +0000 UTC" deadline="2028-01-17 19:47:06.833070903 +0000 UTC"
Jul 29 01:09:31.902389 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.902360    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12906h37m34.930713743s"
Jul 29 01:09:31.947829 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:31.947797    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-167.ec2.internal\" not found"
Jul 29 01:09:31.981798 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:31.981772    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f38f3724504444c25ead0317dd3441.slice/crio-1c12a04c27a12be80fd933f91e4d2a7c0246e9d70c4d7398ceeeca48ddc24975 WatchSource:0}: Error finding container 1c12a04c27a12be80fd933f91e4d2a7c0246e9d70c4d7398ceeeca48ddc24975: Status 404 returned error can't find the container with id 1c12a04c27a12be80fd933f91e4d2a7c0246e9d70c4d7398ceeeca48ddc24975
Jul 29 01:09:31.982033 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:31.982013    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0aa2a89687e58353bebdc31185ae62a.slice/crio-141be3aeef2f712fd9cacbb26ef28255755165b5fad4f8ac36539c85841ca53f WatchSource:0}: Error finding container 141be3aeef2f712fd9cacbb26ef28255755165b5fad4f8ac36539c85841ca53f: Status 404 returned error can't find the container with id 141be3aeef2f712fd9cacbb26ef28255755165b5fad4f8ac36539c85841ca53f
Jul 29 01:09:31.989240 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.989085    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:31.989283 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.989266    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:31.989371 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:31.989274    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:09:32.002426 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.002398    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 01:09:32.003506 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.003492    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal"
Jul 29 01:09:32.016809 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.016795    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 01:09:32.028786 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.028769    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:32.035985 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.035939    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-167.ec2.internal" event={"ID":"d3f38f3724504444c25ead0317dd3441","Type":"ContainerStarted","Data":"1c12a04c27a12be80fd933f91e4d2a7c0246e9d70c4d7398ceeeca48ddc24975"}
Jul 29 01:09:32.036975 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.036956    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal" event={"ID":"f0aa2a89687e58353bebdc31185ae62a","Type":"ContainerStarted","Data":"141be3aeef2f712fd9cacbb26ef28255755165b5fad4f8ac36539c85841ca53f"}
Jul 29 01:09:32.868504 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.868474    2558 apiserver.go:52] "Watching apiserver"
Jul 29 01:09:32.878072 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.878049    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 01:09:32.880259 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.880236    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-dpkgf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx","openshift-image-registry/node-ca-dhscn","openshift-multus/multus-additional-cni-plugins-4xwc2","openshift-multus/network-metrics-daemon-dtlcz","openshift-ovn-kubernetes/ovnkube-node-fjgn9","kube-system/kube-apiserver-proxy-ip-10-0-130-167.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8hvc2","openshift-dns/node-resolver-vv6bd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal","openshift-multus/multus-96mqb","openshift-network-diagnostics/network-check-target-kznnj","openshift-network-operator/iptables-alerter-xqzcr","kube-system/global-pull-secret-syncer-zdjqz"]
Jul 29 01:09:32.881690 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.881670    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xqzcr"
Jul 29 01:09:32.883045 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.883026    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dhscn"
Jul 29 01:09:32.884407 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.884385    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z47m8\""
Jul 29 01:09:32.884512 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.884394    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 01:09:32.884574 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.884523    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 01:09:32.884871 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.884852    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:09:32.884958 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.884893    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:32.886640 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.885680    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 01:09:32.886640 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.886132    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 01:09:32.886640 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.886151    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 01:09:32.886640 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.886251    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6gxx7\""
Jul 29 01:09:32.887377 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.887297    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:32.887469 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:32.887393    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:32.887644 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.887622    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 01:09:32.888343 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.888311    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g8spf\""
Jul 29 01:09:32.888433 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.888352    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 01:09:32.888433 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.888397    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 01:09:32.888527 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.888352    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 01:09:32.888657 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.888639    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 01:09:32.888899 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.888863    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.890210 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.890163    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 01:09:32.890298 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.890267    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vv6bd"
Jul 29 01:09:32.891850 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.891834    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dpkgf"
Jul 29 01:09:32.892591 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.892405    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 01:09:32.892591 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.892454    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 01:09:32.892591 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.892521    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 01:09:32.893138 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.893118    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:32.893586 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.893566    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 01:09:32.893869 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.893853    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 01:09:32.893943 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.893862    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 01:09:32.894457 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.894440    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:32.894548 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:32.894528    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:32.895454 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.895024    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 01:09:32.895454 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.895086    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 01:09:32.895454 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.895096    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xrpdj\""
Jul 29 01:09:32.895454 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.895328    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-28lgg\""
Jul 29 01:09:32.895454 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.895341    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 01:09:32.895454 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.895348    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-scs94\""
Jul 29 01:09:32.895454 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.895421    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ccsx7\""
Jul 29 01:09:32.895831 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.895614    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 01:09:32.896001 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.895983    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 01:09:32.896059 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.896028    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 01:09:32.896164 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.896148    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 01:09:32.896637 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.896622    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-96mqb"
Jul 29 01:09:32.898508 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.898492    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:32.898600 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:32.898548    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:32.898731 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.898661    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 01:09:32.898731 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.898706    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vp67g\""
Jul 29 01:09:32.900259 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.900243    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:32.901238 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901218    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11845a94-87b0-486e-ab0b-545f54a711a3-system-cni-dir\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:32.901341 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901251    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11845a94-87b0-486e-ab0b-545f54a711a3-cnibin\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:32.901341 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901296    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-systemd-units\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.901341 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901313    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-etc-openvswitch\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.901341 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901327    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-run-openvswitch\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.901549 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5bf265b1-0589-492f-b317-f5d97affdb48-ovnkube-script-lib\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.901549 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901388    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af226ec5-cdaf-45c6-9007-fadb4ee20017-tmp-dir\") pod \"node-resolver-vv6bd\" (UID: \"af226ec5-cdaf-45c6-9007-fadb4ee20017\") " pod="openshift-dns/node-resolver-vv6bd"
Jul 29 01:09:32.901549 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901436    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11845a94-87b0-486e-ab0b-545f54a711a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:32.901549 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901466    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11845a94-87b0-486e-ab0b-545f54a711a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:32.901549 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-run-ovn\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.901549 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901510    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-node-log\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.901549 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a38cca6-c57a-4656-a991-e6832a2e8648-serviceca\") pod \"node-ca-dhscn\" (UID: \"5a38cca6-c57a-4656-a991-e6832a2e8648\") " pod="openshift-image-registry/node-ca-dhscn"
Jul 29 01:09:32.901883 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901559    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11845a94-87b0-486e-ab0b-545f54a711a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:32.901883 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901595    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-run-netns\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.901883 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901615    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-log-socket\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.901883 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901657    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e509743-fc3c-4d36-92bc-e1e601c0d0bf-host-slash\") pod \"iptables-alerter-xqzcr\" (UID: \"8e509743-fc3c-4d36-92bc-e1e601c0d0bf\") " pod="openshift-network-operator/iptables-alerter-xqzcr"
Jul 29 01:09:32.901883 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw8gm\" (UniqueName: \"kubernetes.io/projected/8e509743-fc3c-4d36-92bc-e1e601c0d0bf-kube-api-access-tw8gm\") pod \"iptables-alerter-xqzcr\" (UID: \"8e509743-fc3c-4d36-92bc-e1e601c0d0bf\") " pod="openshift-network-operator/iptables-alerter-xqzcr"
Jul 29 01:09:32.901883 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901694    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:32.901883 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901715    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9k4n\" (UniqueName: \"kubernetes.io/projected/af0f0bbd-a686-4738-97d9-a6faeb834ac7-kube-api-access-s9k4n\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:32.901883 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901732    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-run-ovn-kubernetes\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.901883 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901747    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-cni-bin\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.901883 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901767    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5bf265b1-0589-492f-b317-f5d97affdb48-env-overrides\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.901883 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901786    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-run-systemd\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.901883 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901845    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-var-lib-openvswitch\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.901883 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901871    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glmlj\" (UniqueName: \"kubernetes.io/projected/af226ec5-cdaf-45c6-9007-fadb4ee20017-kube-api-access-glmlj\") pod \"node-resolver-vv6bd\" (UID: \"af226ec5-cdaf-45c6-9007-fadb4ee20017\") " pod="openshift-dns/node-resolver-vv6bd"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901894    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a38cca6-c57a-4656-a991-e6832a2e8648-host\") pod \"node-ca-dhscn\" (UID: \"5a38cca6-c57a-4656-a991-e6832a2e8648\") " pod="openshift-image-registry/node-ca-dhscn"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901915    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfhhw\" (UniqueName: \"kubernetes.io/projected/5a38cca6-c57a-4656-a991-e6832a2e8648-kube-api-access-sfhhw\") pod \"node-ca-dhscn\" (UID: \"5a38cca6-c57a-4656-a991-e6832a2e8648\") " pod="openshift-image-registry/node-ca-dhscn"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11845a94-87b0-486e-ab0b-545f54a711a3-os-release\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.901987    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-slash\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.902016    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11845a94-87b0-486e-ab0b-545f54a711a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.902050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-kubelet\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.902071    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-cni-netd\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.902102    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.902138    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bf265b1-0589-492f-b317-f5d97affdb48-ovn-node-metrics-cert\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.902201    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlz6l\" (UniqueName: \"kubernetes.io/projected/11845a94-87b0-486e-ab0b-545f54a711a3-kube-api-access-tlz6l\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.902227    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fctnw\" (UniqueName: \"kubernetes.io/projected/5bf265b1-0589-492f-b317-f5d97affdb48-kube-api-access-fctnw\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.902347    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8e509743-fc3c-4d36-92bc-e1e601c0d0bf-iptables-alerter-script\") pod \"iptables-alerter-xqzcr\" (UID: \"8e509743-fc3c-4d36-92bc-e1e601c0d0bf\") " pod="openshift-network-operator/iptables-alerter-xqzcr"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.902389    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5bf265b1-0589-492f-b317-f5d97affdb48-ovnkube-config\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.902417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af226ec5-cdaf-45c6-9007-fadb4ee20017-hosts-file\") pod \"node-resolver-vv6bd\" (UID: \"af226ec5-cdaf-45c6-9007-fadb4ee20017\") " pod="openshift-dns/node-resolver-vv6bd"
Jul 29 01:09:32.902528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.902515    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:09:32.903071 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.902557    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 01:09:32.903071 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.902574    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x9zmc\""
Jul 29 01:09:32.903071 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.903029    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 01:09:32.926196 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.926150    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h9lq9"
Jul 29 01:09:32.936474 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.936454    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h9lq9"
Jul 29 01:09:32.991343 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:32.991317    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 01:09:33.002926 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.002902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-registration-dir\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.003032 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.002938    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-sysconfig\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.003032 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.002966    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8ad2537f-978e-4a54-9587-4593723b5394-kubelet-config\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:33.003032 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.002993    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-run-netns\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.003032 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003024    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-modprobe-d\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.003210 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003052    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11845a94-87b0-486e-ab0b-545f54a711a3-system-cni-dir\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.003210 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003088    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11845a94-87b0-486e-ab0b-545f54a711a3-cnibin\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.003210 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003143    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11845a94-87b0-486e-ab0b-545f54a711a3-system-cni-dir\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.003210 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003153    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-etc-openvswitch\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.003210 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003193    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11845a94-87b0-486e-ab0b-545f54a711a3-cnibin\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.003426 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003234    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-etc-openvswitch\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.003426 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003232    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-sysctl-d\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.003426 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003266    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a38163b-fd85-49fa-92c3-bcc2f4e23ba5-konnectivity-ca\") pod \"konnectivity-agent-dpkgf\" (UID: \"3a38163b-fd85-49fa-92c3-bcc2f4e23ba5\") " pod="kube-system/konnectivity-agent-dpkgf"
Jul 29 01:09:33.003426 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003299    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-multus-cni-dir\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.003426 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003321    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af226ec5-cdaf-45c6-9007-fadb4ee20017-tmp-dir\") pod \"node-resolver-vv6bd\" (UID: \"af226ec5-cdaf-45c6-9007-fadb4ee20017\") " pod="openshift-dns/node-resolver-vv6bd"
Jul 29 01:09:33.003426 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003355    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11845a94-87b0-486e-ab0b-545f54a711a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.003426 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003424    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11845a94-87b0-486e-ab0b-545f54a711a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.003719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003523    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-run-ovn\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.003719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003558    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-socket-dir\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.003719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003599    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-sys\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.003719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003621    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ff6f\" (UniqueName: \"kubernetes.io/projected/243fc1c2-9a43-4148-b5cf-199ece0bb73a-kube-api-access-2ff6f\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.003719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003659    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11845a94-87b0-486e-ab0b-545f54a711a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.003719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003657    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-run-ovn\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.003719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003666    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af226ec5-cdaf-45c6-9007-fadb4ee20017-tmp-dir\") pod \"node-resolver-vv6bd\" (UID: \"af226ec5-cdaf-45c6-9007-fadb4ee20017\") " pod="openshift-dns/node-resolver-vv6bd"
Jul 29 01:09:33.004113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003654    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-os-release\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.004113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003755    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11845a94-87b0-486e-ab0b-545f54a711a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.004113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003792    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-run-netns\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.004113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003825    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-kubernetes\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.004113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003851    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a38163b-fd85-49fa-92c3-bcc2f4e23ba5-agent-certs\") pod \"konnectivity-agent-dpkgf\" (UID: \"3a38163b-fd85-49fa-92c3-bcc2f4e23ba5\") " pod="kube-system/konnectivity-agent-dpkgf"
Jul 29 01:09:33.004113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-multus-socket-dir-parent\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.004113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003906    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-run-netns\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.004113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003924    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw8gm\" (UniqueName: \"kubernetes.io/projected/8e509743-fc3c-4d36-92bc-e1e601c0d0bf-kube-api-access-tw8gm\") pod \"iptables-alerter-xqzcr\" (UID: \"8e509743-fc3c-4d36-92bc-e1e601c0d0bf\") " pod="openshift-network-operator/iptables-alerter-xqzcr"
Jul 29 01:09:33.004113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003975    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9k4n\" (UniqueName: \"kubernetes.io/projected/af0f0bbd-a686-4738-97d9-a6faeb834ac7-kube-api-access-s9k4n\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:33.004113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.003993    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11845a94-87b0-486e-ab0b-545f54a711a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.004113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004039    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-cni-bin\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.004113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004077    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-cni-bin\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.004113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004080    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5bf265b1-0589-492f-b317-f5d97affdb48-env-overrides\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.004113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004109    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-run-systemd\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11845a94-87b0-486e-ab0b-545f54a711a3-os-release\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004159    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-run-systemd\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004161    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004201    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11845a94-87b0-486e-ab0b-545f54a711a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004209    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-var-lib-kubelet\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004218    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004235    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-host\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004261    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-tuned\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004278    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-var-lib-kubelet\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004293    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-kubelet\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004313    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-cni-netd\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004336    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-system-cni-dir\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004343    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-kubelet\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004355    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11845a94-87b0-486e-ab0b-545f54a711a3-os-release\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004359    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-run-k8s-cni-cncf-io\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004398    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-hostroot\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.004755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004394    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-cni-netd\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004413    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/476267ab-64fa-4601-8b7e-0f9a48ef8148-multus-daemon-config\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004453    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-etc-kubernetes\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004473    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-device-dir\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004488    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-lib-modules\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-cnibin\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004511    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5bf265b1-0589-492f-b317-f5d97affdb48-env-overrides\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004551    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8e509743-fc3c-4d36-92bc-e1e601c0d0bf-iptables-alerter-script\") pod \"iptables-alerter-xqzcr\" (UID: \"8e509743-fc3c-4d36-92bc-e1e601c0d0bf\") " pod="openshift-network-operator/iptables-alerter-xqzcr"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004591    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5bf265b1-0589-492f-b317-f5d97affdb48-ovnkube-config\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004619    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004645    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-sys-fs\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004678    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-var-lib-cni-multus\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004706    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af226ec5-cdaf-45c6-9007-fadb4ee20017-hosts-file\") pod \"node-resolver-vv6bd\" (UID: \"af226ec5-cdaf-45c6-9007-fadb4ee20017\") " pod="openshift-dns/node-resolver-vv6bd"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004763    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af226ec5-cdaf-45c6-9007-fadb4ee20017-hosts-file\") pod \"node-resolver-vv6bd\" (UID: \"af226ec5-cdaf-45c6-9007-fadb4ee20017\") " pod="openshift-dns/node-resolver-vv6bd"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004764    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-systemd-units\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004797    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-run-openvswitch\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004822    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5bf265b1-0589-492f-b317-f5d97affdb48-ovnkube-script-lib\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.005631 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004850    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bwnz\" (UniqueName: \"kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz\") pod \"network-check-target-kznnj\" (UID: \"49593762-5cdf-4434-9f5d-e6b6a8019add\") " pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004858    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-systemd-units\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004876    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004876    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-run-openvswitch\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004896    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp5w2\" (UniqueName: \"kubernetes.io/projected/476267ab-64fa-4601-8b7e-0f9a48ef8148-kube-api-access-mp5w2\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004936    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-sysctl-conf\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004962    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-node-log\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.004986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a38cca6-c57a-4656-a991-e6832a2e8648-serviceca\") pod \"node-ca-dhscn\" (UID: \"5a38cca6-c57a-4656-a991-e6832a2e8648\") " pod="openshift-image-registry/node-ca-dhscn"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005034    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-node-log\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005063    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-log-socket\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005082    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-run\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005112    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5bf265b1-0589-492f-b317-f5d97affdb48-ovnkube-config\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005121    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-log-socket\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005129    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8e509743-fc3c-4d36-92bc-e1e601c0d0bf-iptables-alerter-script\") pod \"iptables-alerter-xqzcr\" (UID: \"8e509743-fc3c-4d36-92bc-e1e601c0d0bf\") " pod="openshift-network-operator/iptables-alerter-xqzcr"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005136    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/243fc1c2-9a43-4148-b5cf-199ece0bb73a-tmp\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005162    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8ad2537f-978e-4a54-9587-4593723b5394-dbus\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005195    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e509743-fc3c-4d36-92bc-e1e601c0d0bf-host-slash\") pod \"iptables-alerter-xqzcr\" (UID: \"8e509743-fc3c-4d36-92bc-e1e601c0d0bf\") " pod="openshift-network-operator/iptables-alerter-xqzcr"
Jul 29 01:09:33.006391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005211    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005249    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-run-ovn-kubernetes\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005254    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e509743-fc3c-4d36-92bc-e1e601c0d0bf-host-slash\") pod \"iptables-alerter-xqzcr\" (UID: \"8e509743-fc3c-4d36-92bc-e1e601c0d0bf\") " pod="openshift-network-operator/iptables-alerter-xqzcr"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szrtt\" (UniqueName: \"kubernetes.io/projected/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-kube-api-access-szrtt\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005299    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-run-ovn-kubernetes\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005301    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-var-lib-openvswitch\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.005328    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glmlj\" (UniqueName: \"kubernetes.io/projected/af226ec5-cdaf-45c6-9007-fadb4ee20017-kube-api-access-glmlj\") pod \"node-resolver-vv6bd\" (UID: \"af226ec5-cdaf-45c6-9007-fadb4ee20017\") " pod="openshift-dns/node-resolver-vv6bd"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005339    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5bf265b1-0589-492f-b317-f5d97affdb48-ovnkube-script-lib\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005336    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-var-lib-openvswitch\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005356    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a38cca6-c57a-4656-a991-e6832a2e8648-host\") pod \"node-ca-dhscn\" (UID: \"5a38cca6-c57a-4656-a991-e6832a2e8648\") " pod="openshift-image-registry/node-ca-dhscn"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005397    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a38cca6-c57a-4656-a991-e6832a2e8648-host\") pod \"node-ca-dhscn\" (UID: \"5a38cca6-c57a-4656-a991-e6832a2e8648\") " pod="openshift-image-registry/node-ca-dhscn"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.005413    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs podName:af0f0bbd-a686-4738-97d9-a6faeb834ac7 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:33.505375527 +0000 UTC m=+3.005810975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs") pod "network-metrics-daemon-dtlcz" (UID: "af0f0bbd-a686-4738-97d9-a6faeb834ac7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005437    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a38cca6-c57a-4656-a991-e6832a2e8648-serviceca\") pod \"node-ca-dhscn\" (UID: \"5a38cca6-c57a-4656-a991-e6832a2e8648\") " pod="openshift-image-registry/node-ca-dhscn"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005440    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfhhw\" (UniqueName: \"kubernetes.io/projected/5a38cca6-c57a-4656-a991-e6832a2e8648-kube-api-access-sfhhw\") pod \"node-ca-dhscn\" (UID: \"5a38cca6-c57a-4656-a991-e6832a2e8648\") " pod="openshift-image-registry/node-ca-dhscn"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005488    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-slash\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bf265b1-0589-492f-b317-f5d97affdb48-ovn-node-metrics-cert\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.007089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005525    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5bf265b1-0589-492f-b317-f5d97affdb48-host-slash\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.007758 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-systemd\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.007758 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005568    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/476267ab-64fa-4601-8b7e-0f9a48ef8148-cni-binary-copy\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.007758 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11845a94-87b0-486e-ab0b-545f54a711a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.007758 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005625    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:33.007758 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005648    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-var-lib-cni-bin\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.007758 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-multus-conf-dir\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.007758 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005701    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-run-multus-certs\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.007758 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005737    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlz6l\" (UniqueName: \"kubernetes.io/projected/11845a94-87b0-486e-ab0b-545f54a711a3-kube-api-access-tlz6l\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.007758 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fctnw\" (UniqueName: \"kubernetes.io/projected/5bf265b1-0589-492f-b317-f5d97affdb48-kube-api-access-fctnw\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.007758 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005809    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 01:09:33.007758 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.005953    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11845a94-87b0-486e-ab0b-545f54a711a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.009291 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.009270    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bf265b1-0589-492f-b317-f5d97affdb48-ovn-node-metrics-cert\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.016675 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.016303    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfhhw\" (UniqueName: \"kubernetes.io/projected/5a38cca6-c57a-4656-a991-e6832a2e8648-kube-api-access-sfhhw\") pod \"node-ca-dhscn\" (UID: \"5a38cca6-c57a-4656-a991-e6832a2e8648\") " pod="openshift-image-registry/node-ca-dhscn"
Jul 29 01:09:33.016675 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.016634    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9k4n\" (UniqueName: \"kubernetes.io/projected/af0f0bbd-a686-4738-97d9-a6faeb834ac7-kube-api-access-s9k4n\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:33.016829 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.016792    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw8gm\" (UniqueName: \"kubernetes.io/projected/8e509743-fc3c-4d36-92bc-e1e601c0d0bf-kube-api-access-tw8gm\") pod \"iptables-alerter-xqzcr\" (UID: \"8e509743-fc3c-4d36-92bc-e1e601c0d0bf\") " pod="openshift-network-operator/iptables-alerter-xqzcr"
Jul 29 01:09:33.017149 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.017127    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fctnw\" (UniqueName: \"kubernetes.io/projected/5bf265b1-0589-492f-b317-f5d97affdb48-kube-api-access-fctnw\") pod \"ovnkube-node-fjgn9\" (UID: \"5bf265b1-0589-492f-b317-f5d97affdb48\") " pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.017907 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.017886    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlz6l\" (UniqueName: \"kubernetes.io/projected/11845a94-87b0-486e-ab0b-545f54a711a3-kube-api-access-tlz6l\") pod \"multus-additional-cni-plugins-4xwc2\" (UID: \"11845a94-87b0-486e-ab0b-545f54a711a3\") " pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.018379 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.018360    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glmlj\" (UniqueName: \"kubernetes.io/projected/af226ec5-cdaf-45c6-9007-fadb4ee20017-kube-api-access-glmlj\") pod \"node-resolver-vv6bd\" (UID: \"af226ec5-cdaf-45c6-9007-fadb4ee20017\") " pod="openshift-dns/node-resolver-vv6bd"
Jul 29 01:09:33.106721 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106683    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-sysctl-d\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.106884 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106730    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a38163b-fd85-49fa-92c3-bcc2f4e23ba5-konnectivity-ca\") pod \"konnectivity-agent-dpkgf\" (UID: \"3a38163b-fd85-49fa-92c3-bcc2f4e23ba5\") " pod="kube-system/konnectivity-agent-dpkgf"
Jul 29 01:09:33.106884 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106757    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-multus-cni-dir\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.106884 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-socket-dir\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.106884 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-sys\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.106884 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ff6f\" (UniqueName: \"kubernetes.io/projected/243fc1c2-9a43-4148-b5cf-199ece0bb73a-kube-api-access-2ff6f\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.106884 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-os-release\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.106884 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106877    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-kubernetes\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106901    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a38163b-fd85-49fa-92c3-bcc2f4e23ba5-agent-certs\") pod \"konnectivity-agent-dpkgf\" (UID: \"3a38163b-fd85-49fa-92c3-bcc2f4e23ba5\") " pod="kube-system/konnectivity-agent-dpkgf"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106924    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-multus-socket-dir-parent\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106948    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-var-lib-kubelet\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106962    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-host\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-tuned\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106984    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-multus-cni-dir\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107001    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-sysctl-d\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107023    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-var-lib-kubelet\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.106990    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-var-lib-kubelet\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107064    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-system-cni-dir\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107093    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-run-k8s-cni-cncf-io\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107118    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-hostroot\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107138    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-socket-dir\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/476267ab-64fa-4601-8b7e-0f9a48ef8148-multus-daemon-config\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107167    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-etc-kubernetes\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107201    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-sys\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107212    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-device-dir\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.107243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-lib-modules\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107228    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-run-k8s-cni-cncf-io\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107259    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-cnibin\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107267    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-system-cni-dir\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107286    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107282    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-hostroot\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-multus-socket-dir-parent\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107321    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-sys-fs\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107323    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-host\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107275    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-os-release\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107336    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-device-dir\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107381    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-var-lib-cni-multus\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107433    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-var-lib-cni-multus\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107441    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-sys-fs\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107388    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-etc-kubernetes\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107478    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bwnz\" (UniqueName: \"kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz\") pod \"network-check-target-kznnj\" (UID: \"49593762-5cdf-4434-9f5d-e6b6a8019add\") " pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107482    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-lib-modules\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a38163b-fd85-49fa-92c3-bcc2f4e23ba5-konnectivity-ca\") pod \"konnectivity-agent-dpkgf\" (UID: \"3a38163b-fd85-49fa-92c3-bcc2f4e23ba5\") " pod="kube-system/konnectivity-agent-dpkgf"
Jul 29 01:09:33.108056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107510    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp5w2\" (UniqueName: \"kubernetes.io/projected/476267ab-64fa-4601-8b7e-0f9a48ef8148-kube-api-access-mp5w2\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107640    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-kubernetes\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107693    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107700    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-sysctl-conf\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107730    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-etc-selinux\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107784    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/476267ab-64fa-4601-8b7e-0f9a48ef8148-multus-daemon-config\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107788    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-cnibin\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-run\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107821    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-var-lib-kubelet\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/243fc1c2-9a43-4148-b5cf-199ece0bb73a-tmp\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107893    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8ad2537f-978e-4a54-9587-4593723b5394-dbus\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107911    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-sysctl-conf\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.107957    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-run\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108002    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8ad2537f-978e-4a54-9587-4593723b5394-dbus\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108019    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szrtt\" (UniqueName: \"kubernetes.io/projected/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-kube-api-access-szrtt\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108090    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-systemd\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108132    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/476267ab-64fa-4601-8b7e-0f9a48ef8148-cni-binary-copy\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.108856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108142    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-systemd\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108159    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108204    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-var-lib-cni-bin\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108231    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-multus-conf-dir\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108255    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-run-multus-certs\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108282    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-registration-dir\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.108285    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108304    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-sysconfig\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108328    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8ad2537f-978e-4a54-9587-4593723b5394-kubelet-config\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.108350    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret podName:8ad2537f-978e-4a54-9587-4593723b5394 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:33.608332339 +0000 UTC m=+3.108767769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret") pod "global-pull-secret-syncer-zdjqz" (UID: "8ad2537f-978e-4a54-9587-4593723b5394") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108372    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8ad2537f-978e-4a54-9587-4593723b5394-kubelet-config\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108380    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-run-netns\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108406    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-modprobe-d\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108416    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-var-lib-cni-bin\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108473    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-run-netns\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108478    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-multus-conf-dir\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108503    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/476267ab-64fa-4601-8b7e-0f9a48ef8148-host-run-multus-certs\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.109719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108528    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-sysconfig\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.110465 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108557    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/476267ab-64fa-4601-8b7e-0f9a48ef8148-cni-binary-copy\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.110465 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108579    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-registration-dir\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.110465 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.108601    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-modprobe-d\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.110465 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.110101    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/243fc1c2-9a43-4148-b5cf-199ece0bb73a-etc-tuned\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.110465 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.110165    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/243fc1c2-9a43-4148-b5cf-199ece0bb73a-tmp\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.110465 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.110285    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a38163b-fd85-49fa-92c3-bcc2f4e23ba5-agent-certs\") pod \"konnectivity-agent-dpkgf\" (UID: \"3a38163b-fd85-49fa-92c3-bcc2f4e23ba5\") " pod="kube-system/konnectivity-agent-dpkgf"
Jul 29 01:09:33.115672 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.115651    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:33.115672 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.115672    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:33.115851 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.115685    2558 projected.go:196] Error preparing data for projected volume kube-api-access-2bwnz for pod openshift-network-diagnostics/network-check-target-kznnj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:33.115851 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.115748    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz podName:49593762-5cdf-4434-9f5d-e6b6a8019add nodeName:}" failed. No retries permitted until 2026-07-29 01:09:33.615737203 +0000 UTC m=+3.116172633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2bwnz" (UniqueName: "kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz") pod "network-check-target-kznnj" (UID: "49593762-5cdf-4434-9f5d-e6b6a8019add") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:33.120965 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.120912    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp5w2\" (UniqueName: \"kubernetes.io/projected/476267ab-64fa-4601-8b7e-0f9a48ef8148-kube-api-access-mp5w2\") pod \"multus-96mqb\" (UID: \"476267ab-64fa-4601-8b7e-0f9a48ef8148\") " pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.121852 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.121834    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ff6f\" (UniqueName: \"kubernetes.io/projected/243fc1c2-9a43-4148-b5cf-199ece0bb73a-kube-api-access-2ff6f\") pod \"tuned-8hvc2\" (UID: \"243fc1c2-9a43-4148-b5cf-199ece0bb73a\") " pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.121935 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.121904    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szrtt\" (UniqueName: \"kubernetes.io/projected/db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1-kube-api-access-szrtt\") pod \"aws-ebs-csi-driver-node-zrkwx\" (UID: \"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.195943 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.195908    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xqzcr"
Jul 29 01:09:33.203745 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.203723    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dhscn"
Jul 29 01:09:33.211422 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.211402    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4xwc2"
Jul 29 01:09:33.215962 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.215941    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:33.222642 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.222624    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vv6bd"
Jul 29 01:09:33.228341 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.228316    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dpkgf"
Jul 29 01:09:33.235414 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.235397    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx"
Jul 29 01:09:33.244196 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.244162    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-96mqb"
Jul 29 01:09:33.247879 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.247864    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8hvc2"
Jul 29 01:09:33.349322 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.349293    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:33.512186 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.512137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:33.512346 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.512289    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:33.512397 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.512375    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs podName:af0f0bbd-a686-4738-97d9-a6faeb834ac7 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:34.51235308 +0000 UTC m=+4.012788524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs") pod "network-metrics-daemon-dtlcz" (UID: "af0f0bbd-a686-4738-97d9-a6faeb834ac7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:33.612947 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.612919    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:33.613122 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.613038    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:33.613122 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.613100    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret podName:8ad2537f-978e-4a54-9587-4593723b5394 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:34.613083933 +0000 UTC m=+4.113519382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret") pod "global-pull-secret-syncer-zdjqz" (UID: "8ad2537f-978e-4a54-9587-4593723b5394") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:33.713506 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.713466    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bwnz\" (UniqueName: \"kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz\") pod \"network-check-target-kznnj\" (UID: \"49593762-5cdf-4434-9f5d-e6b6a8019add\") " pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:33.713668 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.713634    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:33.713668 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.713656    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:33.713765 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.713675    2558 projected.go:196] Error preparing data for projected volume kube-api-access-2bwnz for pod openshift-network-diagnostics/network-check-target-kznnj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:33.713765 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:33.713735    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz podName:49593762-5cdf-4434-9f5d-e6b6a8019add nodeName:}" failed. No retries permitted until 2026-07-29 01:09:34.713721363 +0000 UTC m=+4.214156792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2bwnz" (UniqueName: "kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz") pod "network-check-target-kznnj" (UID: "49593762-5cdf-4434-9f5d-e6b6a8019add") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:33.781725 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.781643    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:33.834191 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:33.834151    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a38cca6_c57a_4656_a991_e6832a2e8648.slice/crio-a19526921c65f7dc7caf82c5ef0d53e56d55c59e596c9fb687f12e75c07a7092 WatchSource:0}: Error finding container a19526921c65f7dc7caf82c5ef0d53e56d55c59e596c9fb687f12e75c07a7092: Status 404 returned error can't find the container with id a19526921c65f7dc7caf82c5ef0d53e56d55c59e596c9fb687f12e75c07a7092
Jul 29 01:09:33.835880 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:33.835796    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11845a94_87b0_486e_ab0b_545f54a711a3.slice/crio-3f793a7f23e99be5bf6309a8725de41fa9283a293ead82c1dbba3b06bd0392e6 WatchSource:0}: Error finding container 3f793a7f23e99be5bf6309a8725de41fa9283a293ead82c1dbba3b06bd0392e6: Status 404 returned error can't find the container with id 3f793a7f23e99be5bf6309a8725de41fa9283a293ead82c1dbba3b06bd0392e6
Jul 29 01:09:33.838969 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:33.838942    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476267ab_64fa_4601_8b7e_0f9a48ef8148.slice/crio-57dd09b719b35ac76b4919c4865a66673fd1d7af6693a9f0f274f423e12af4b6 WatchSource:0}: Error finding container 57dd09b719b35ac76b4919c4865a66673fd1d7af6693a9f0f274f423e12af4b6: Status 404 returned error can't find the container with id 57dd09b719b35ac76b4919c4865a66673fd1d7af6693a9f0f274f423e12af4b6
Jul 29 01:09:33.839634 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:33.839610    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf226ec5_cdaf_45c6_9007_fadb4ee20017.slice/crio-9da9e1d186a71f4bbce7728f9a77e5105bcdb9f47a2fdb62cc964c31b521a8f5 WatchSource:0}: Error finding container 9da9e1d186a71f4bbce7728f9a77e5105bcdb9f47a2fdb62cc964c31b521a8f5: Status 404 returned error can't find the container with id 9da9e1d186a71f4bbce7728f9a77e5105bcdb9f47a2fdb62cc964c31b521a8f5
Jul 29 01:09:33.840425 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:33.840336    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a38163b_fd85_49fa_92c3_bcc2f4e23ba5.slice/crio-846ad9d26d5f9c2c5dd252d6d21a9458580f5463741ea47d0b8925a4a00d10ae WatchSource:0}: Error finding container 846ad9d26d5f9c2c5dd252d6d21a9458580f5463741ea47d0b8925a4a00d10ae: Status 404 returned error can't find the container with id 846ad9d26d5f9c2c5dd252d6d21a9458580f5463741ea47d0b8925a4a00d10ae
Jul 29 01:09:33.842118 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:33.842082    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0d9f01_dfdd_4de3_8b7f_db7a6f8f18d1.slice/crio-599facf8606e69e242d374a7095fff92e88465b11c388a9d21751a0ba610c7ae WatchSource:0}: Error finding container 599facf8606e69e242d374a7095fff92e88465b11c388a9d21751a0ba610c7ae: Status 404 returned error can't find the container with id 599facf8606e69e242d374a7095fff92e88465b11c388a9d21751a0ba610c7ae
Jul 29 01:09:33.842996 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:33.842947    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243fc1c2_9a43_4148_b5cf_199ece0bb73a.slice/crio-1cdbbd4ff0fde2a963c3344ef5e2195d44a18eb3baab49d93d47409c0b13fe78 WatchSource:0}: Error finding container 1cdbbd4ff0fde2a963c3344ef5e2195d44a18eb3baab49d93d47409c0b13fe78: Status 404 returned error can't find the container with id 1cdbbd4ff0fde2a963c3344ef5e2195d44a18eb3baab49d93d47409c0b13fe78
Jul 29 01:09:33.845059 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:33.845038    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf265b1_0589_492f_b317_f5d97affdb48.slice/crio-1bce96b7d5b89eaf5800b67c42a4b7d7ec127b0a8208b9ada14452fd13153e97 WatchSource:0}: Error finding container 1bce96b7d5b89eaf5800b67c42a4b7d7ec127b0a8208b9ada14452fd13153e97: Status 404 returned error can't find the container with id 1bce96b7d5b89eaf5800b67c42a4b7d7ec127b0a8208b9ada14452fd13153e97
Jul 29 01:09:33.846195 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:09:33.846156    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e509743_fc3c_4d36_92bc_e1e601c0d0bf.slice/crio-b7ce300a81f94179d2ad978be44787a35dd72645c395ec4b68500e8f72591a79 WatchSource:0}: Error finding container b7ce300a81f94179d2ad978be44787a35dd72645c395ec4b68500e8f72591a79: Status 404 returned error can't find the container with id b7ce300a81f94179d2ad978be44787a35dd72645c395ec4b68500e8f72591a79
Jul 29 01:09:33.939246 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.939099    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 01:04:32 +0000 UTC" deadline="2028-03-20 02:26:00.714112563 +0000 UTC"
Jul 29 01:09:33.939649 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:33.939247    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14401h16m26.774869986s"
Jul 29 01:09:34.032719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.032648    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:34.032843 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:34.032745    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:34.042162 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.042129    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8hvc2" event={"ID":"243fc1c2-9a43-4148-b5cf-199ece0bb73a","Type":"ContainerStarted","Data":"1cdbbd4ff0fde2a963c3344ef5e2195d44a18eb3baab49d93d47409c0b13fe78"}
Jul 29 01:09:34.043297 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.043258    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vv6bd" event={"ID":"af226ec5-cdaf-45c6-9007-fadb4ee20017","Type":"ContainerStarted","Data":"9da9e1d186a71f4bbce7728f9a77e5105bcdb9f47a2fdb62cc964c31b521a8f5"}
Jul 29 01:09:34.044405 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.044383    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dhscn" event={"ID":"5a38cca6-c57a-4656-a991-e6832a2e8648","Type":"ContainerStarted","Data":"a19526921c65f7dc7caf82c5ef0d53e56d55c59e596c9fb687f12e75c07a7092"}
Jul 29 01:09:34.046066 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.046043    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-167.ec2.internal" event={"ID":"d3f38f3724504444c25ead0317dd3441","Type":"ContainerStarted","Data":"b95531d0747129ccf2523dacb6cd0364220066bfa5ff91e4317d756b2b843a2a"}
Jul 29 01:09:34.047352 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.047333    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal" event={"ID":"f0aa2a89687e58353bebdc31185ae62a","Type":"ContainerStarted","Data":"cc27da0d4f60f2003f7ca446ddff297754c981d5b7de844239229043cad311eb"}
Jul 29 01:09:34.048262 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.048237    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9" event={"ID":"5bf265b1-0589-492f-b317-f5d97affdb48","Type":"ContainerStarted","Data":"1bce96b7d5b89eaf5800b67c42a4b7d7ec127b0a8208b9ada14452fd13153e97"}
Jul 29 01:09:34.049126 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.049109    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx" event={"ID":"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1","Type":"ContainerStarted","Data":"599facf8606e69e242d374a7095fff92e88465b11c388a9d21751a0ba610c7ae"}
Jul 29 01:09:34.050096 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.050071    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dpkgf" event={"ID":"3a38163b-fd85-49fa-92c3-bcc2f4e23ba5","Type":"ContainerStarted","Data":"846ad9d26d5f9c2c5dd252d6d21a9458580f5463741ea47d0b8925a4a00d10ae"}
Jul 29 01:09:34.051140 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.051122    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-96mqb" event={"ID":"476267ab-64fa-4601-8b7e-0f9a48ef8148","Type":"ContainerStarted","Data":"57dd09b719b35ac76b4919c4865a66673fd1d7af6693a9f0f274f423e12af4b6"}
Jul 29 01:09:34.052150 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.052132    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xwc2" event={"ID":"11845a94-87b0-486e-ab0b-545f54a711a3","Type":"ContainerStarted","Data":"3f793a7f23e99be5bf6309a8725de41fa9283a293ead82c1dbba3b06bd0392e6"}
Jul 29 01:09:34.053162 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.053144    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xqzcr" event={"ID":"8e509743-fc3c-4d36-92bc-e1e601c0d0bf","Type":"ContainerStarted","Data":"b7ce300a81f94179d2ad978be44787a35dd72645c395ec4b68500e8f72591a79"}
Jul 29 01:09:34.088351 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.088299    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-167.ec2.internal" podStartSLOduration=3.088283369 podStartE2EDuration="3.088283369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:34.068293851 +0000 UTC m=+3.568729303" watchObservedRunningTime="2026-07-29 01:09:34.088283369 +0000 UTC m=+3.588718823"
Jul 29 01:09:34.519797 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.519760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:34.520014 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:34.519942    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:34.520014 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:34.520006    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs podName:af0f0bbd-a686-4738-97d9-a6faeb834ac7 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:36.519986739 +0000 UTC m=+6.020422190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs") pod "network-metrics-daemon-dtlcz" (UID: "af0f0bbd-a686-4738-97d9-a6faeb834ac7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:34.620327 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.620294    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:34.620522 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:34.620503    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:34.620592 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:34.620583    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret podName:8ad2537f-978e-4a54-9587-4593723b5394 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:36.6205622 +0000 UTC m=+6.120997661 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret") pod "global-pull-secret-syncer-zdjqz" (UID: "8ad2537f-978e-4a54-9587-4593723b5394") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:34.721397 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.721362    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bwnz\" (UniqueName: \"kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz\") pod \"network-check-target-kznnj\" (UID: \"49593762-5cdf-4434-9f5d-e6b6a8019add\") " pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:34.721572 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:34.721559    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:34.721638 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:34.721579    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:34.721638 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:34.721595    2558 projected.go:196] Error preparing data for projected volume kube-api-access-2bwnz for pod openshift-network-diagnostics/network-check-target-kznnj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:34.721748 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:34.721649    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz podName:49593762-5cdf-4434-9f5d-e6b6a8019add nodeName:}" failed. No retries permitted until 2026-07-29 01:09:36.721632249 +0000 UTC m=+6.222067699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2bwnz" (UniqueName: "kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz") pod "network-check-target-kznnj" (UID: "49593762-5cdf-4434-9f5d-e6b6a8019add") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:34.939735 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.939582    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 01:04:32 +0000 UTC" deadline="2028-04-02 01:04:09.630966371 +0000 UTC"
Jul 29 01:09:34.939735 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:34.939648    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14711h54m34.691322953s"
Jul 29 01:09:35.034479 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:35.034452    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:35.034655 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:35.034580    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:35.034966 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:35.034945    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:35.035106 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:35.035084    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:35.076866 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:35.076832    2558 generic.go:356] "Generic (PLEG): container finished" podID="f0aa2a89687e58353bebdc31185ae62a" containerID="cc27da0d4f60f2003f7ca446ddff297754c981d5b7de844239229043cad311eb" exitCode=0
Jul 29 01:09:35.077718 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:35.077683    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal" event={"ID":"f0aa2a89687e58353bebdc31185ae62a","Type":"ContainerDied","Data":"cc27da0d4f60f2003f7ca446ddff297754c981d5b7de844239229043cad311eb"}
Jul 29 01:09:36.031952 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:36.031919    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:36.032523 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:36.032047    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:36.099354 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:36.098850    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal" event={"ID":"f0aa2a89687e58353bebdc31185ae62a","Type":"ContainerStarted","Data":"c873e3e880d2dd7eadd604477ca0e20666ef0637d1b1ce544047e2e590688600"}
Jul 29 01:09:36.536046 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:36.535983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:36.536289 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:36.536119    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:36.537077 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:36.537053    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs podName:af0f0bbd-a686-4738-97d9-a6faeb834ac7 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:40.537025337 +0000 UTC m=+10.037460768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs") pod "network-metrics-daemon-dtlcz" (UID: "af0f0bbd-a686-4738-97d9-a6faeb834ac7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:36.636681 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:36.636638    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:36.636872 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:36.636797    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:36.636872 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:36.636862    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret podName:8ad2537f-978e-4a54-9587-4593723b5394 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:40.636844363 +0000 UTC m=+10.137279807 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret") pod "global-pull-secret-syncer-zdjqz" (UID: "8ad2537f-978e-4a54-9587-4593723b5394") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:36.737686 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:36.737648    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bwnz\" (UniqueName: \"kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz\") pod \"network-check-target-kznnj\" (UID: \"49593762-5cdf-4434-9f5d-e6b6a8019add\") " pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:36.737878 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:36.737858    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:36.737970 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:36.737886    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:36.737970 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:36.737898    2558 projected.go:196] Error preparing data for projected volume kube-api-access-2bwnz for pod openshift-network-diagnostics/network-check-target-kznnj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:36.737970 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:36.737954    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz podName:49593762-5cdf-4434-9f5d-e6b6a8019add nodeName:}" failed. No retries permitted until 2026-07-29 01:09:40.737936273 +0000 UTC m=+10.238371706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2bwnz" (UniqueName: "kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz") pod "network-check-target-kznnj" (UID: "49593762-5cdf-4434-9f5d-e6b6a8019add") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:37.033570 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:37.033533    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:37.034019 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:37.033669    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:37.034019 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:37.034004    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:37.034130 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:37.034104    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:38.032731 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:38.032565    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:38.032731 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:38.032696    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:39.032978 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:39.032942    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:39.033434 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:39.033080    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:39.033534 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:39.033513    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:39.033657 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:39.033616    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:40.033077 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:40.032802    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:40.033077 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:40.032937    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:40.573898 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:40.573344    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:40.573898 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:40.573499    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:40.573898 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:40.573559    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs podName:af0f0bbd-a686-4738-97d9-a6faeb834ac7 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:48.57354115 +0000 UTC m=+18.073976582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs") pod "network-metrics-daemon-dtlcz" (UID: "af0f0bbd-a686-4738-97d9-a6faeb834ac7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:40.674676 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:40.674620    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:40.674876 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:40.674763    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:40.674876 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:40.674839    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret podName:8ad2537f-978e-4a54-9587-4593723b5394 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:48.674819013 +0000 UTC m=+18.175254465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret") pod "global-pull-secret-syncer-zdjqz" (UID: "8ad2537f-978e-4a54-9587-4593723b5394") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:40.775951 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:40.775392    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bwnz\" (UniqueName: \"kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz\") pod \"network-check-target-kznnj\" (UID: \"49593762-5cdf-4434-9f5d-e6b6a8019add\") " pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:40.775951 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:40.775541    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:40.775951 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:40.775564    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:40.775951 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:40.775576    2558 projected.go:196] Error preparing data for projected volume kube-api-access-2bwnz for pod openshift-network-diagnostics/network-check-target-kznnj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:40.775951 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:40.775638    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz podName:49593762-5cdf-4434-9f5d-e6b6a8019add nodeName:}" failed. No retries permitted until 2026-07-29 01:09:48.775619233 +0000 UTC m=+18.276054680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2bwnz" (UniqueName: "kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz") pod "network-check-target-kznnj" (UID: "49593762-5cdf-4434-9f5d-e6b6a8019add") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:41.033310 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:41.033274    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:41.033803 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:41.033386    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:41.033803 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:41.033712    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:41.033922 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:41.033798    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:42.033028 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:42.032533    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:42.033028 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:42.032656    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:43.032068 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:43.032042    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:43.032469 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:43.032042    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:43.032469 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:43.032158    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:43.032469 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:43.032239    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:44.032161 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:44.032123    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:44.032565 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:44.032266    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:45.032755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:45.032713    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:45.033237 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:45.032768    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:45.033237 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:45.032866    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:45.033237 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:45.033003    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:46.032655 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:46.032619    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:46.032846 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:46.032766    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:47.033052 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:47.033008    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:47.033520 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:47.033145    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:47.033520 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:47.033214    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:47.033520 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:47.033329    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:48.032637 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:48.032610    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:48.032811 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:48.032704    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:48.629238 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:48.629195    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:48.629633 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:48.629344    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:48.629633 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:48.629414    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs podName:af0f0bbd-a686-4738-97d9-a6faeb834ac7 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:04.629391454 +0000 UTC m=+34.129826896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs") pod "network-metrics-daemon-dtlcz" (UID: "af0f0bbd-a686-4738-97d9-a6faeb834ac7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:48.730212 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:48.730162    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:48.730369 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:48.730308    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:48.730414 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:48.730380    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret podName:8ad2537f-978e-4a54-9587-4593723b5394 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:04.730362881 +0000 UTC m=+34.230798310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret") pod "global-pull-secret-syncer-zdjqz" (UID: "8ad2537f-978e-4a54-9587-4593723b5394") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:48.830732 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:48.830693    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bwnz\" (UniqueName: \"kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz\") pod \"network-check-target-kznnj\" (UID: \"49593762-5cdf-4434-9f5d-e6b6a8019add\") " pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:48.830904 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:48.830868    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:48.830904 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:48.830892    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:48.830904 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:48.830902    2558 projected.go:196] Error preparing data for projected volume kube-api-access-2bwnz for pod openshift-network-diagnostics/network-check-target-kznnj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:48.831022 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:48.830952    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz podName:49593762-5cdf-4434-9f5d-e6b6a8019add nodeName:}" failed. No retries permitted until 2026-07-29 01:10:04.830936993 +0000 UTC m=+34.331372423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2bwnz" (UniqueName: "kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz") pod "network-check-target-kznnj" (UID: "49593762-5cdf-4434-9f5d-e6b6a8019add") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:49.032094 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:49.032066    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:49.032271 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:49.032067    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:49.032271 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:49.032217    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:49.032401 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:49.032278    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:50.032875 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:50.032846    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:50.033305 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:50.032940    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:51.032598 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:51.032571    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:51.032780 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:51.032662    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:51.032780 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:51.032658    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:51.032780 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:51.032771    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:52.032775 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:52.032740    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:52.032929 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:52.032850    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:53.033033 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.032776    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:53.033900 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.032868    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:53.033900 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:53.033114    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:53.033900 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:53.033197    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:53.132012 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.131734    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dhscn" event={"ID":"5a38cca6-c57a-4656-a991-e6832a2e8648","Type":"ContainerStarted","Data":"59d40cc01909ea85e2e1d2d262d6ad8b62627f618bd05ace155e4c261363ac3e"}
Jul 29 01:09:53.136206 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.136158    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9" event={"ID":"5bf265b1-0589-492f-b317-f5d97affdb48","Type":"ContainerStarted","Data":"2a8103a6f3f1e7528bdd23a04d1a3b67b710c1e9b028fc1f0885dd13f856969c"}
Jul 29 01:09:53.136332 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.136312    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9" event={"ID":"5bf265b1-0589-492f-b317-f5d97affdb48","Type":"ContainerStarted","Data":"06f68b1c3b11c28b87b284283e8110de2e1d8dc139a749a552e9352bcd935c6c"}
Jul 29 01:09:53.136408 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.136393    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9" event={"ID":"5bf265b1-0589-492f-b317-f5d97affdb48","Type":"ContainerStarted","Data":"2825a5f0d3e8e262c1a8a0243875d48bd74fb69d8f4e5e6827e7c8e57673c500"}
Jul 29 01:09:53.136554 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.136524    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9" event={"ID":"5bf265b1-0589-492f-b317-f5d97affdb48","Type":"ContainerStarted","Data":"fa92444f39acfdda4370ea6c619050bea4e75389612266f9fc9bae9d2b0c0fa7"}
Jul 29 01:09:53.138468 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.138443    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx" event={"ID":"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1","Type":"ContainerStarted","Data":"344efec1ad46b0d3e8dd41a4ca6b64dae515419c8d883477721a839673d03dd4"}
Jul 29 01:09:53.140012 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.139991    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dpkgf" event={"ID":"3a38163b-fd85-49fa-92c3-bcc2f4e23ba5","Type":"ContainerStarted","Data":"09f44fd715b11be24287c3b29ae5e2061408ee19d800ec176a4d19e14df18d30"}
Jul 29 01:09:53.141626 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.141595    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-96mqb" event={"ID":"476267ab-64fa-4601-8b7e-0f9a48ef8148","Type":"ContainerStarted","Data":"dbda35b41c2ec7545dec447451cf905d152c890fdbb47c26e276a2677ab0ca6b"}
Jul 29 01:09:53.143842 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.143815    2558 generic.go:356] "Generic (PLEG): container finished" podID="11845a94-87b0-486e-ab0b-545f54a711a3" containerID="e18d62800c795e598ae0be0ad63d4ad79e63c5c234903641d9a5e69bef0b236c" exitCode=0
Jul 29 01:09:53.143942 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.143893    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xwc2" event={"ID":"11845a94-87b0-486e-ab0b-545f54a711a3","Type":"ContainerDied","Data":"e18d62800c795e598ae0be0ad63d4ad79e63c5c234903641d9a5e69bef0b236c"}
Jul 29 01:09:53.145389 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.145366    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8hvc2" event={"ID":"243fc1c2-9a43-4148-b5cf-199ece0bb73a","Type":"ContainerStarted","Data":"1619504037b3ba5752bb6b17e6fc8d730afdaeb35643c2d8fb2213792a9ccbce"}
Jul 29 01:09:53.146726 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.146707    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vv6bd" event={"ID":"af226ec5-cdaf-45c6-9007-fadb4ee20017","Type":"ContainerStarted","Data":"f92a5cc428b9ea619fe4f619797ef0e5141b7bf881fb3a973ca86086cfd9dace"}
Jul 29 01:09:53.148048 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.148014    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-167.ec2.internal" podStartSLOduration=21.147988666 podStartE2EDuration="21.147988666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:36.114647019 +0000 UTC m=+5.615082471" watchObservedRunningTime="2026-07-29 01:09:53.147988666 +0000 UTC m=+22.648424108"
Jul 29 01:09:53.148439 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.148410    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dhscn" podStartSLOduration=3.8003931890000002 podStartE2EDuration="22.148396493s" totalImagesPullingTime="18.348003304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:53.148126987 +0000 UTC m=+22.648562481" watchObservedRunningTime="2026-07-29 01:09:53.148396493 +0000 UTC m=+22.648831947"
Jul 29 01:09:53.189138 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.189096    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vv6bd" podStartSLOduration=3.5436118629999998 podStartE2EDuration="22.189080054s" totalImagesPullingTime="18.645468191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:53.188773753 +0000 UTC m=+22.689209205" watchObservedRunningTime="2026-07-29 01:09:53.189080054 +0000 UTC m=+22.689515505"
Jul 29 01:09:53.203223 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.203160    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dpkgf" podStartSLOduration=11.687898774 podStartE2EDuration="22.20314678s" totalImagesPullingTime="10.515248006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:53.202815201 +0000 UTC m=+22.703250654" watchObservedRunningTime="2026-07-29 01:09:53.20314678 +0000 UTC m=+22.703582231"
Jul 29 01:09:53.220369 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.220330    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8hvc2" podStartSLOduration=3.528354954 podStartE2EDuration="22.220315652s" totalImagesPullingTime="18.691960698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:53.219776573 +0000 UTC m=+22.720212025" watchObservedRunningTime="2026-07-29 01:09:53.220315652 +0000 UTC m=+22.720751101"
Jul 29 01:09:53.236335 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.236292    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-96mqb" podStartSLOduration=3.1828278819999998 podStartE2EDuration="22.236273945s" totalImagesPullingTime="19.053446063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:53.236012231 +0000 UTC m=+22.736447685" watchObservedRunningTime="2026-07-29 01:09:53.236273945 +0000 UTC m=+22.736709395"
Jul 29 01:09:53.245954 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.245914    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:53.357197 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.357113    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:53.463448 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.463418    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:53.526091 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.526050    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:53.583351 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:53.583305    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:54.032727 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:54.032698    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:54.032868 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:54.032834    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:54.107083 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:54.107058    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 01:09:54.152432 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:54.152400    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9" event={"ID":"5bf265b1-0589-492f-b317-f5d97affdb48","Type":"ContainerStarted","Data":"8b78be839da59ef2bb5a6624641bb1cbc6742e62417b6cc54a118adaa15de6bc"}
Jul 29 01:09:54.152578 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:54.152492    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9" event={"ID":"5bf265b1-0589-492f-b317-f5d97affdb48","Type":"ContainerStarted","Data":"678fad281dfda7703ed868a2a0bd774eb5283848dca32fcb0104da70f0be3bf1"}
Jul 29 01:09:54.154488 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:54.154452    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx" event={"ID":"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1","Type":"ContainerStarted","Data":"bb7bd55d310e342edf8a3d2f567e0d7b72579a6a46be5532b521dd790d5f6d88"}
Jul 29 01:09:54.156076 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:54.156050    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xqzcr" event={"ID":"8e509743-fc3c-4d36-92bc-e1e601c0d0bf","Type":"ContainerStarted","Data":"e988988c8ff8bee810740e098bc4bfda4c7709c70962f048638e4e3462632670"}
Jul 29 01:09:54.170648 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:54.170604    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xqzcr" podStartSLOduration=4.5314199330000005 podStartE2EDuration="23.170586251s" totalImagesPullingTime="18.639166318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:54.170490021 +0000 UTC m=+23.670925473" watchObservedRunningTime="2026-07-29 01:09:54.170586251 +0000 UTC m=+23.671021707"
Jul 29 01:09:54.292449 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:54.292410    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:54.350394 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:54.350356    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:54.966487 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:54.966378    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T01:09:54.107078339Z","UUID":"62fe0fb3-dfd8-4186-8bdd-90d55feafeac","Handler":null,"Name":"","Endpoint":""}
Jul 29 01:09:54.968022 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:54.968002    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 01:09:54.968151 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:54.968043    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 01:09:55.021140 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:55.021105    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:55.032087 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:55.032066    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:55.032229 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:55.032212    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:55.032291 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:55.032257    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:55.032394 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:55.032372    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:55.119318 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:55.119290    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:55.220962 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:55.220867    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:56.032786 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:56.032600    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:56.032985 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:56.032869    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:56.165390 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:56.165347    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9" event={"ID":"5bf265b1-0589-492f-b317-f5d97affdb48","Type":"ContainerStarted","Data":"306785fcef2765c5d07a0fbb2a40ffb378957acb5e148cc63d2dd8d6f2f73d7d"}
Jul 29 01:09:56.167696 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:56.167664    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx" event={"ID":"db0d9f01-dfdd-4de3-8b7f-db7a6f8f18d1","Type":"ContainerStarted","Data":"919e4e2bc21424e1761c48aae5b63f6ca514e8f516cb6ff3e9e2943b6bd8b509"}
Jul 29 01:09:56.187739 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:56.187697    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrkwx" podStartSLOduration=4.320361216 podStartE2EDuration="25.18768217s" totalImagesPullingTime="20.867320954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:56.187000159 +0000 UTC m=+25.687435613" watchObservedRunningTime="2026-07-29 01:09:56.18768217 +0000 UTC m=+25.688117621"
Jul 29 01:09:57.032912 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:57.032877    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:57.032912 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:57.032896    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:57.033144 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:57.032995    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:57.033144 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:57.033070    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:57.178515 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:57.178492    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dpkgf"
Jul 29 01:09:57.179494 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:57.179478    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dpkgf"
Jul 29 01:09:58.032289 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:58.032094    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:58.032444 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:58.032363    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:58.174644 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:58.174609    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9" event={"ID":"5bf265b1-0589-492f-b317-f5d97affdb48","Type":"ContainerStarted","Data":"14daf8d373ff92312592a9862dbb38249be1ea5be394748c2a7ccddcd96009aa"}
Jul 29 01:09:58.174954 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:58.174927    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:58.176435 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:58.176404    2558 generic.go:356] "Generic (PLEG): container finished" podID="11845a94-87b0-486e-ab0b-545f54a711a3" containerID="1be949eb792c214cc92ace2e7287c42bbd0dd34dc617c581126db23d54b615c7" exitCode=0
Jul 29 01:09:58.176544 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:58.176487    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xwc2" event={"ID":"11845a94-87b0-486e-ab0b-545f54a711a3","Type":"ContainerDied","Data":"1be949eb792c214cc92ace2e7287c42bbd0dd34dc617c581126db23d54b615c7"}
Jul 29 01:09:58.176687 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:58.176659    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dpkgf"
Jul 29 01:09:58.177126 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:58.177109    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dpkgf"
Jul 29 01:09:58.191308 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:58.191269    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:58.201033 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:58.200996    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9" podStartSLOduration=8.464049442 podStartE2EDuration="27.200984766s" totalImagesPullingTime="18.736935324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:58.199521484 +0000 UTC m=+27.699956936" watchObservedRunningTime="2026-07-29 01:09:58.200984766 +0000 UTC m=+27.701420218"
Jul 29 01:09:58.299533 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:58.299475    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:09:59.032556 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:59.032530    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:59.032756 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:59.032567    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:59.032756 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:59.032668    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:59.032872 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:59.032811    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:59.179185 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:59.179109    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:59.179185 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:59.179168    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:59.193235 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:59.193211    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:09:59.590459 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:59.590424    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dtlcz"]
Jul 29 01:09:59.590649 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:59.590634    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:09:59.590782 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:59.590753    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:09:59.591050 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:59.591028    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zdjqz"]
Jul 29 01:09:59.591148 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:59.591133    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:09:59.591268 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:59.591249    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:09:59.592266 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:59.592245    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kznnj"]
Jul 29 01:09:59.592363 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:59.592353    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:09:59.592470 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:09:59.592444    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:09:59.895455 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:09:59.895374    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:00.000339 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:00.000303    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:00.182609 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:00.182529    2558 generic.go:356] "Generic (PLEG): container finished" podID="11845a94-87b0-486e-ab0b-545f54a711a3" containerID="30680a2e2ac950568c619c3e9d303e60739ac1648e15051be135d1d427bd7ba2" exitCode=0
Jul 29 01:10:00.182757 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:00.182630    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xwc2" event={"ID":"11845a94-87b0-486e-ab0b-545f54a711a3","Type":"ContainerDied","Data":"30680a2e2ac950568c619c3e9d303e60739ac1648e15051be135d1d427bd7ba2"}
Jul 29 01:10:01.033161 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:01.033008    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:10:01.033560 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:01.033075    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:10:01.033560 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:01.033252    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:10:01.033560 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:01.033375    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:10:01.186469 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:01.186438    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xwc2" event={"ID":"11845a94-87b0-486e-ab0b-545f54a711a3","Type":"ContainerStarted","Data":"fb6f8c9cff284fb86cd588396cf96b50fb1ef7d27f6af3e96935c42fef88ae3e"}
Jul 29 01:10:01.562287 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:01.562249    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:01.631290 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:01.631261    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:02.032812 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:02.032788    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:10:02.032959 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:02.032884    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:10:02.190506 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:02.190475    2558 generic.go:356] "Generic (PLEG): container finished" podID="11845a94-87b0-486e-ab0b-545f54a711a3" containerID="fb6f8c9cff284fb86cd588396cf96b50fb1ef7d27f6af3e96935c42fef88ae3e" exitCode=0
Jul 29 01:10:02.190910 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:02.190524    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xwc2" event={"ID":"11845a94-87b0-486e-ab0b-545f54a711a3","Type":"ContainerDied","Data":"fb6f8c9cff284fb86cd588396cf96b50fb1ef7d27f6af3e96935c42fef88ae3e"}
Jul 29 01:10:03.032442 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:03.032413    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:10:03.032630 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:03.032544    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:10:03.032630 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:03.032608    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:10:03.032760 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:03.032737    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:10:04.032037 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:04.032008    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:10:04.032624 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:04.032119    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjqz" podUID="8ad2537f-978e-4a54-9587-4593723b5394"
Jul 29 01:10:04.650698 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:04.650669    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:10:04.650874 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:04.650804    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:04.650874 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:04.650871    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs podName:af0f0bbd-a686-4738-97d9-a6faeb834ac7 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:36.650852312 +0000 UTC m=+66.151287741 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs") pod "network-metrics-daemon-dtlcz" (UID: "af0f0bbd-a686-4738-97d9-a6faeb834ac7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:04.751782 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:04.751747    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:10:04.751957 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:04.751861    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:04.751957 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:04.751927    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret podName:8ad2537f-978e-4a54-9587-4593723b5394 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:36.751909278 +0000 UTC m=+66.252344725 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret") pod "global-pull-secret-syncer-zdjqz" (UID: "8ad2537f-978e-4a54-9587-4593723b5394") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:04.852561 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:04.852524    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bwnz\" (UniqueName: \"kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz\") pod \"network-check-target-kznnj\" (UID: \"49593762-5cdf-4434-9f5d-e6b6a8019add\") " pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:10:04.852720 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:04.852675    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:04.852720 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:04.852694    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:04.852720 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:04.852707    2558 projected.go:196] Error preparing data for projected volume kube-api-access-2bwnz for pod openshift-network-diagnostics/network-check-target-kznnj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:04.852840 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:04.852767    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz podName:49593762-5cdf-4434-9f5d-e6b6a8019add nodeName:}" failed. No retries permitted until 2026-07-29 01:10:36.85274874 +0000 UTC m=+66.353184219 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2bwnz" (UniqueName: "kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz") pod "network-check-target-kznnj" (UID: "49593762-5cdf-4434-9f5d-e6b6a8019add") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:05.032141 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.032107    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:10:05.032141 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.032123    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:10:05.032640 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:05.032224    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kznnj" podUID="49593762-5cdf-4434-9f5d-e6b6a8019add"
Jul 29 01:10:05.032640 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:05.032373    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:10:05.843952 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.843925    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-167.ec2.internal" event="NodeReady"
Jul 29 01:10:05.844109 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.844081    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 01:10:05.894820 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.894783    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hk6hx"]
Jul 29 01:10:05.895669 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.895641    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:05.897592 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.897570    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4g22q"]
Jul 29 01:10:05.897712 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.897691    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:05.899732 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.899712    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4g22q"
Jul 29 01:10:05.901644 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.901394    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 01:10:05.901644 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.901424    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zd58l\""
Jul 29 01:10:05.901644 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.901475    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 01:10:05.903431 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.903414    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 01:10:05.903521 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.903460    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fcjh7\""
Jul 29 01:10:05.903864 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.903825    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 01:10:05.903972 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.903888    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 01:10:05.911588 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.911551    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hk6hx"]
Jul 29 01:10:05.914932 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.914911    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4g22q"]
Jul 29 01:10:05.968426 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:05.968401    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:06.032568 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.032543    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:10:06.035191 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.035154    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 01:10:06.061385 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.061359    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8-cert\") pod \"ingress-canary-4g22q\" (UID: \"3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8\") " pod="openshift-ingress-canary/ingress-canary-4g22q"
Jul 29 01:10:06.061385 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.061373    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:06.061557 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.061399    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:06.061557 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.061527    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e77ad1e5-bfb2-4c16-8895-0854b65959bb-config-volume\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:06.061648 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.061557    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e77ad1e5-bfb2-4c16-8895-0854b65959bb-tmp-dir\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:06.061648 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.061601    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq2xn\" (UniqueName: \"kubernetes.io/projected/e77ad1e5-bfb2-4c16-8895-0854b65959bb-kube-api-access-kq2xn\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:06.061735 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.061645    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72l4w\" (UniqueName: \"kubernetes.io/projected/3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8-kube-api-access-72l4w\") pod \"ingress-canary-4g22q\" (UID: \"3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8\") " pod="openshift-ingress-canary/ingress-canary-4g22q"
Jul 29 01:10:06.161978 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.161916    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8-cert\") pod \"ingress-canary-4g22q\" (UID: \"3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8\") " pod="openshift-ingress-canary/ingress-canary-4g22q"
Jul 29 01:10:06.161978 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.161945    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:06.162159 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.161988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e77ad1e5-bfb2-4c16-8895-0854b65959bb-config-volume\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:06.162159 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.162009    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e77ad1e5-bfb2-4c16-8895-0854b65959bb-tmp-dir\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:06.162159 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.162045    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq2xn\" (UniqueName: \"kubernetes.io/projected/e77ad1e5-bfb2-4c16-8895-0854b65959bb-kube-api-access-kq2xn\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:06.162159 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.162083    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72l4w\" (UniqueName: \"kubernetes.io/projected/3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8-kube-api-access-72l4w\") pod \"ingress-canary-4g22q\" (UID: \"3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8\") " pod="openshift-ingress-canary/ingress-canary-4g22q"
Jul 29 01:10:06.162414 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:06.162191    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:06.162414 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:06.162257    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls podName:e77ad1e5-bfb2-4c16-8895-0854b65959bb nodeName:}" failed. No retries permitted until 2026-07-29 01:10:06.662236884 +0000 UTC m=+36.162672337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls") pod "dns-default-hk6hx" (UID: "e77ad1e5-bfb2-4c16-8895-0854b65959bb") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:06.162414 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.162386    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e77ad1e5-bfb2-4c16-8895-0854b65959bb-tmp-dir\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:06.162582 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.162563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e77ad1e5-bfb2-4c16-8895-0854b65959bb-config-volume\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:06.166124 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.166097    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8-cert\") pod \"ingress-canary-4g22q\" (UID: \"3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8\") " pod="openshift-ingress-canary/ingress-canary-4g22q"
Jul 29 01:10:06.171776 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.171756    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq2xn\" (UniqueName: \"kubernetes.io/projected/e77ad1e5-bfb2-4c16-8895-0854b65959bb-kube-api-access-kq2xn\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:06.171993 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.171973    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72l4w\" (UniqueName: \"kubernetes.io/projected/3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8-kube-api-access-72l4w\") pod \"ingress-canary-4g22q\" (UID: \"3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8\") " pod="openshift-ingress-canary/ingress-canary-4g22q"
Jul 29 01:10:06.216461 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.216321    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4g22q"
Jul 29 01:10:06.349465 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.349436    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4g22q"]
Jul 29 01:10:06.371955 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:10:06.371925    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ddc2c7b_ff7d_45fc_9971_8cd2a28b94c8.slice/crio-7169b1f8101b81f9432cbf82327d4bad030f69eb750c9781c7bf5af6daa2b141 WatchSource:0}: Error finding container 7169b1f8101b81f9432cbf82327d4bad030f69eb750c9781c7bf5af6daa2b141: Status 404 returned error can't find the container with id 7169b1f8101b81f9432cbf82327d4bad030f69eb750c9781c7bf5af6daa2b141
Jul 29 01:10:06.497274 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.497158    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:06.665770 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:06.665738    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:06.665918 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:06.665898    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:06.665976 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:06.665967    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls podName:e77ad1e5-bfb2-4c16-8895-0854b65959bb nodeName:}" failed. No retries permitted until 2026-07-29 01:10:07.665950086 +0000 UTC m=+37.166385519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls") pod "dns-default-hk6hx" (UID: "e77ad1e5-bfb2-4c16-8895-0854b65959bb") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:07.032304 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:07.032269    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:10:07.032304 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:07.032288    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:10:07.035979 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:07.035849    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 01:10:07.035979 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:07.035874    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 01:10:07.035979 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:07.035921    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5jbq7\""
Jul 29 01:10:07.036473 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:07.036335    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 01:10:07.036473 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:07.036376    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p2784\""
Jul 29 01:10:07.207460 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:07.207428    2558 generic.go:356] "Generic (PLEG): container finished" podID="11845a94-87b0-486e-ab0b-545f54a711a3" containerID="42f522adee522e116bfbc100aa77d2747ca83a315df6f7b0bc0f18b0b3abd8c1" exitCode=0
Jul 29 01:10:07.207622 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:07.207517    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xwc2" event={"ID":"11845a94-87b0-486e-ab0b-545f54a711a3","Type":"ContainerDied","Data":"42f522adee522e116bfbc100aa77d2747ca83a315df6f7b0bc0f18b0b3abd8c1"}
Jul 29 01:10:07.208962 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:07.208936    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4g22q" event={"ID":"3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8","Type":"ContainerStarted","Data":"7169b1f8101b81f9432cbf82327d4bad030f69eb750c9781c7bf5af6daa2b141"}
Jul 29 01:10:07.674372 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:07.674290    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:07.674519 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:07.674467    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:07.674572 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:07.674548    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls podName:e77ad1e5-bfb2-4c16-8895-0854b65959bb nodeName:}" failed. No retries permitted until 2026-07-29 01:10:09.674524905 +0000 UTC m=+39.174960350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls") pod "dns-default-hk6hx" (UID: "e77ad1e5-bfb2-4c16-8895-0854b65959bb") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:08.214939 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:08.214896    2558 generic.go:356] "Generic (PLEG): container finished" podID="11845a94-87b0-486e-ab0b-545f54a711a3" containerID="b8491fd7203739049e9bd57c6bef69ae9e173adee527a084d70fca252bc220f6" exitCode=0
Jul 29 01:10:08.215356 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:08.214946    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xwc2" event={"ID":"11845a94-87b0-486e-ab0b-545f54a711a3","Type":"ContainerDied","Data":"b8491fd7203739049e9bd57c6bef69ae9e173adee527a084d70fca252bc220f6"}
Jul 29 01:10:09.220300 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:09.220085    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xwc2" event={"ID":"11845a94-87b0-486e-ab0b-545f54a711a3","Type":"ContainerStarted","Data":"3014328b89a3604788632c6b6418b424bdeac14cafb8e0de042f96a5c72e8928"}
Jul 29 01:10:09.221515 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:09.221494    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4g22q" event={"ID":"3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8","Type":"ContainerStarted","Data":"a9c7f4ec187ea2c268dfaaf6b15aa12a21374253e3665dcff693ad9b0dd1b3b2"}
Jul 29 01:10:09.244140 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:09.244043    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4xwc2" podStartSLOduration=9.460155457 podStartE2EDuration="38.244027364s" totalImagesPullingTime="28.783871907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:09.242763504 +0000 UTC m=+38.743198957" watchObservedRunningTime="2026-07-29 01:10:09.244027364 +0000 UTC m=+38.744462817"
Jul 29 01:10:09.340182 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:09.340152    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:09.398845 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:09.398822    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:09.458020 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:09.457962    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:09.691022 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:09.690981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:09.691170 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:09.691117    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:09.691170 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:09.691186    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls podName:e77ad1e5-bfb2-4c16-8895-0854b65959bb nodeName:}" failed. No retries permitted until 2026-07-29 01:10:13.691158578 +0000 UTC m=+43.191594007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls") pod "dns-default-hk6hx" (UID: "e77ad1e5-bfb2-4c16-8895-0854b65959bb") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:11.039219 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:11.039187    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:11.097153 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:11.097122    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:13.718318 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:13.718281    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:13.718675 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:13.718442    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:13.718675 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:13.718507    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls podName:e77ad1e5-bfb2-4c16-8895-0854b65959bb nodeName:}" failed. No retries permitted until 2026-07-29 01:10:21.718490171 +0000 UTC m=+51.218925601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls") pod "dns-default-hk6hx" (UID: "e77ad1e5-bfb2-4c16-8895-0854b65959bb") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:16.002807 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:16.002777    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:16.103872 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:16.103842    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:21.771503 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:21.771459    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:21.771962 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:21.771610    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:21.771962 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:21.771685    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls podName:e77ad1e5-bfb2-4c16-8895-0854b65959bb nodeName:}" failed. No retries permitted until 2026-07-29 01:10:37.771668969 +0000 UTC m=+67.272104398 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls") pod "dns-default-hk6hx" (UID: "e77ad1e5-bfb2-4c16-8895-0854b65959bb") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:27.987973 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:27.987936    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:28.044756 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:28.044721    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:31.203219 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:31.203193    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fjgn9"
Jul 29 01:10:31.231565 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:31.231515    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4g22q" podStartSLOduration=23.952429754 podStartE2EDuration="26.231497803s" totalImagesPullingTime="2.279068049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:09.261317616 +0000 UTC m=+38.761753067" watchObservedRunningTime="2026-07-29 01:10:31.231497803 +0000 UTC m=+60.731933258"
Jul 29 01:10:31.333275 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:31.333243    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:31.396430 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:31.396384    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:10:35.360093 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.360066    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94"]
Jul 29 01:10:35.362810 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.362794    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94"
Jul 29 01:10:35.365336 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.365314    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 01:10:35.366659 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.366642    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 01:10:35.366659 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.366651    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 29 01:10:35.366794 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.366651    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rzfhd\""
Jul 29 01:10:35.366794 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.366644    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 01:10:35.370756 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.370735    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94"]
Jul 29 01:10:35.383076 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.383054    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"]
Jul 29 01:10:35.385259 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.385245    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.389271 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.389250    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 29 01:10:35.389369 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.389322    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 29 01:10:35.389369 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.389357    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 29 01:10:35.389486 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.389448    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 29 01:10:35.397550 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.397528    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"]
Jul 29 01:10:35.460900 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.460858    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.460900 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.460902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-hub\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.461067 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.460924    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-ca\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.461067 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.460958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.461067 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.460986    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9555082-e796-40a0-bbeb-0dd67601301a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56b8cc48dd-42w94\" (UID: \"e9555082-e796-40a0-bbeb-0dd67601301a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94"
Jul 29 01:10:35.461067 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.461039    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.461067 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.461056    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wz6b\" (UniqueName: \"kubernetes.io/projected/e9555082-e796-40a0-bbeb-0dd67601301a-kube-api-access-4wz6b\") pod \"managed-serviceaccount-addon-agent-56b8cc48dd-42w94\" (UID: \"e9555082-e796-40a0-bbeb-0dd67601301a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94"
Jul 29 01:10:35.461272 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.461074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5tv4\" (UniqueName: \"kubernetes.io/projected/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-kube-api-access-r5tv4\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.561915 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.561878    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.561915 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.561919    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wz6b\" (UniqueName: \"kubernetes.io/projected/e9555082-e796-40a0-bbeb-0dd67601301a-kube-api-access-4wz6b\") pod \"managed-serviceaccount-addon-agent-56b8cc48dd-42w94\" (UID: \"e9555082-e796-40a0-bbeb-0dd67601301a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94"
Jul 29 01:10:35.562059 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.561939    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5tv4\" (UniqueName: \"kubernetes.io/projected/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-kube-api-access-r5tv4\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.562059 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.561991    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.562059 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.562008    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-hub\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.562059 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.562035    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-ca\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.562262 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.562059    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.562262 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.562085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9555082-e796-40a0-bbeb-0dd67601301a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56b8cc48dd-42w94\" (UID: \"e9555082-e796-40a0-bbeb-0dd67601301a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94"
Jul 29 01:10:35.562703 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.562672    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.566046 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.566017    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.566148 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.566081    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-hub\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.566148 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.566085    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-ca\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.566252 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.566208    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9555082-e796-40a0-bbeb-0dd67601301a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56b8cc48dd-42w94\" (UID: \"e9555082-e796-40a0-bbeb-0dd67601301a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94"
Jul 29 01:10:35.566359 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.566339    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.569785 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.569754    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wz6b\" (UniqueName: \"kubernetes.io/projected/e9555082-e796-40a0-bbeb-0dd67601301a-kube-api-access-4wz6b\") pod \"managed-serviceaccount-addon-agent-56b8cc48dd-42w94\" (UID: \"e9555082-e796-40a0-bbeb-0dd67601301a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94"
Jul 29 01:10:35.569906 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.569890    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5tv4\" (UniqueName: \"kubernetes.io/projected/b8ad20be-d753-44bc-a770-bcfc1ce49ee1-kube-api-access-r5tv4\") pod \"cluster-proxy-proxy-agent-5b49b89b89-7zdvd\" (UID: \"b8ad20be-d753-44bc-a770-bcfc1ce49ee1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.680096 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.679996    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94"
Jul 29 01:10:35.696318 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.696293    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:10:35.806283 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.806253    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94"]
Jul 29 01:10:35.809006 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:10:35.808978    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9555082_e796_40a0_bbeb_0dd67601301a.slice/crio-e8269621002be29d6d0ea4ff41bd5be090f2ba90bca5a5f34bd660dfd5d6d481 WatchSource:0}: Error finding container e8269621002be29d6d0ea4ff41bd5be090f2ba90bca5a5f34bd660dfd5d6d481: Status 404 returned error can't find the container with id e8269621002be29d6d0ea4ff41bd5be090f2ba90bca5a5f34bd660dfd5d6d481
Jul 29 01:10:35.823466 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:35.823380    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"]
Jul 29 01:10:35.825722 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:10:35.825700    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8ad20be_d753_44bc_a770_bcfc1ce49ee1.slice/crio-3f5828bd4c839264a1d23ff943fd1dc6f7088a01d22a5a1145988e10555913d8 WatchSource:0}: Error finding container 3f5828bd4c839264a1d23ff943fd1dc6f7088a01d22a5a1145988e10555913d8: Status 404 returned error can't find the container with id 3f5828bd4c839264a1d23ff943fd1dc6f7088a01d22a5a1145988e10555913d8
Jul 29 01:10:36.280987 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:36.280948    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd" event={"ID":"b8ad20be-d753-44bc-a770-bcfc1ce49ee1","Type":"ContainerStarted","Data":"3f5828bd4c839264a1d23ff943fd1dc6f7088a01d22a5a1145988e10555913d8"}
Jul 29 01:10:36.281917 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:36.281896    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94" event={"ID":"e9555082-e796-40a0-bbeb-0dd67601301a","Type":"ContainerStarted","Data":"e8269621002be29d6d0ea4ff41bd5be090f2ba90bca5a5f34bd660dfd5d6d481"}
Jul 29 01:10:36.670646 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:36.670565    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:10:36.673184 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:36.673157    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 01:10:36.681121 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:36.681103    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 01:10:36.681189 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:36.681164    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs podName:af0f0bbd-a686-4738-97d9-a6faeb834ac7 nodeName:}" failed. No retries permitted until 2026-07-29 01:11:40.681148017 +0000 UTC m=+130.181583460 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs") pod "network-metrics-daemon-dtlcz" (UID: "af0f0bbd-a686-4738-97d9-a6faeb834ac7") : secret "metrics-daemon-secret" not found
Jul 29 01:10:36.771143 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:36.771109    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:10:36.773931 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:36.773906    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 01:10:36.784100 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:36.784081    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ad2537f-978e-4a54-9587-4593723b5394-original-pull-secret\") pod \"global-pull-secret-syncer-zdjqz\" (UID: \"8ad2537f-978e-4a54-9587-4593723b5394\") " pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:10:36.871949 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:36.871913    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bwnz\" (UniqueName: \"kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz\") pod \"network-check-target-kznnj\" (UID: \"49593762-5cdf-4434-9f5d-e6b6a8019add\") " pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:10:36.874772 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:36.874743    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 01:10:36.885357 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:36.885333    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 01:10:36.896371 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:36.896344    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bwnz\" (UniqueName: \"kubernetes.io/projected/49593762-5cdf-4434-9f5d-e6b6a8019add-kube-api-access-2bwnz\") pod \"network-check-target-kznnj\" (UID: \"49593762-5cdf-4434-9f5d-e6b6a8019add\") " pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:10:36.943847 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:36.943773    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjqz"
Jul 29 01:10:37.047018 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:37.046988    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5jbq7\""
Jul 29 01:10:37.055535 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:37.055510    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:10:37.097568 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:37.097538    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zdjqz"]
Jul 29 01:10:37.101477 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:10:37.101451    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad2537f_978e_4a54_9587_4593723b5394.slice/crio-40a40cd95fa24a56825a85e33a57d8532c1039fcc1dcc83392720bc196c314f6 WatchSource:0}: Error finding container 40a40cd95fa24a56825a85e33a57d8532c1039fcc1dcc83392720bc196c314f6: Status 404 returned error can't find the container with id 40a40cd95fa24a56825a85e33a57d8532c1039fcc1dcc83392720bc196c314f6
Jul 29 01:10:37.191114 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:37.191083    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kznnj"]
Jul 29 01:10:37.193659 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:10:37.193636    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49593762_5cdf_4434_9f5d_e6b6a8019add.slice/crio-8601d6d243bd8deb02e9133066ffa01ee21ed4f036450c73b9be5f4d909fd8da WatchSource:0}: Error finding container 8601d6d243bd8deb02e9133066ffa01ee21ed4f036450c73b9be5f4d909fd8da: Status 404 returned error can't find the container with id 8601d6d243bd8deb02e9133066ffa01ee21ed4f036450c73b9be5f4d909fd8da
Jul 29 01:10:37.285185 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:37.285139    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zdjqz" event={"ID":"8ad2537f-978e-4a54-9587-4593723b5394","Type":"ContainerStarted","Data":"40a40cd95fa24a56825a85e33a57d8532c1039fcc1dcc83392720bc196c314f6"}
Jul 29 01:10:37.286529 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:37.286499    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kznnj" event={"ID":"49593762-5cdf-4434-9f5d-e6b6a8019add","Type":"ContainerStarted","Data":"8601d6d243bd8deb02e9133066ffa01ee21ed4f036450c73b9be5f4d909fd8da"}
Jul 29 01:10:37.780018 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:37.779976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:10:37.780531 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:37.780197    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:37.780531 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:10:37.780273    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls podName:e77ad1e5-bfb2-4c16-8895-0854b65959bb nodeName:}" failed. No retries permitted until 2026-07-29 01:11:09.780251975 +0000 UTC m=+99.280687421 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls") pod "dns-default-hk6hx" (UID: "e77ad1e5-bfb2-4c16-8895-0854b65959bb") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:43.304574 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:43.304534    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94" event={"ID":"e9555082-e796-40a0-bbeb-0dd67601301a","Type":"ContainerStarted","Data":"8aa5086b0e51a4d482f1a1364fcfcc8cd67c4ff45703016f4fb154a717a4bd13"}
Jul 29 01:10:43.306014 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:43.305986    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kznnj" event={"ID":"49593762-5cdf-4434-9f5d-e6b6a8019add","Type":"ContainerStarted","Data":"250e9f6db7cd62a974210f9ca27d7a8fa4be2802a1d51bf07dd51765b22567a1"}
Jul 29 01:10:43.306137 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:43.306043    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:10:43.307272 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:43.307249    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zdjqz" event={"ID":"8ad2537f-978e-4a54-9587-4593723b5394","Type":"ContainerStarted","Data":"272646a9b94f9ce03dbd961d9a59704eca2c3a7d951277201250f0670e257668"}
Jul 29 01:10:43.321845 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:43.321803    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94" podStartSLOduration=1.636766371 podStartE2EDuration="8.321790133s" totalImagesPullingTime="6.685023762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:43.321347195 +0000 UTC m=+72.821782648" watchObservedRunningTime="2026-07-29 01:10:43.321790133 +0000 UTC m=+72.822225584"
Jul 29 01:10:43.343057 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:43.343011    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kznnj" podStartSLOduration=67.033055 podStartE2EDuration="1m12.342998783s" totalImagesPullingTime="5.309943783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:43.34231651 +0000 UTC m=+72.842751962" watchObservedRunningTime="2026-07-29 01:10:43.342998783 +0000 UTC m=+72.843434236"
Jul 29 01:10:43.360078 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:43.360041    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zdjqz" podStartSLOduration=66.956158431 podStartE2EDuration="1m12.360028915s" totalImagesPullingTime="5.403870484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:43.359492102 +0000 UTC m=+72.859927568" watchObservedRunningTime="2026-07-29 01:10:43.360028915 +0000 UTC m=+72.860464359"
Jul 29 01:10:50.330643 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:50.330608    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd" event={"ID":"b8ad20be-d753-44bc-a770-bcfc1ce49ee1","Type":"ContainerStarted","Data":"c74c8f975378f45429ff87817c57584f1b24769f9eab27097711c117d7e382f8"}
Jul 29 01:10:50.331134 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:50.330650    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd" event={"ID":"b8ad20be-d753-44bc-a770-bcfc1ce49ee1","Type":"ContainerStarted","Data":"3cf7633539c616a566285103184715ba6351a829a8a38e1737b3c0f4c2afc5db"}
Jul 29 01:10:50.331134 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:50.330663    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd" event={"ID":"b8ad20be-d753-44bc-a770-bcfc1ce49ee1","Type":"ContainerStarted","Data":"0ffb2d365c2921c5cc71d8baf2bfa3e9384fb1e158de1c1808461a59c21e644d"}
Jul 29 01:10:50.352933 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:10:50.352887    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd" podStartSLOduration=1.268229599 podStartE2EDuration="15.352874572s" totalImagesPullingTime="14.084644973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:50.352110908 +0000 UTC m=+79.852546360" watchObservedRunningTime="2026-07-29 01:10:50.352874572 +0000 UTC m=+79.853310023"
Jul 29 01:11:09.257413 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:11:09.257381    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:11:09.794162 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:11:09.794109    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:11:09.794374 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:11:09.794283    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:11:09.794374 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:11:09.794358    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls podName:e77ad1e5-bfb2-4c16-8895-0854b65959bb nodeName:}" failed. No retries permitted until 2026-07-29 01:12:13.794342597 +0000 UTC m=+163.294778027 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls") pod "dns-default-hk6hx" (UID: "e77ad1e5-bfb2-4c16-8895-0854b65959bb") : secret "dns-default-metrics-tls" not found
Jul 29 01:11:14.315760 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:11:14.315727    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kznnj"
Jul 29 01:11:40.696774 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:11:40.696715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:11:40.697304 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:11:40.696876    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 01:11:40.697304 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:11:40.696950    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs podName:af0f0bbd-a686-4738-97d9-a6faeb834ac7 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:42.696933115 +0000 UTC m=+252.197368544 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs") pod "network-metrics-daemon-dtlcz" (UID: "af0f0bbd-a686-4738-97d9-a6faeb834ac7") : secret "metrics-daemon-secret" not found
Jul 29 01:12:08.909857 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:12:08.909812    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hk6hx" podUID="e77ad1e5-bfb2-4c16-8895-0854b65959bb"
Jul 29 01:12:09.552564 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:12:09.552536    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:12:10.049799 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:12:10.049762    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dtlcz" podUID="af0f0bbd-a686-4738-97d9-a6faeb834ac7"
Jul 29 01:12:13.826419 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:12:13.826378    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:12:13.826908 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:12:13.826492    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:12:13.826908 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:12:13.826544    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls podName:e77ad1e5-bfb2-4c16-8895-0854b65959bb nodeName:}" failed. No retries permitted until 2026-07-29 01:14:15.826530276 +0000 UTC m=+285.326965706 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls") pod "dns-default-hk6hx" (UID: "e77ad1e5-bfb2-4c16-8895-0854b65959bb") : secret "dns-default-metrics-tls" not found
Jul 29 01:12:21.033032 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:12:21.033001    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:12:42.647324 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:12:42.647293    2558 generic.go:356] "Generic (PLEG): container finished" podID="e9555082-e796-40a0-bbeb-0dd67601301a" containerID="8aa5086b0e51a4d482f1a1364fcfcc8cd67c4ff45703016f4fb154a717a4bd13" exitCode=255
Jul 29 01:12:42.647639 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:12:42.647361    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94" event={"ID":"e9555082-e796-40a0-bbeb-0dd67601301a","Type":"ContainerDied","Data":"8aa5086b0e51a4d482f1a1364fcfcc8cd67c4ff45703016f4fb154a717a4bd13"}
Jul 29 01:12:42.647639 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:12:42.647622    2558 scope.go:117] "RemoveContainer" containerID="8aa5086b0e51a4d482f1a1364fcfcc8cd67c4ff45703016f4fb154a717a4bd13"
Jul 29 01:12:43.652120 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:12:43.652088    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56b8cc48dd-42w94" event={"ID":"e9555082-e796-40a0-bbeb-0dd67601301a","Type":"ContainerStarted","Data":"bf54cc9c515a05da3403e24401e00485542b209fd0888475a13446c884847ef0"}
Jul 29 01:12:53.845674 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:12:53.845637    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:22.813189 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:22.813143    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:22.913838 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:22.913811    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:25.483360 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:25.483326    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:25.535867 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:25.535834    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:26.113062 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:26.113034    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:26.213934 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:26.213903    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:26.555872 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:26.555839    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:26.657164 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:26.657135    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:26.819600 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:26.819527    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:26.919060 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:26.919032    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:27.207971 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.207882    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-htc8v"]
Jul 29 01:13:27.210077 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.210040    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.212348 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.212329    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 01:13:27.213351 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.213333    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 01:13:27.213461 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.213435    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 01:13:27.213645 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.213620    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tbnhx\""
Jul 29 01:13:27.214353 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.214338    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 01:13:27.220979 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.220961    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-htc8v"]
Jul 29 01:13:27.244469 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.244420    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:27.295528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.295506    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:27.314459 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.314437    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54cad648-ce34-4e4f-bb80-6800cc746170-crio-socket\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.314532 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.314484    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.314532 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.314516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54cad648-ce34-4e4f-bb80-6800cc746170-data-volume\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.314602 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.314563    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vm72\" (UniqueName: \"kubernetes.io/projected/54cad648-ce34-4e4f-bb80-6800cc746170-kube-api-access-9vm72\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.314602 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.314588    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.415113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.415086    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54cad648-ce34-4e4f-bb80-6800cc746170-data-volume\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.415218 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.415122    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vm72\" (UniqueName: \"kubernetes.io/projected/54cad648-ce34-4e4f-bb80-6800cc746170-kube-api-access-9vm72\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.415218 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.415148    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.415218 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.415165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54cad648-ce34-4e4f-bb80-6800cc746170-crio-socket\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.415323 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.415229    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.415323 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:27.415251    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:27.415383 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:27.415325    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm podName:54cad648-ce34-4e4f-bb80-6800cc746170 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:27.915304065 +0000 UTC m=+237.415739495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm") pod "insights-runtime-extractor-htc8v" (UID: "54cad648-ce34-4e4f-bb80-6800cc746170") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:27.415383 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:27.415342    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:27.415451 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:27.415402    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls podName:54cad648-ce34-4e4f-bb80-6800cc746170 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:27.915386037 +0000 UTC m=+237.415821485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls") pod "insights-runtime-extractor-htc8v" (UID: "54cad648-ce34-4e4f-bb80-6800cc746170") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:27.415490 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.415448    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54cad648-ce34-4e4f-bb80-6800cc746170-crio-socket\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.415490 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.415475    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54cad648-ce34-4e4f-bb80-6800cc746170-data-volume\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.424336 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.424312    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vm72\" (UniqueName: \"kubernetes.io/projected/54cad648-ce34-4e4f-bb80-6800cc746170-kube-api-access-9vm72\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.537167 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.537137    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:27.641207 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.641159    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:27.739010 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.738979    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:27.919439 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.919341    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.919439 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:27.919412    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:27.919638 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:27.919486    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:27.919638 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:27.919498    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:27.919638 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:27.919546    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm podName:54cad648-ce34-4e4f-bb80-6800cc746170 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:28.919530633 +0000 UTC m=+238.419966064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm") pod "insights-runtime-extractor-htc8v" (UID: "54cad648-ce34-4e4f-bb80-6800cc746170") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:27.919638 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:27.919558    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls podName:54cad648-ce34-4e4f-bb80-6800cc746170 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:28.919552297 +0000 UTC m=+238.419987727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls") pod "insights-runtime-extractor-htc8v" (UID: "54cad648-ce34-4e4f-bb80-6800cc746170") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:28.455989 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:28.455955    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:28.508339 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:28.508306    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:28.925882 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:28.925851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:28.926303 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:28.925915    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:28.926303 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:28.925977    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:28.926303 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:28.926004    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:28.926303 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:28.926027    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm podName:54cad648-ce34-4e4f-bb80-6800cc746170 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:30.92601316 +0000 UTC m=+240.426448590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm") pod "insights-runtime-extractor-htc8v" (UID: "54cad648-ce34-4e4f-bb80-6800cc746170") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:28.926303 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:28.926050    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls podName:54cad648-ce34-4e4f-bb80-6800cc746170 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:30.926038061 +0000 UTC m=+240.426473491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls") pod "insights-runtime-extractor-htc8v" (UID: "54cad648-ce34-4e4f-bb80-6800cc746170") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:29.396045 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:29.396017    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vv6bd_af226ec5-cdaf-45c6-9007-fadb4ee20017/dns-node-resolver/0.log"
Jul 29 01:13:29.398346 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:29.398313    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:30.396046 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:30.396019    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dhscn_5a38cca6-c57a-4656-a991-e6832a2e8648/node-ca/0.log"
Jul 29 01:13:30.796049 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:30.796025    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4g22q_3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8/serve-healthcheck-canary/0.log"
Jul 29 01:13:30.937805 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:30.937778    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:30.937956 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:30.937824    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:30.937956 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:30.937892    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:30.937956 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:30.937922    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:30.937956 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:30.937951    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm podName:54cad648-ce34-4e4f-bb80-6800cc746170 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:34.937935516 +0000 UTC m=+244.438370946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm") pod "insights-runtime-extractor-htc8v" (UID: "54cad648-ce34-4e4f-bb80-6800cc746170") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:30.938096 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:30.937964    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls podName:54cad648-ce34-4e4f-bb80-6800cc746170 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:34.937957645 +0000 UTC m=+244.438393075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls") pod "insights-runtime-extractor-htc8v" (UID: "54cad648-ce34-4e4f-bb80-6800cc746170") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:32.635390 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:32.635347    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:32.787454 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:32.787416    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:32.888036 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:32.887953    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:32.989202 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:32.989119    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:33.274158 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:33.274129    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:33.376234 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:33.376170    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:33.751362 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:33.751276    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:34.529264 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:34.529233    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:34.719416 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:34.719382    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:34.968553 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:34.968480    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:34.968553 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:34.968526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:34.968916 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:34.968596    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:34.968916 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:34.968641    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:34.968916 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:34.968666    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm podName:54cad648-ce34-4e4f-bb80-6800cc746170 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:42.968649692 +0000 UTC m=+252.469085122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm") pod "insights-runtime-extractor-htc8v" (UID: "54cad648-ce34-4e4f-bb80-6800cc746170") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:34.968916 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:34.968708    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls podName:54cad648-ce34-4e4f-bb80-6800cc746170 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:42.968695116 +0000 UTC m=+252.469130546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls") pod "insights-runtime-extractor-htc8v" (UID: "54cad648-ce34-4e4f-bb80-6800cc746170") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:35.121309 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:35.121270    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:35.254656 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:35.254572    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:35.740249 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:35.740213    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:36.116659 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:36.116626    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:36.319738 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:36.319701    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:36.514091 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:36.514063    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:36.629466 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:36.629437    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:36.918241 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:36.918142    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:37.320436 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:37.320405    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:37.716667 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:37.716581    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:38.116691 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:38.116660    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:38.320466 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:38.320431    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:38.917613 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:38.917572    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:39.182036 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:39.181948    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:39.518937 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:39.518902    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:39.729629 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:39.729565    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:39.831576 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:39.831496    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:40.118014 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:40.117938    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:40.316690 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:40.316657    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:40.713252 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:40.713221    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:41.519854 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:41.519816    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:41.719641 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:41.719606    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:42.124772 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:42.124740    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:42.325211 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:42.325157    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:42.720930 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:42.720900    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:13:42.723284 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:42.723257    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af0f0bbd-a686-4738-97d9-a6faeb834ac7-metrics-certs\") pod \"network-metrics-daemon-dtlcz\" (UID: \"af0f0bbd-a686-4738-97d9-a6faeb834ac7\") " pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:13:42.936551 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:42.936520    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p2784\""
Jul 29 01:13:42.944522 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:42.944499    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtlcz"
Jul 29 01:13:42.961844 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:42.961819    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:43.023605 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:43.023573    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:43.023745 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:43.023630    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:43.024164 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:43.024145    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54cad648-ce34-4e4f-bb80-6800cc746170-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:43.025726 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:43.025702    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54cad648-ce34-4e4f-bb80-6800cc746170-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-htc8v\" (UID: \"54cad648-ce34-4e4f-bb80-6800cc746170\") " pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:43.062458 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:43.062432    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dtlcz"]
Jul 29 01:13:43.065465 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:13:43.065441    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0f0bbd_a686_4738_97d9_a6faeb834ac7.slice/crio-157f03dcff5d134409e0d578d179870b699dc9fa2719080e3b9ac3f5d2eda0a9 WatchSource:0}: Error finding container 157f03dcff5d134409e0d578d179870b699dc9fa2719080e3b9ac3f5d2eda0a9: Status 404 returned error can't find the container with id 157f03dcff5d134409e0d578d179870b699dc9fa2719080e3b9ac3f5d2eda0a9
Jul 29 01:13:43.121236 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:43.121208    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tbnhx\""
Jul 29 01:13:43.123299 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:43.123277    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:43.129522 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:43.129505    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-htc8v"
Jul 29 01:13:43.248213 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:43.248111    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-htc8v"]
Jul 29 01:13:43.251581 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:13:43.251560    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54cad648_ce34_4e4f_bb80_6800cc746170.slice/crio-e98567676a1a9a79a1102b4005ad4d02725f905c4270c173e6192912a87397b2 WatchSource:0}: Error finding container e98567676a1a9a79a1102b4005ad4d02725f905c4270c173e6192912a87397b2: Status 404 returned error can't find the container with id e98567676a1a9a79a1102b4005ad4d02725f905c4270c173e6192912a87397b2
Jul 29 01:13:43.326728 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:43.326703    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:43.824191 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:43.824094    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-htc8v" event={"ID":"54cad648-ce34-4e4f-bb80-6800cc746170","Type":"ContainerStarted","Data":"e98567676a1a9a79a1102b4005ad4d02725f905c4270c173e6192912a87397b2"}
Jul 29 01:13:43.826022 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:43.825994    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtlcz" event={"ID":"af0f0bbd-a686-4738-97d9-a6faeb834ac7","Type":"ContainerStarted","Data":"157f03dcff5d134409e0d578d179870b699dc9fa2719080e3b9ac3f5d2eda0a9"}
Jul 29 01:13:44.830969 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:44.830929    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtlcz" event={"ID":"af0f0bbd-a686-4738-97d9-a6faeb834ac7","Type":"ContainerStarted","Data":"93e51ad539861fa70fe843e94f855a7729f28869e1c677c7a9f23d00cbdfa3a5"}
Jul 29 01:13:44.831399 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:44.831036    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtlcz" event={"ID":"af0f0bbd-a686-4738-97d9-a6faeb834ac7","Type":"ContainerStarted","Data":"6a80e83e0a9d583a1a883753dc1e4362f2966618dead92ae9860fd44a782de71"}
Jul 29 01:13:44.850039 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:44.848105    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dtlcz" podStartSLOduration=252.871563897 podStartE2EDuration="4m13.848055056s" totalImagesPullingTime="976.491159ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:44.847693223 +0000 UTC m=+254.348128676" watchObservedRunningTime="2026-07-29 01:13:44.848055056 +0000 UTC m=+254.348490508"
Jul 29 01:13:44.896134 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:44.896100    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:44.953835 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:44.953797    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:48.848188 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:48.848127    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-htc8v" event={"ID":"54cad648-ce34-4e4f-bb80-6800cc746170","Type":"ContainerStarted","Data":"053f54fbc70ebd794a5e5fae3cc8371b0f604e376574067a0eb2761554f64068"}
Jul 29 01:13:50.150776 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:50.150738    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:50.251257 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:50.251225    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:50.326653 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:50.326617    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:50.456193 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:50.456097    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:50.830542 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:50.830508    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:50.931662 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:50.931627    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:51.452940 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:51.452912    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:51.554806 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:51.554772    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:51.655412 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:51.655383    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:51.755733 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:51.755652    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:51.858406 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:51.858373    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-htc8v" event={"ID":"54cad648-ce34-4e4f-bb80-6800cc746170","Type":"ContainerStarted","Data":"de47526ade172b61812a5c8eadb95eab0592886bdcb8e23f17b36a1ae3598e4a"}
Jul 29 01:13:52.042391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:52.042345    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:52.187078 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:52.187037    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:52.270771 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:52.270640    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:52.425380 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:52.425300    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:52.522680 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:52.522601    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:52.623037 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:52.622990    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:53.668011 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:53.667968    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:53.725547 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:53.725513    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:55.872723 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:55.872691    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-htc8v" event={"ID":"54cad648-ce34-4e4f-bb80-6800cc746170","Type":"ContainerStarted","Data":"1ce8aeaa1c4a4c78ea27b4ff12f72d98244edc566bb80a4d730f9a3a071c9feb"}
Jul 29 01:13:55.892237 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:55.892191    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-htc8v" podStartSLOduration=17.338674962 podStartE2EDuration="28.89216022s" totalImagesPullingTime="11.553485258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:13:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:55.890626503 +0000 UTC m=+265.391061954" watchObservedRunningTime="2026-07-29 01:13:55.89216022 +0000 UTC m=+265.392595673"
Jul 29 01:13:57.377133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.377095    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:57.442477 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.442447    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:57.545953 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.545916    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:57.551622 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.551597    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6"]
Jul 29 01:13:57.554618 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.554600    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6"
Jul 29 01:13:57.557125 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.557107    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 29 01:13:57.557233 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.557217    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7wgjp\""
Jul 29 01:13:57.563270 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.563246    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6"]
Jul 29 01:13:57.636443 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.636383    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5f926c84-30af-42c7-b590-412c93b8f488-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-6ftl6\" (UID: \"5f926c84-30af-42c7-b590-412c93b8f488\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6"
Jul 29 01:13:57.737716 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.737686    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5f926c84-30af-42c7-b590-412c93b8f488-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-6ftl6\" (UID: \"5f926c84-30af-42c7-b590-412c93b8f488\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6"
Jul 29 01:13:57.737849 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:57.737833    2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 01:13:57.737915 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:57.737905    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f926c84-30af-42c7-b590-412c93b8f488-tls-certificates podName:5f926c84-30af-42c7-b590-412c93b8f488 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:58.23788871 +0000 UTC m=+267.738324140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/5f926c84-30af-42c7-b590-412c93b8f488-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-6ftl6" (UID: "5f926c84-30af-42c7-b590-412c93b8f488") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 01:13:57.865803 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.865768    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fb4695bf6-4k2d5"]
Jul 29 01:13:57.868861 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.868846    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:57.871334 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.871308    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 01:13:57.871588 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.871573    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 01:13:57.871696 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.871680    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 01:13:57.871767 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.871688    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 01:13:57.871767 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.871700    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 01:13:57.871767 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.871731    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9xgr5\""
Jul 29 01:13:57.871919 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.871776    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 01:13:57.871919 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.871781    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 01:13:57.879864 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:57.879841    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fb4695bf6-4k2d5"]
Jul 29 01:13:58.039413 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.039385    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-oauth-serving-cert\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.039618 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.039426    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-serving-cert\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.039618 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.039461    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-oauth-config\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.039618 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.039508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9tsh\" (UniqueName: \"kubernetes.io/projected/c545910b-2bb5-4c0e-b598-3edf37fc9204-kube-api-access-p9tsh\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.039618 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.039562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-service-ca\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.039618 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.039608    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-config\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.140462 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.140432    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-oauth-config\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.140462 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.140463    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9tsh\" (UniqueName: \"kubernetes.io/projected/c545910b-2bb5-4c0e-b598-3edf37fc9204-kube-api-access-p9tsh\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.140666 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.140490    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-service-ca\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.140666 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.140616    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-config\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.140770 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.140670    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-oauth-serving-cert\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.140770 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.140715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-serving-cert\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.141349 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.141323    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-config\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.141473 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.141357    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-service-ca\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.141473 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.141335    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-oauth-serving-cert\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.142811 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.142781    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-oauth-config\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.142989 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.142971    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-serving-cert\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.149575 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.149551    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9tsh\" (UniqueName: \"kubernetes.io/projected/c545910b-2bb5-4c0e-b598-3edf37fc9204-kube-api-access-p9tsh\") pod \"console-5fb4695bf6-4k2d5\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") " pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.178473 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.178451    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:13:58.241691 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.241663    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5f926c84-30af-42c7-b590-412c93b8f488-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-6ftl6\" (UID: \"5f926c84-30af-42c7-b590-412c93b8f488\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6"
Jul 29 01:13:58.241807 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:58.241787    2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 01:13:58.241846 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:13:58.241842    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f926c84-30af-42c7-b590-412c93b8f488-tls-certificates podName:5f926c84-30af-42c7-b590-412c93b8f488 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:59.241827186 +0000 UTC m=+268.742262619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/5f926c84-30af-42c7-b590-412c93b8f488-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-6ftl6" (UID: "5f926c84-30af-42c7-b590-412c93b8f488") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 01:13:58.296663 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.296597    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fb4695bf6-4k2d5"]
Jul 29 01:13:58.302000 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:13:58.301971    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc545910b_2bb5_4c0e_b598_3edf37fc9204.slice/crio-d7c232768a28c4d968451a2b60c8e2db16fa2d3b027b773e18e9f2096af372d0 WatchSource:0}: Error finding container d7c232768a28c4d968451a2b60c8e2db16fa2d3b027b773e18e9f2096af372d0: Status 404 returned error can't find the container with id d7c232768a28c4d968451a2b60c8e2db16fa2d3b027b773e18e9f2096af372d0
Jul 29 01:13:58.338043 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.338013    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:13:58.884184 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:58.884136    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb4695bf6-4k2d5" event={"ID":"c545910b-2bb5-4c0e-b598-3edf37fc9204","Type":"ContainerStarted","Data":"d7c232768a28c4d968451a2b60c8e2db16fa2d3b027b773e18e9f2096af372d0"}
Jul 29 01:13:59.248728 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:59.248643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5f926c84-30af-42c7-b590-412c93b8f488-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-6ftl6\" (UID: \"5f926c84-30af-42c7-b590-412c93b8f488\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6"
Jul 29 01:13:59.251520 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:59.251471    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5f926c84-30af-42c7-b590-412c93b8f488-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-6ftl6\" (UID: \"5f926c84-30af-42c7-b590-412c93b8f488\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6"
Jul 29 01:13:59.363023 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:59.362841    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6"
Jul 29 01:13:59.510150 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:59.510120    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6"]
Jul 29 01:13:59.513046 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:13:59.513018    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f926c84_30af_42c7_b590_412c93b8f488.slice/crio-e5b527690c50ba84cff5b114e003cbbe783a1d9509d7923847fa9f049f4750f8 WatchSource:0}: Error finding container e5b527690c50ba84cff5b114e003cbbe783a1d9509d7923847fa9f049f4750f8: Status 404 returned error can't find the container with id e5b527690c50ba84cff5b114e003cbbe783a1d9509d7923847fa9f049f4750f8
Jul 29 01:13:59.889455 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:13:59.889371    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6" event={"ID":"5f926c84-30af-42c7-b590-412c93b8f488","Type":"ContainerStarted","Data":"e5b527690c50ba84cff5b114e003cbbe783a1d9509d7923847fa9f049f4750f8"}
Jul 29 01:14:01.898115 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:01.898074    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6" event={"ID":"5f926c84-30af-42c7-b590-412c93b8f488","Type":"ContainerStarted","Data":"1a9b5de6c2edc68f7bce8a5eda0f7e0ced778bcb5eb6416110132303704abe4f"}
Jul 29 01:14:01.898585 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:01.898214    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6"
Jul 29 01:14:01.899683 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:01.899655    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb4695bf6-4k2d5" event={"ID":"c545910b-2bb5-4c0e-b598-3edf37fc9204","Type":"ContainerStarted","Data":"01ad95ee4b666920de87d78a7efa2cc2bad6d79365898f2c76fbb38dc3c18d85"}
Jul 29 01:14:01.902870 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:01.902847    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6"
Jul 29 01:14:01.914547 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:01.914503    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6ftl6" podStartSLOduration=3.100416239 podStartE2EDuration="4.914492987s" totalImagesPullingTime="1.814076748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:01.913361538 +0000 UTC m=+271.413796990" watchObservedRunningTime="2026-07-29 01:14:01.914492987 +0000 UTC m=+271.414928438"
Jul 29 01:14:01.946212 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:01.946159    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fb4695bf6-4k2d5" podStartSLOduration=1.9151085650000002 podStartE2EDuration="4.946145539s" totalImagesPullingTime="3.031036974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:01.945606906 +0000 UTC m=+271.446042355" watchObservedRunningTime="2026-07-29 01:14:01.946145539 +0000 UTC m=+271.446580990"
Jul 29 01:14:02.574450 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:02.574413    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:02.676303 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:02.676273    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:02.738108 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:02.738079    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:06.057621 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:06.057586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:08.178901 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:08.178875    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:14:08.179330 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:08.179103    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:14:08.180253 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:08.180230    2558 patch_prober.go:28] interesting pod/console-5fb4695bf6-4k2d5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body=
Jul 29 01:14:08.180357 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:08.180276    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5fb4695bf6-4k2d5" podUID="c545910b-2bb5-4c0e-b598-3edf37fc9204" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused"
Jul 29 01:14:09.263325 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:09.263290    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:10.712541 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:10.712507    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:10.813017 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:10.812975    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:12.161723 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:12.161683    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:12.553548 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:14:12.553516    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hk6hx" podUID="e77ad1e5-bfb2-4c16-8895-0854b65959bb"
Jul 29 01:14:12.934826 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:12.934748    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:14:14.699157 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:14.699112    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:14.887280 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:14.887238    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:14.979376 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:14.979289    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lh58k"]
Jul 29 01:14:14.979805 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:14.979771    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:14.985392 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:14.985374    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:14.988687 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:14.988664    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 01:14:14.988799 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:14.988755    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 01:14:14.988799 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:14.988772    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-56rrk\""
Jul 29 01:14:14.989071 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:14.989054    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 01:14:14.989150 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:14.989132    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 01:14:14.989795 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:14.989780    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 01:14:14.989848 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:14.989793    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 01:14:15.072668 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.072636    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:15.161460 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.161433    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6df3c19-9050-493c-b294-cddae06f7dec-sys\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.161460 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.161461    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdfkq\" (UniqueName: \"kubernetes.io/projected/a6df3c19-9050-493c-b294-cddae06f7dec-kube-api-access-rdfkq\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.161654 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.161484    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.161654 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.161500    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-tls\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.161654 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.161602    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-accelerators-collector-config\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.161803 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.161688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-wtmp\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.161803 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.161718    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6df3c19-9050-493c-b294-cddae06f7dec-metrics-client-ca\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.161803 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.161792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-textfile\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.161908 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.161815    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a6df3c19-9050-493c-b294-cddae06f7dec-root\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.174484 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.174451    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:15.262532 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.262507    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-accelerators-collector-config\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.262653 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.262569    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-wtmp\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.262653 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.262598    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6df3c19-9050-493c-b294-cddae06f7dec-metrics-client-ca\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.262653 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.262634    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-textfile\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.262856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.262657    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a6df3c19-9050-493c-b294-cddae06f7dec-root\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.262856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.262686    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6df3c19-9050-493c-b294-cddae06f7dec-sys\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.262856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.262704    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-wtmp\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.262856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.262737    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a6df3c19-9050-493c-b294-cddae06f7dec-root\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.262856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.262747    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6df3c19-9050-493c-b294-cddae06f7dec-sys\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.262856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.262774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdfkq\" (UniqueName: \"kubernetes.io/projected/a6df3c19-9050-493c-b294-cddae06f7dec-kube-api-access-rdfkq\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.262856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.262808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.262856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.262826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-tls\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.263228 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:14:15.262912    2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 01:14:15.263228 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:14:15.262973    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-tls podName:a6df3c19-9050-493c-b294-cddae06f7dec nodeName:}" failed. No retries permitted until 2026-07-29 01:14:15.762957288 +0000 UTC m=+285.263392719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-tls") pod "node-exporter-lh58k" (UID: "a6df3c19-9050-493c-b294-cddae06f7dec") : secret "node-exporter-tls" not found
Jul 29 01:14:15.263228 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.262976    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-textfile\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.263228 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.263146    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-accelerators-collector-config\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.263228 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.263151    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6df3c19-9050-493c-b294-cddae06f7dec-metrics-client-ca\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.265088 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.265071    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.272203 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.272164    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdfkq\" (UniqueName: \"kubernetes.io/projected/a6df3c19-9050-493c-b294-cddae06f7dec-kube-api-access-rdfkq\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.273363 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.273337    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:15.372773 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.372743    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:15.473565 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.473534    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:15.766755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.766728    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-tls\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.768882 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.768859    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a6df3c19-9050-493c-b294-cddae06f7dec-node-exporter-tls\") pod \"node-exporter-lh58k\" (UID: \"a6df3c19-9050-493c-b294-cddae06f7dec\") " pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.867447 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.867415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:14:15.869558 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.869539    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e77ad1e5-bfb2-4c16-8895-0854b65959bb-metrics-tls\") pod \"dns-default-hk6hx\" (UID: \"e77ad1e5-bfb2-4c16-8895-0854b65959bb\") " pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:14:15.894852 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.894820    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lh58k"
Jul 29 01:14:15.906619 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:14:15.906590    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6df3c19_9050_493c_b294_cddae06f7dec.slice/crio-2fd5178d7fed5055961b727f35f34c1cd55b2f2e997760f53752860018374111 WatchSource:0}: Error finding container 2fd5178d7fed5055961b727f35f34c1cd55b2f2e997760f53752860018374111: Status 404 returned error can't find the container with id 2fd5178d7fed5055961b727f35f34c1cd55b2f2e997760f53752860018374111
Jul 29 01:14:15.914443 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.914414    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:15.937419 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.937402    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zd58l\""
Jul 29 01:14:15.944812 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.944787    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lh58k" event={"ID":"a6df3c19-9050-493c-b294-cddae06f7dec","Type":"ContainerStarted","Data":"2fd5178d7fed5055961b727f35f34c1cd55b2f2e997760f53752860018374111"}
Jul 29 01:14:15.945902 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:15.945889    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:14:16.014799 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:16.014768    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:16.070940 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:16.070911    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hk6hx"]
Jul 29 01:14:16.073721 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:14:16.073693    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode77ad1e5_bfb2_4c16_8895_0854b65959bb.slice/crio-cecb9d902679577884700b812f5bc0b59ae1ad5f500e0108e5503bfc5870b097 WatchSource:0}: Error finding container cecb9d902679577884700b812f5bc0b59ae1ad5f500e0108e5503bfc5870b097: Status 404 returned error can't find the container with id cecb9d902679577884700b812f5bc0b59ae1ad5f500e0108e5503bfc5870b097
Jul 29 01:14:16.130236 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:16.130205    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:16.537606 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:16.537569    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:16.870517 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:16.870424    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:16.950244 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:16.950154    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hk6hx" event={"ID":"e77ad1e5-bfb2-4c16-8895-0854b65959bb","Type":"ContainerStarted","Data":"cecb9d902679577884700b812f5bc0b59ae1ad5f500e0108e5503bfc5870b097"}
Jul 29 01:14:17.866981 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:17.866896    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:17.933870 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:17.933841    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:17.954419 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:17.954395    2558 generic.go:356] "Generic (PLEG): container finished" podID="a6df3c19-9050-493c-b294-cddae06f7dec" containerID="70f6b15fce6d1d50c433cdbbacc97471b661e75bb09bda17d15d8b118e01e50e" exitCode=0
Jul 29 01:14:17.954573 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:17.954478    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lh58k" event={"ID":"a6df3c19-9050-493c-b294-cddae06f7dec","Type":"ContainerDied","Data":"70f6b15fce6d1d50c433cdbbacc97471b661e75bb09bda17d15d8b118e01e50e"}
Jul 29 01:14:17.956298 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:17.956278    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hk6hx" event={"ID":"e77ad1e5-bfb2-4c16-8895-0854b65959bb","Type":"ContainerStarted","Data":"c1a3d8deed60d587c7d64f87cc1ef77691e171efa2a68d2f83a2ef587391d2cc"}
Jul 29 01:14:17.956389 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:17.956319    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hk6hx" event={"ID":"e77ad1e5-bfb2-4c16-8895-0854b65959bb","Type":"ContainerStarted","Data":"08508fc2a09a1d584b8e2d7f48684bdcbf509d1ad1fb937400ed2a0f9212ba4d"}
Jul 29 01:14:17.956433 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:17.956387    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:14:17.990049 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:17.990009    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hk6hx" podStartSLOduration=251.50127666 podStartE2EDuration="4m12.989991405s" totalImagesPullingTime="1.488714745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:17.989666892 +0000 UTC m=+287.490102345" watchObservedRunningTime="2026-07-29 01:14:17.989991405 +0000 UTC m=+287.490426857"
Jul 29 01:14:18.179940 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:18.179866    2558 patch_prober.go:28] interesting pod/console-5fb4695bf6-4k2d5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body=
Jul 29 01:14:18.179940 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:18.179914    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5fb4695bf6-4k2d5" podUID="c545910b-2bb5-4c0e-b598-3edf37fc9204" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused"
Jul 29 01:14:18.624740 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:18.624711    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:18.961225 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:18.961141    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lh58k" event={"ID":"a6df3c19-9050-493c-b294-cddae06f7dec","Type":"ContainerStarted","Data":"d17356830a7858e41a87292d1850eac332bd686ad053c499387423127cdc3d8d"}
Jul 29 01:14:18.961645 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:18.961254    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lh58k" event={"ID":"a6df3c19-9050-493c-b294-cddae06f7dec","Type":"ContainerStarted","Data":"51d7ab8b0ae5b999c25f001cfa8fb3855432b7e90d69f7411e49d4a0911b7510"}
Jul 29 01:14:18.980410 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:18.980363    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lh58k" podStartSLOduration=3.930464354 podStartE2EDuration="4.980348035s" totalImagesPullingTime="974.533973ms" totalInitContainerRuntime="75.349708ms" isStatefulPod=true podCreationTimestamp="2026-07-29 01:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:18.979575185 +0000 UTC m=+288.480010651" watchObservedRunningTime="2026-07-29 01:14:18.980348035 +0000 UTC m=+288.480783486"
Jul 29 01:14:19.717554 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.717509    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:19.754287 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.754259    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-797fd"]
Jul 29 01:14:19.831858 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.831827    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-797fd"]
Jul 29 01:14:19.831858 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.831869    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fb4695bf6-4k2d5"]
Jul 29 01:14:19.832047 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.831895    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cfcb4ff49-mjfn2"]
Jul 29 01:14:19.832047 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.831943    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-797fd"
Jul 29 01:14:19.834398 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.834378    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 29 01:14:19.835096 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.835079    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-458n6\""
Jul 29 01:14:19.847988 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.847956    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:19.857664 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.857645    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cfcb4ff49-mjfn2"]
Jul 29 01:14:19.857755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.857725    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.865266 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.865248    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 01:14:19.896026 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.896008    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-trusted-ca-bundle\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.896122 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.896036    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-service-ca\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.896122 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.896059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf99a633-c088-4fbe-8834-a3df3f34abf9-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-797fd\" (UID: \"bf99a633-c088-4fbe-8834-a3df3f34abf9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-797fd"
Jul 29 01:14:19.896122 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.896076    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-config\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.896247 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.896139    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-oauth-serving-cert\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.896247 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.896192    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-oauth-config\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.896247 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.896230    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-serving-cert\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.896336 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.896256    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn89p\" (UniqueName: \"kubernetes.io/projected/bf99a633-c088-4fbe-8834-a3df3f34abf9-kube-api-access-vn89p\") pod \"monitoring-plugin-68b7fc9574-797fd\" (UID: \"bf99a633-c088-4fbe-8834-a3df3f34abf9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-797fd"
Jul 29 01:14:19.896336 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.896272    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrxwb\" (UniqueName: \"kubernetes.io/projected/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-kube-api-access-lrxwb\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.997212 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.997155    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-oauth-config\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.997565 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.997216    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-serving-cert\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.997565 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.997278    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn89p\" (UniqueName: \"kubernetes.io/projected/bf99a633-c088-4fbe-8834-a3df3f34abf9-kube-api-access-vn89p\") pod \"monitoring-plugin-68b7fc9574-797fd\" (UID: \"bf99a633-c088-4fbe-8834-a3df3f34abf9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-797fd"
Jul 29 01:14:19.997565 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.997303    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrxwb\" (UniqueName: \"kubernetes.io/projected/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-kube-api-access-lrxwb\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.997751 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.997572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-trusted-ca-bundle\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.997751 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.997621    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-service-ca\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.997751 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.997688    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf99a633-c088-4fbe-8834-a3df3f34abf9-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-797fd\" (UID: \"bf99a633-c088-4fbe-8834-a3df3f34abf9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-797fd"
Jul 29 01:14:19.997751 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.997716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-config\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.997946 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.997760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-oauth-serving-cert\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.997946 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:14:19.997788    2558 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 29 01:14:19.997946 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:14:19.997870    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf99a633-c088-4fbe-8834-a3df3f34abf9-monitoring-plugin-cert podName:bf99a633-c088-4fbe-8834-a3df3f34abf9 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:20.497851014 +0000 UTC m=+289.998286457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/bf99a633-c088-4fbe-8834-a3df3f34abf9-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-797fd" (UID: "bf99a633-c088-4fbe-8834-a3df3f34abf9") : secret "monitoring-plugin-cert" not found
Jul 29 01:14:19.998341 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.998320    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-service-ca\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.998465 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.998442    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-oauth-serving-cert\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.998521 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.998501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-config\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.998825 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.998806    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-trusted-ca-bundle\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.999853 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.999830    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-serving-cert\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:19.999995 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:19.999978    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-oauth-config\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:20.006140 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.006117    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrxwb\" (UniqueName: \"kubernetes.io/projected/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-kube-api-access-lrxwb\") pod \"console-7cfcb4ff49-mjfn2\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") " pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:20.006416 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.006395    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn89p\" (UniqueName: \"kubernetes.io/projected/bf99a633-c088-4fbe-8834-a3df3f34abf9-kube-api-access-vn89p\") pod \"monitoring-plugin-68b7fc9574-797fd\" (UID: \"bf99a633-c088-4fbe-8834-a3df3f34abf9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-797fd"
Jul 29 01:14:20.121447 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.121418    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:20.166394 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.166370    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:20.185644 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.185620    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:20.264709 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.264676    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:20.331524 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.331492    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cfcb4ff49-mjfn2"]
Jul 29 01:14:20.335118 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:14:20.335093    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba2d66c0_1221_4062_bc21_4de7ccb6bfc5.slice/crio-e417a14c9427b87c5968a3a37425a44ef08eefe1b937583cb4e2dfc3b1ba929c WatchSource:0}: Error finding container e417a14c9427b87c5968a3a37425a44ef08eefe1b937583cb4e2dfc3b1ba929c: Status 404 returned error can't find the container with id e417a14c9427b87c5968a3a37425a44ef08eefe1b937583cb4e2dfc3b1ba929c
Jul 29 01:14:20.501312 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.501284    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf99a633-c088-4fbe-8834-a3df3f34abf9-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-797fd\" (UID: \"bf99a633-c088-4fbe-8834-a3df3f34abf9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-797fd"
Jul 29 01:14:20.503514 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.503493    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf99a633-c088-4fbe-8834-a3df3f34abf9-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-797fd\" (UID: \"bf99a633-c088-4fbe-8834-a3df3f34abf9\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-797fd"
Jul 29 01:14:20.741385 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.741354    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-797fd"
Jul 29 01:14:20.898456 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.898368    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-797fd"]
Jul 29 01:14:20.901647 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:14:20.901619    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf99a633_c088_4fbe_8834_a3df3f34abf9.slice/crio-7b906f8e38460a0fcd45310d8badc371209e8cb57a31f81b805432a219187ef5 WatchSource:0}: Error finding container 7b906f8e38460a0fcd45310d8badc371209e8cb57a31f81b805432a219187ef5: Status 404 returned error can't find the container with id 7b906f8e38460a0fcd45310d8badc371209e8cb57a31f81b805432a219187ef5
Jul 29 01:14:20.968992 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.968958    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-797fd" event={"ID":"bf99a633-c088-4fbe-8834-a3df3f34abf9","Type":"ContainerStarted","Data":"7b906f8e38460a0fcd45310d8badc371209e8cb57a31f81b805432a219187ef5"}
Jul 29 01:14:20.970395 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.970372    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfcb4ff49-mjfn2" event={"ID":"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5","Type":"ContainerStarted","Data":"d0b280efdea0def2ba478b353e72fca70f4e7c5ad53bf6e68ce71a1d86883693"}
Jul 29 01:14:20.970508 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.970409    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfcb4ff49-mjfn2" event={"ID":"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5","Type":"ContainerStarted","Data":"e417a14c9427b87c5968a3a37425a44ef08eefe1b937583cb4e2dfc3b1ba929c"}
Jul 29 01:14:20.988945 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:20.988794    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cfcb4ff49-mjfn2" podStartSLOduration=1.988779863 podStartE2EDuration="1.988779863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:20.988599211 +0000 UTC m=+290.489034662" watchObservedRunningTime="2026-07-29 01:14:20.988779863 +0000 UTC m=+290.489215315"
Jul 29 01:14:21.146829 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:21.146796    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:22.978750 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:22.978715    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-797fd" event={"ID":"bf99a633-c088-4fbe-8834-a3df3f34abf9","Type":"ContainerStarted","Data":"993c097265766175ffc5e9b1a853c6a20f31fd57578ff37a029bdf0c70a7235d"}
Jul 29 01:14:22.979191 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:22.978920    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-797fd"
Jul 29 01:14:22.984234 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:22.984212    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-797fd"
Jul 29 01:14:22.994530 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:22.994493    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-797fd" podStartSLOduration=2.423946022 podStartE2EDuration="3.994479968s" totalImagesPullingTime="1.570533946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:22.992597531 +0000 UTC m=+292.493032994" watchObservedRunningTime="2026-07-29 01:14:22.994479968 +0000 UTC m=+292.494915419"
Jul 29 01:14:25.551694 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:25.551634    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:25.611327 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:25.611294    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:25.683736 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:25.683706    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:25.740044 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:25.740018    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:26.402839 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:26.402809    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cfcb4ff49-mjfn2"]
Jul 29 01:14:26.494008 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:26.493947    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:26.562492 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:26.562461    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:26.803333 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:26.803299    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:27.110587 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:27.110508    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:27.165650 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:27.165621    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:27.398144 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:27.398060    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:27.453111 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:27.453080    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:27.963730 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:27.963699    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hk6hx"
Jul 29 01:14:29.375843 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:29.375789    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:29.432103 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:29.432076    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:30.166615 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:30.166589    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:30.474420 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:30.474333    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:30.531441 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:30.531415    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:30.907616 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:30.907590    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 01:14:31.820685 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:31.820639    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:31.890701 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:31.890661    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:37.979441 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:37.979406    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:38.075302 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:38.075264    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:40.787994 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:40.787959    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:40.888192 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:40.888142    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:43.591488 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:43.591446    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:43.690852 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:43.690822    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:44.852362 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:44.852326    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5fb4695bf6-4k2d5" podUID="c545910b-2bb5-4c0e-b598-3edf37fc9204" containerName="console" containerID="cri-o://01ad95ee4b666920de87d78a7efa2cc2bad6d79365898f2c76fbb38dc3c18d85" gracePeriod=15
Jul 29 01:14:44.913396 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:44.913367    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:45.014459 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.014428    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:45.048428 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.048395    2558 generic.go:356] "Generic (PLEG): container finished" podID="c545910b-2bb5-4c0e-b598-3edf37fc9204" containerID="01ad95ee4b666920de87d78a7efa2cc2bad6d79365898f2c76fbb38dc3c18d85" exitCode=0
Jul 29 01:14:45.048556 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.048473    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb4695bf6-4k2d5" event={"ID":"c545910b-2bb5-4c0e-b598-3edf37fc9204","Type":"ContainerDied","Data":"01ad95ee4b666920de87d78a7efa2cc2bad6d79365898f2c76fbb38dc3c18d85"}
Jul 29 01:14:45.089307 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.089285    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:14:45.173204 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.173115    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-oauth-config\") pod \"c545910b-2bb5-4c0e-b598-3edf37fc9204\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") "
Jul 29 01:14:45.173204 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.173164    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-service-ca\") pod \"c545910b-2bb5-4c0e-b598-3edf37fc9204\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") "
Jul 29 01:14:45.173406 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.173233    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-oauth-serving-cert\") pod \"c545910b-2bb5-4c0e-b598-3edf37fc9204\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") "
Jul 29 01:14:45.173406 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.173250    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-config\") pod \"c545910b-2bb5-4c0e-b598-3edf37fc9204\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") "
Jul 29 01:14:45.173406 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.173280    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-serving-cert\") pod \"c545910b-2bb5-4c0e-b598-3edf37fc9204\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") "
Jul 29 01:14:45.173406 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.173306    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9tsh\" (UniqueName: \"kubernetes.io/projected/c545910b-2bb5-4c0e-b598-3edf37fc9204-kube-api-access-p9tsh\") pod \"c545910b-2bb5-4c0e-b598-3edf37fc9204\" (UID: \"c545910b-2bb5-4c0e-b598-3edf37fc9204\") "
Jul 29 01:14:45.173658 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.173632    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c545910b-2bb5-4c0e-b598-3edf37fc9204" (UID: "c545910b-2bb5-4c0e-b598-3edf37fc9204"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:14:45.173718 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.173649    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-config" (OuterVolumeSpecName: "console-config") pod "c545910b-2bb5-4c0e-b598-3edf37fc9204" (UID: "c545910b-2bb5-4c0e-b598-3edf37fc9204"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:14:45.173718 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.173640    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-service-ca" (OuterVolumeSpecName: "service-ca") pod "c545910b-2bb5-4c0e-b598-3edf37fc9204" (UID: "c545910b-2bb5-4c0e-b598-3edf37fc9204"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:14:45.175385 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.175361    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c545910b-2bb5-4c0e-b598-3edf37fc9204" (UID: "c545910b-2bb5-4c0e-b598-3edf37fc9204"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:14:45.175486 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.175376    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c545910b-2bb5-4c0e-b598-3edf37fc9204-kube-api-access-p9tsh" (OuterVolumeSpecName: "kube-api-access-p9tsh") pod "c545910b-2bb5-4c0e-b598-3edf37fc9204" (UID: "c545910b-2bb5-4c0e-b598-3edf37fc9204"). InnerVolumeSpecName "kube-api-access-p9tsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:14:45.175486 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.175473    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c545910b-2bb5-4c0e-b598-3edf37fc9204" (UID: "c545910b-2bb5-4c0e-b598-3edf37fc9204"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:14:45.273961 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.273923    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-oauth-serving-cert\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:14:45.273961 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.273957    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-config\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:14:45.273961 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.273967    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-serving-cert\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:14:45.274145 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.273975    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9tsh\" (UniqueName: \"kubernetes.io/projected/c545910b-2bb5-4c0e-b598-3edf37fc9204-kube-api-access-p9tsh\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:14:45.274145 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.273985    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c545910b-2bb5-4c0e-b598-3edf37fc9204-console-oauth-config\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:14:45.274145 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.273993    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c545910b-2bb5-4c0e-b598-3edf37fc9204-service-ca\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:14:45.698071 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:45.698037    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd" podUID="b8ad20be-d753-44bc-a770-bcfc1ce49ee1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 29 01:14:46.052599 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:46.052575    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb4695bf6-4k2d5"
Jul 29 01:14:46.052996 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:46.052566    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb4695bf6-4k2d5" event={"ID":"c545910b-2bb5-4c0e-b598-3edf37fc9204","Type":"ContainerDied","Data":"d7c232768a28c4d968451a2b60c8e2db16fa2d3b027b773e18e9f2096af372d0"}
Jul 29 01:14:46.052996 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:46.052708    2558 scope.go:117] "RemoveContainer" containerID="01ad95ee4b666920de87d78a7efa2cc2bad6d79365898f2c76fbb38dc3c18d85"
Jul 29 01:14:46.072525 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:46.072503    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fb4695bf6-4k2d5"]
Jul 29 01:14:46.076163 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:46.076144    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fb4695bf6-4k2d5"]
Jul 29 01:14:47.036651 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:47.036619    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c545910b-2bb5-4c0e-b598-3edf37fc9204" path="/var/lib/kubelet/pods/c545910b-2bb5-4c0e-b598-3edf37fc9204/volumes"
Jul 29 01:14:51.420926 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.420890    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cfcb4ff49-mjfn2" podUID="ba2d66c0-1221-4062-bc21-4de7ccb6bfc5" containerName="console" containerID="cri-o://d0b280efdea0def2ba478b353e72fca70f4e7c5ad53bf6e68ce71a1d86883693" gracePeriod=15
Jul 29 01:14:51.654664 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.654638    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:51.719277 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.719208    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-trusted-ca-bundle\") pod \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") "
Jul 29 01:14:51.719277 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.719258    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-oauth-serving-cert\") pod \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") "
Jul 29 01:14:51.719464 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.719295    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-service-ca\") pod \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") "
Jul 29 01:14:51.719464 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.719327    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-oauth-config\") pod \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") "
Jul 29 01:14:51.719464 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.719368    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-config\") pod \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") "
Jul 29 01:14:51.719464 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.719401    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-serving-cert\") pod \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") "
Jul 29 01:14:51.720058 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.719927    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ba2d66c0-1221-4062-bc21-4de7ccb6bfc5" (UID: "ba2d66c0-1221-4062-bc21-4de7ccb6bfc5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:14:51.720058 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.719953    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ba2d66c0-1221-4062-bc21-4de7ccb6bfc5" (UID: "ba2d66c0-1221-4062-bc21-4de7ccb6bfc5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:14:51.720243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.720059    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-service-ca" (OuterVolumeSpecName: "service-ca") pod "ba2d66c0-1221-4062-bc21-4de7ccb6bfc5" (UID: "ba2d66c0-1221-4062-bc21-4de7ccb6bfc5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:14:51.720243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.720111    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-config" (OuterVolumeSpecName: "console-config") pod "ba2d66c0-1221-4062-bc21-4de7ccb6bfc5" (UID: "ba2d66c0-1221-4062-bc21-4de7ccb6bfc5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:14:51.720243 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.719425    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrxwb\" (UniqueName: \"kubernetes.io/projected/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-kube-api-access-lrxwb\") pod \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\" (UID: \"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5\") "
Jul 29 01:14:51.721986 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.720498    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-config\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:14:51.721986 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.720530    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-trusted-ca-bundle\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:14:51.721986 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.720547    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-oauth-serving-cert\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:14:51.721986 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.720561    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-service-ca\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:14:51.722483 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.722453    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ba2d66c0-1221-4062-bc21-4de7ccb6bfc5" (UID: "ba2d66c0-1221-4062-bc21-4de7ccb6bfc5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:14:51.725586 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.725566    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ba2d66c0-1221-4062-bc21-4de7ccb6bfc5" (UID: "ba2d66c0-1221-4062-bc21-4de7ccb6bfc5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:14:51.725676 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.725581    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-kube-api-access-lrxwb" (OuterVolumeSpecName: "kube-api-access-lrxwb") pod "ba2d66c0-1221-4062-bc21-4de7ccb6bfc5" (UID: "ba2d66c0-1221-4062-bc21-4de7ccb6bfc5"). InnerVolumeSpecName "kube-api-access-lrxwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:14:51.821383 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.821351    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-oauth-config\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:14:51.821383 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.821375    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-console-serving-cert\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:14:51.821383 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:51.821384    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrxwb\" (UniqueName: \"kubernetes.io/projected/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5-kube-api-access-lrxwb\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:14:52.074871 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:52.074834    2558 generic.go:356] "Generic (PLEG): container finished" podID="ba2d66c0-1221-4062-bc21-4de7ccb6bfc5" containerID="d0b280efdea0def2ba478b353e72fca70f4e7c5ad53bf6e68ce71a1d86883693" exitCode=0
Jul 29 01:14:52.075033 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:52.074892    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfcb4ff49-mjfn2"
Jul 29 01:14:52.075033 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:52.074908    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfcb4ff49-mjfn2" event={"ID":"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5","Type":"ContainerDied","Data":"d0b280efdea0def2ba478b353e72fca70f4e7c5ad53bf6e68ce71a1d86883693"}
Jul 29 01:14:52.075033 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:52.074952    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfcb4ff49-mjfn2" event={"ID":"ba2d66c0-1221-4062-bc21-4de7ccb6bfc5","Type":"ContainerDied","Data":"e417a14c9427b87c5968a3a37425a44ef08eefe1b937583cb4e2dfc3b1ba929c"}
Jul 29 01:14:52.075033 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:52.074974    2558 scope.go:117] "RemoveContainer" containerID="d0b280efdea0def2ba478b353e72fca70f4e7c5ad53bf6e68ce71a1d86883693"
Jul 29 01:14:52.083911 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:52.083891    2558 scope.go:117] "RemoveContainer" containerID="d0b280efdea0def2ba478b353e72fca70f4e7c5ad53bf6e68ce71a1d86883693"
Jul 29 01:14:52.084193 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:14:52.084152    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0b280efdea0def2ba478b353e72fca70f4e7c5ad53bf6e68ce71a1d86883693\": container with ID starting with d0b280efdea0def2ba478b353e72fca70f4e7c5ad53bf6e68ce71a1d86883693 not found: ID does not exist" containerID="d0b280efdea0def2ba478b353e72fca70f4e7c5ad53bf6e68ce71a1d86883693"
Jul 29 01:14:52.084258 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:52.084211    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b280efdea0def2ba478b353e72fca70f4e7c5ad53bf6e68ce71a1d86883693"} err="failed to get container status \"d0b280efdea0def2ba478b353e72fca70f4e7c5ad53bf6e68ce71a1d86883693\": rpc error: code = NotFound desc = could not find container \"d0b280efdea0def2ba478b353e72fca70f4e7c5ad53bf6e68ce71a1d86883693\": container with ID starting with d0b280efdea0def2ba478b353e72fca70f4e7c5ad53bf6e68ce71a1d86883693 not found: ID does not exist"
Jul 29 01:14:52.095600 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:52.095577    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cfcb4ff49-mjfn2"]
Jul 29 01:14:52.099304 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:52.099284    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cfcb4ff49-mjfn2"]
Jul 29 01:14:52.678113 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:52.678083    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:52.785241 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:52.785200    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:53.036670 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:53.036643    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba2d66c0-1221-4062-bc21-4de7ccb6bfc5" path="/var/lib/kubelet/pods/ba2d66c0-1221-4062-bc21-4de7ccb6bfc5/volumes"
Jul 29 01:14:55.697485 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:55.697450    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd" podUID="b8ad20be-d753-44bc-a770-bcfc1ce49ee1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 29 01:14:58.643775 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:58.643747    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4g22q_3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8/serve-healthcheck-canary/0.log"
Jul 29 01:14:59.897490 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:59.897457    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:14:59.952674 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:14:59.952642    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:05.698004 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:05.697962    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd" podUID="b8ad20be-d753-44bc-a770-bcfc1ce49ee1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 29 01:15:05.698442 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:05.698026    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd"
Jul 29 01:15:05.698489 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:05.698474    2558 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c74c8f975378f45429ff87817c57584f1b24769f9eab27097711c117d7e382f8"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 29 01:15:05.698524 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:05.698509    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd" podUID="b8ad20be-d753-44bc-a770-bcfc1ce49ee1" containerName="service-proxy" containerID="cri-o://c74c8f975378f45429ff87817c57584f1b24769f9eab27097711c117d7e382f8" gracePeriod=30
Jul 29 01:15:06.118540 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:06.118509    2558 generic.go:356] "Generic (PLEG): container finished" podID="b8ad20be-d753-44bc-a770-bcfc1ce49ee1" containerID="c74c8f975378f45429ff87817c57584f1b24769f9eab27097711c117d7e382f8" exitCode=2
Jul 29 01:15:06.118696 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:06.118583    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd" event={"ID":"b8ad20be-d753-44bc-a770-bcfc1ce49ee1","Type":"ContainerDied","Data":"c74c8f975378f45429ff87817c57584f1b24769f9eab27097711c117d7e382f8"}
Jul 29 01:15:06.118696 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:06.118624    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b49b89b89-7zdvd" event={"ID":"b8ad20be-d753-44bc-a770-bcfc1ce49ee1","Type":"ContainerStarted","Data":"34a75c20c309b09f6d3e3a33206141f6d52d642cf8ea7e8ea39766b9ccb1a075"}
Jul 29 01:15:06.752516 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:06.752471    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:06.853507 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:06.853470    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:06.906151 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:06.906115    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:14.896152 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:14.896110    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:14.958264 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:14.958228    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:31.059881 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:31.059849    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:31.155307 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:31.155231    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:32.097223 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:32.097154    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:32.199027 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:32.198985    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:32.259044 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:32.259012    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:43.077328 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.077276    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:43.136808 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.136776    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:43.305011 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.304973    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c6b9584dc-7k6ld"]
Jul 29 01:15:43.305228 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.305215    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c545910b-2bb5-4c0e-b598-3edf37fc9204" containerName="console"
Jul 29 01:15:43.305275 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.305232    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c545910b-2bb5-4c0e-b598-3edf37fc9204" containerName="console"
Jul 29 01:15:43.305275 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.305247    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba2d66c0-1221-4062-bc21-4de7ccb6bfc5" containerName="console"
Jul 29 01:15:43.305275 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.305268    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba2d66c0-1221-4062-bc21-4de7ccb6bfc5" containerName="console"
Jul 29 01:15:43.305368 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.305320    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba2d66c0-1221-4062-bc21-4de7ccb6bfc5" containerName="console"
Jul 29 01:15:43.305368 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.305333    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c545910b-2bb5-4c0e-b598-3edf37fc9204" containerName="console"
Jul 29 01:15:43.309011 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.308997    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.311936 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.311915    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 01:15:43.311936 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.311936    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 01:15:43.312275 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.312258    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 01:15:43.312756 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.312737    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 01:15:43.312980 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.312954    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 01:15:43.313110 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.313005    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 01:15:43.313110 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.313085    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9xgr5\""
Jul 29 01:15:43.313252 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.313233    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 01:15:43.317672 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.317652    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 01:15:43.327752 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.327703    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6b9584dc-7k6ld"]
Jul 29 01:15:43.366274 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.366242    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:43.460067 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.460040    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-oauth-config\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.460067 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.460069    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-config\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.460231 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.460098    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgcl9\" (UniqueName: \"kubernetes.io/projected/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-kube-api-access-bgcl9\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.460231 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.460118    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-service-ca\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.460231 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.460204    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-trusted-ca-bundle\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.460326 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.460239    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-oauth-serving-cert\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.460326 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.460272    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-serving-cert\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.509612 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.509571    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:43.561575 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.561550    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgcl9\" (UniqueName: \"kubernetes.io/projected/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-kube-api-access-bgcl9\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.561656 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.561579    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-service-ca\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.561656 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.561605    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-trusted-ca-bundle\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.561656 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.561626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-oauth-serving-cert\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.561765 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.561677    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-serving-cert\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.561765 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.561715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-oauth-config\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.561765 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.561732    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-config\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.562391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.562370    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-oauth-serving-cert\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.562487 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.562468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-config\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.562551 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.562532    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-service-ca\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.562588 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.562541    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-trusted-ca-bundle\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.564067 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.564050    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-serving-cert\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.564129 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.564119    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-oauth-config\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.570603 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.570585    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgcl9\" (UniqueName: \"kubernetes.io/projected/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-kube-api-access-bgcl9\") pod \"console-7c6b9584dc-7k6ld\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") " pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.619659 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.619603    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:43.748416 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:43.748381    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6b9584dc-7k6ld"]
Jul 29 01:15:43.751832 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:15:43.751811    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3f2f6c_9e00_4df8_aa0f_bb81d31cff89.slice/crio-715e9ad5241e6265c9b8ff4225420da16d94af40ffe239da03cfe3133797457b WatchSource:0}: Error finding container 715e9ad5241e6265c9b8ff4225420da16d94af40ffe239da03cfe3133797457b: Status 404 returned error can't find the container with id 715e9ad5241e6265c9b8ff4225420da16d94af40ffe239da03cfe3133797457b
Jul 29 01:15:44.055322 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:44.055288    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:44.243981 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:44.243945    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6b9584dc-7k6ld" event={"ID":"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89","Type":"ContainerStarted","Data":"9985e415fd563402d9fe840ce8022ef514fe40539c878be54bf394ba5ecaa22b"}
Jul 29 01:15:44.244425 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:44.243999    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6b9584dc-7k6ld" event={"ID":"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89","Type":"ContainerStarted","Data":"715e9ad5241e6265c9b8ff4225420da16d94af40ffe239da03cfe3133797457b"}
Jul 29 01:15:44.262111 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:44.262064    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c6b9584dc-7k6ld" podStartSLOduration=1.262047822 podStartE2EDuration="1.262047822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:15:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:44.26177293 +0000 UTC m=+373.762208385" watchObservedRunningTime="2026-07-29 01:15:44.262047822 +0000 UTC m=+373.762483342"
Jul 29 01:15:44.917538 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:44.917492    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:45.022829 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:45.022793    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:45.122644 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:45.122601    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:53.620684 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:53.620646    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:53.621311 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:53.620718    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:53.625474 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:53.625448    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:54.282555 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:54.282528    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:15:54.420327 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:54.420290    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:54.520794 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:54.520760    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:54.577096 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:54.577015    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:15:58.698042 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:15:58.697990    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:12.504467 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:12.504425    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:12.604306 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:12.604271    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:13.290595 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.290559    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"]
Jul 29 01:16:13.292865 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.292845    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"
Jul 29 01:16:13.295662 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.295644    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 01:16:13.296566 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.296546    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r9r48\""
Jul 29 01:16:13.296654 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.296546    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 01:16:13.304773 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.304753    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"]
Jul 29 01:16:13.360018 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.359992    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk\" (UID: \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"
Jul 29 01:16:13.360140 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.360051    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk\" (UID: \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"
Jul 29 01:16:13.360207 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.360132    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp9qq\" (UniqueName: \"kubernetes.io/projected/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-kube-api-access-sp9qq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk\" (UID: \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"
Jul 29 01:16:13.461212 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.461161    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk\" (UID: \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"
Jul 29 01:16:13.461294 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.461231    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk\" (UID: \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"
Jul 29 01:16:13.461294 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.461257    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp9qq\" (UniqueName: \"kubernetes.io/projected/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-kube-api-access-sp9qq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk\" (UID: \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"
Jul 29 01:16:13.461512 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.461495    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk\" (UID: \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"
Jul 29 01:16:13.461598 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.461574    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk\" (UID: \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"
Jul 29 01:16:13.470643 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.470615    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp9qq\" (UniqueName: \"kubernetes.io/projected/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-kube-api-access-sp9qq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk\" (UID: \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"
Jul 29 01:16:13.602235 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.602140    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"
Jul 29 01:16:13.727529 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.727494    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"]
Jul 29 01:16:13.730087 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:16:13.730056    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f5daf77_7a4e_484b_9089_c6f10c3b45d5.slice/crio-12abb21bf9d55f5b4f26d4fe17aae39a89d54b523fa537dea14823e53e78a82c WatchSource:0}: Error finding container 12abb21bf9d55f5b4f26d4fe17aae39a89d54b523fa537dea14823e53e78a82c: Status 404 returned error can't find the container with id 12abb21bf9d55f5b4f26d4fe17aae39a89d54b523fa537dea14823e53e78a82c
Jul 29 01:16:13.732239 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:13.732222    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:16:14.343833 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:14.343797    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk" event={"ID":"8f5daf77-7a4e-484b-9089-c6f10c3b45d5","Type":"ContainerStarted","Data":"12abb21bf9d55f5b4f26d4fe17aae39a89d54b523fa537dea14823e53e78a82c"}
Jul 29 01:16:20.371090 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:20.371056    2558 generic.go:356] "Generic (PLEG): container finished" podID="8f5daf77-7a4e-484b-9089-c6f10c3b45d5" containerID="207ab97cccfa63fbd1997192754d333d35210d02c86b7945bd898785db62b3fe" exitCode=0
Jul 29 01:16:20.371466 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:20.371140    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk" event={"ID":"8f5daf77-7a4e-484b-9089-c6f10c3b45d5","Type":"ContainerDied","Data":"207ab97cccfa63fbd1997192754d333d35210d02c86b7945bd898785db62b3fe"}
Jul 29 01:16:23.383451 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:23.383412    2558 generic.go:356] "Generic (PLEG): container finished" podID="8f5daf77-7a4e-484b-9089-c6f10c3b45d5" containerID="21b2969665eafd1449b4919e55c653a4474155bb7041c51ec3651597e1ef75b6" exitCode=0
Jul 29 01:16:23.383815 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:23.383487    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk" event={"ID":"8f5daf77-7a4e-484b-9089-c6f10c3b45d5","Type":"ContainerDied","Data":"21b2969665eafd1449b4919e55c653a4474155bb7041c51ec3651597e1ef75b6"}
Jul 29 01:16:28.843282 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:28.843246    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:30.411297 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:30.411209    2558 generic.go:356] "Generic (PLEG): container finished" podID="8f5daf77-7a4e-484b-9089-c6f10c3b45d5" containerID="848a07f593fcdabca4bf441c85d958e90ab9abb513686c383084e64f1a491429" exitCode=0
Jul 29 01:16:30.411297 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:30.411278    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk" event={"ID":"8f5daf77-7a4e-484b-9089-c6f10c3b45d5","Type":"ContainerDied","Data":"848a07f593fcdabca4bf441c85d958e90ab9abb513686c383084e64f1a491429"}
Jul 29 01:16:31.529745 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:31.529716    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"
Jul 29 01:16:31.606596 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:31.606569    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp9qq\" (UniqueName: \"kubernetes.io/projected/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-kube-api-access-sp9qq\") pod \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\" (UID: \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\") "
Jul 29 01:16:31.606719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:31.606601    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-bundle\") pod \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\" (UID: \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\") "
Jul 29 01:16:31.606719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:31.606645    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-util\") pod \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\" (UID: \"8f5daf77-7a4e-484b-9089-c6f10c3b45d5\") "
Jul 29 01:16:31.607339 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:31.607317    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-bundle" (OuterVolumeSpecName: "bundle") pod "8f5daf77-7a4e-484b-9089-c6f10c3b45d5" (UID: "8f5daf77-7a4e-484b-9089-c6f10c3b45d5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:16:31.608742 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:31.608725    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-kube-api-access-sp9qq" (OuterVolumeSpecName: "kube-api-access-sp9qq") pod "8f5daf77-7a4e-484b-9089-c6f10c3b45d5" (UID: "8f5daf77-7a4e-484b-9089-c6f10c3b45d5"). InnerVolumeSpecName "kube-api-access-sp9qq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:16:31.611376 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:31.611358    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-util" (OuterVolumeSpecName: "util") pod "8f5daf77-7a4e-484b-9089-c6f10c3b45d5" (UID: "8f5daf77-7a4e-484b-9089-c6f10c3b45d5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:16:31.707358 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:31.707286    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp9qq\" (UniqueName: \"kubernetes.io/projected/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-kube-api-access-sp9qq\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:16:31.707358 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:31.707313    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-bundle\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:16:31.707358 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:31.707323    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f5daf77-7a4e-484b-9089-c6f10c3b45d5-util\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:16:32.419433 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:32.419401    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk" event={"ID":"8f5daf77-7a4e-484b-9089-c6f10c3b45d5","Type":"ContainerDied","Data":"12abb21bf9d55f5b4f26d4fe17aae39a89d54b523fa537dea14823e53e78a82c"}
Jul 29 01:16:32.419590 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:32.419450    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12abb21bf9d55f5b4f26d4fe17aae39a89d54b523fa537dea14823e53e78a82c"
Jul 29 01:16:32.419590 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:32.419411    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f8qmk"
Jul 29 01:16:34.315306 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:34.315274    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:35.135022 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:35.134961    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:36.319969 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.319934    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bv4w5"]
Jul 29 01:16:36.320348 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.320154    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f5daf77-7a4e-484b-9089-c6f10c3b45d5" containerName="util"
Jul 29 01:16:36.320348 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.320165    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f5daf77-7a4e-484b-9089-c6f10c3b45d5" containerName="util"
Jul 29 01:16:36.320348 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.320192    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f5daf77-7a4e-484b-9089-c6f10c3b45d5" containerName="pull"
Jul 29 01:16:36.320348 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.320198    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f5daf77-7a4e-484b-9089-c6f10c3b45d5" containerName="pull"
Jul 29 01:16:36.320348 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.320206    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f5daf77-7a4e-484b-9089-c6f10c3b45d5" containerName="extract"
Jul 29 01:16:36.320348 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.320211    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f5daf77-7a4e-484b-9089-c6f10c3b45d5" containerName="extract"
Jul 29 01:16:36.320348 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.320253    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f5daf77-7a4e-484b-9089-c6f10c3b45d5" containerName="extract"
Jul 29 01:16:36.323614 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.323598    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bv4w5"
Jul 29 01:16:36.326726 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.326697    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:16:36.326726 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.326713    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7wjmj\""
Jul 29 01:16:36.326883 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.326701    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 29 01:16:36.389221 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.389160    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bv4w5"]
Jul 29 01:16:36.441982 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.441939    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6kqw\" (UniqueName: \"kubernetes.io/projected/c27e5d02-bd80-477a-b5e0-fa9f84d877b9-kube-api-access-c6kqw\") pod \"cert-manager-operator-controller-manager-55c444bf86-bv4w5\" (UID: \"c27e5d02-bd80-477a-b5e0-fa9f84d877b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bv4w5"
Jul 29 01:16:36.441982 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.441984    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c27e5d02-bd80-477a-b5e0-fa9f84d877b9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bv4w5\" (UID: \"c27e5d02-bd80-477a-b5e0-fa9f84d877b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bv4w5"
Jul 29 01:16:36.543170 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.543138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6kqw\" (UniqueName: \"kubernetes.io/projected/c27e5d02-bd80-477a-b5e0-fa9f84d877b9-kube-api-access-c6kqw\") pod \"cert-manager-operator-controller-manager-55c444bf86-bv4w5\" (UID: \"c27e5d02-bd80-477a-b5e0-fa9f84d877b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bv4w5"
Jul 29 01:16:36.543352 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.543192    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c27e5d02-bd80-477a-b5e0-fa9f84d877b9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bv4w5\" (UID: \"c27e5d02-bd80-477a-b5e0-fa9f84d877b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bv4w5"
Jul 29 01:16:36.543531 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.543515    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c27e5d02-bd80-477a-b5e0-fa9f84d877b9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bv4w5\" (UID: \"c27e5d02-bd80-477a-b5e0-fa9f84d877b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bv4w5"
Jul 29 01:16:36.552508 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.552487    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6kqw\" (UniqueName: \"kubernetes.io/projected/c27e5d02-bd80-477a-b5e0-fa9f84d877b9-kube-api-access-c6kqw\") pod \"cert-manager-operator-controller-manager-55c444bf86-bv4w5\" (UID: \"c27e5d02-bd80-477a-b5e0-fa9f84d877b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bv4w5"
Jul 29 01:16:36.632455 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.632398    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bv4w5"
Jul 29 01:16:36.764523 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:36.764418    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bv4w5"]
Jul 29 01:16:36.767701 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:16:36.767670    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc27e5d02_bd80_477a_b5e0_fa9f84d877b9.slice/crio-5d3ecac7264bc42a8a0baca631522f42a0ba982faf27b9d6b14a1c4244d40fac WatchSource:0}: Error finding container 5d3ecac7264bc42a8a0baca631522f42a0ba982faf27b9d6b14a1c4244d40fac: Status 404 returned error can't find the container with id 5d3ecac7264bc42a8a0baca631522f42a0ba982faf27b9d6b14a1c4244d40fac
Jul 29 01:16:37.437193 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:37.437144    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bv4w5" event={"ID":"c27e5d02-bd80-477a-b5e0-fa9f84d877b9","Type":"ContainerStarted","Data":"5d3ecac7264bc42a8a0baca631522f42a0ba982faf27b9d6b14a1c4244d40fac"}
Jul 29 01:16:37.928920 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:37.928882    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:38.030849 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:38.030813    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:39.445743 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:39.445709    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bv4w5" event={"ID":"c27e5d02-bd80-477a-b5e0-fa9f84d877b9","Type":"ContainerStarted","Data":"847692035bc976531958a29c807b0a201ef769c73e9c6d877173941c89687d2a"}
Jul 29 01:16:39.470377 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:39.470321    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bv4w5" podStartSLOduration=1.695681958 podStartE2EDuration="3.470305674s" totalImagesPullingTime="1.774623716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:16:39.46897456 +0000 UTC m=+428.969410012" watchObservedRunningTime="2026-07-29 01:16:39.470305674 +0000 UTC m=+428.970741125"
Jul 29 01:16:39.859404 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:39.859368    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:39.969347 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:39.969292    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:40.345052 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:40.345018    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:40.450474 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:40.450441    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:42.621630 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:42.621577    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:42.869057 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:42.869018    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:44.751247 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:44.751200    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:44.811953 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:44.811920    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:47.956885 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:47.956851    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:48.058027 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:48.058001    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:48.919871 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:48.919839    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:50.234522 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.234489    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:16:50.514185 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.514152    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nxh6k"]
Jul 29 01:16:50.516311 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.516291    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nxh6k"
Jul 29 01:16:50.518746 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.518720    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 01:16:50.518889 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.518873    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 01:16:50.519723 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.519704    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-d22kf\""
Jul 29 01:16:50.526253 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.526234    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nxh6k"]
Jul 29 01:16:50.644997 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.644960    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx5ww\" (UniqueName: \"kubernetes.io/projected/da63abc8-6257-4682-b68c-0f379b16f81e-kube-api-access-xx5ww\") pod \"cert-manager-55b4d954d5-nxh6k\" (UID: \"da63abc8-6257-4682-b68c-0f379b16f81e\") " pod="cert-manager/cert-manager-55b4d954d5-nxh6k"
Jul 29 01:16:50.644997 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.644997    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da63abc8-6257-4682-b68c-0f379b16f81e-bound-sa-token\") pod \"cert-manager-55b4d954d5-nxh6k\" (UID: \"da63abc8-6257-4682-b68c-0f379b16f81e\") " pod="cert-manager/cert-manager-55b4d954d5-nxh6k"
Jul 29 01:16:50.746376 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.746329    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx5ww\" (UniqueName: \"kubernetes.io/projected/da63abc8-6257-4682-b68c-0f379b16f81e-kube-api-access-xx5ww\") pod \"cert-manager-55b4d954d5-nxh6k\" (UID: \"da63abc8-6257-4682-b68c-0f379b16f81e\") " pod="cert-manager/cert-manager-55b4d954d5-nxh6k"
Jul 29 01:16:50.746376 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.746379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da63abc8-6257-4682-b68c-0f379b16f81e-bound-sa-token\") pod \"cert-manager-55b4d954d5-nxh6k\" (UID: \"da63abc8-6257-4682-b68c-0f379b16f81e\") " pod="cert-manager/cert-manager-55b4d954d5-nxh6k"
Jul 29 01:16:50.754964 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.754932    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da63abc8-6257-4682-b68c-0f379b16f81e-bound-sa-token\") pod \"cert-manager-55b4d954d5-nxh6k\" (UID: \"da63abc8-6257-4682-b68c-0f379b16f81e\") " pod="cert-manager/cert-manager-55b4d954d5-nxh6k"
Jul 29 01:16:50.755236 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.755216    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx5ww\" (UniqueName: \"kubernetes.io/projected/da63abc8-6257-4682-b68c-0f379b16f81e-kube-api-access-xx5ww\") pod \"cert-manager-55b4d954d5-nxh6k\" (UID: \"da63abc8-6257-4682-b68c-0f379b16f81e\") " pod="cert-manager/cert-manager-55b4d954d5-nxh6k"
Jul 29 01:16:50.824788 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.824701    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nxh6k"
Jul 29 01:16:50.947297 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:50.947215    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nxh6k"]
Jul 29 01:16:50.949785 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:16:50.949745    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda63abc8_6257_4682_b68c_0f379b16f81e.slice/crio-8b961ec649093109ebdd42f37acf23a217c1ac84bdc944fcf07a98af11ca7453 WatchSource:0}: Error finding container 8b961ec649093109ebdd42f37acf23a217c1ac84bdc944fcf07a98af11ca7453: Status 404 returned error can't find the container with id 8b961ec649093109ebdd42f37acf23a217c1ac84bdc944fcf07a98af11ca7453
Jul 29 01:16:51.488206 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:51.488161    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nxh6k" event={"ID":"da63abc8-6257-4682-b68c-0f379b16f81e","Type":"ContainerStarted","Data":"8b961ec649093109ebdd42f37acf23a217c1ac84bdc944fcf07a98af11ca7453"}
Jul 29 01:16:58.516434 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:58.516392    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nxh6k" event={"ID":"da63abc8-6257-4682-b68c-0f379b16f81e","Type":"ContainerStarted","Data":"82cd7fe6bef0cbf428f4ce2548bc88e703a1ee986768bf4c99ff8f82bc9a34af"}
Jul 29 01:16:58.533694 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:16:58.533641    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nxh6k" podStartSLOduration=1.948521189 podStartE2EDuration="8.533620992s" totalImagesPullingTime="6.585099803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:16:58.532427996 +0000 UTC m=+448.032863449" watchObservedRunningTime="2026-07-29 01:16:58.533620992 +0000 UTC m=+448.034056457"
Jul 29 01:17:03.550403 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:03.550352    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:03.646374 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:03.646340    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:10.214192 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:10.214145    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:10.315332 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:10.315294    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:11.774872 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.774834    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"]
Jul 29 01:17:11.777764 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.777741    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"
Jul 29 01:17:11.780443 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.780420    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 01:17:11.780528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.780496    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 01:17:11.781558 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.781537    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r9r48\""
Jul 29 01:17:11.788387 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.788368    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"]
Jul 29 01:17:11.799445 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.799423    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c74bc35f-4c6b-425e-89da-ca2a536ccd51-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt\" (UID: \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"
Jul 29 01:17:11.799538 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.799464    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c74bc35f-4c6b-425e-89da-ca2a536ccd51-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt\" (UID: \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"
Jul 29 01:17:11.799538 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.799487    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzgjp\" (UniqueName: \"kubernetes.io/projected/c74bc35f-4c6b-425e-89da-ca2a536ccd51-kube-api-access-qzgjp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt\" (UID: \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"
Jul 29 01:17:11.900236 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.900206    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c74bc35f-4c6b-425e-89da-ca2a536ccd51-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt\" (UID: \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"
Jul 29 01:17:11.900384 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.900248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c74bc35f-4c6b-425e-89da-ca2a536ccd51-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt\" (UID: \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"
Jul 29 01:17:11.900384 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.900270    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzgjp\" (UniqueName: \"kubernetes.io/projected/c74bc35f-4c6b-425e-89da-ca2a536ccd51-kube-api-access-qzgjp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt\" (UID: \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"
Jul 29 01:17:11.900585 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.900565    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c74bc35f-4c6b-425e-89da-ca2a536ccd51-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt\" (UID: \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"
Jul 29 01:17:11.900638 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.900585    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c74bc35f-4c6b-425e-89da-ca2a536ccd51-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt\" (UID: \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"
Jul 29 01:17:11.908340 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:11.908316    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzgjp\" (UniqueName: \"kubernetes.io/projected/c74bc35f-4c6b-425e-89da-ca2a536ccd51-kube-api-access-qzgjp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt\" (UID: \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"
Jul 29 01:17:12.087291 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:12.087233    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"
Jul 29 01:17:12.208684 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:12.208655    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"]
Jul 29 01:17:12.210853 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:17:12.210821    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74bc35f_4c6b_425e_89da_ca2a536ccd51.slice/crio-f0dbd2f0eefabb0f58edc39c51575125538fd93400c20ec37566e10053d2606f WatchSource:0}: Error finding container f0dbd2f0eefabb0f58edc39c51575125538fd93400c20ec37566e10053d2606f: Status 404 returned error can't find the container with id f0dbd2f0eefabb0f58edc39c51575125538fd93400c20ec37566e10053d2606f
Jul 29 01:17:12.354717 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:12.354647    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:12.567822 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:12.567786    2558 generic.go:356] "Generic (PLEG): container finished" podID="c74bc35f-4c6b-425e-89da-ca2a536ccd51" containerID="1864d9bdacaa3db5511425a806005c1680b26da451a29607e86a253ec8b511d5" exitCode=0
Jul 29 01:17:12.567980 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:12.567854    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt" event={"ID":"c74bc35f-4c6b-425e-89da-ca2a536ccd51","Type":"ContainerDied","Data":"1864d9bdacaa3db5511425a806005c1680b26da451a29607e86a253ec8b511d5"}
Jul 29 01:17:12.567980 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:12.567889    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt" event={"ID":"c74bc35f-4c6b-425e-89da-ca2a536ccd51","Type":"ContainerStarted","Data":"f0dbd2f0eefabb0f58edc39c51575125538fd93400c20ec37566e10053d2606f"}
Jul 29 01:17:13.573459 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:13.573425    2558 generic.go:356] "Generic (PLEG): container finished" podID="c74bc35f-4c6b-425e-89da-ca2a536ccd51" containerID="b87c93304f88b1f58d7211885ab174ca6ac1b1f524e319bb906f648be5939233" exitCode=0
Jul 29 01:17:13.573832 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:13.573472    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt" event={"ID":"c74bc35f-4c6b-425e-89da-ca2a536ccd51","Type":"ContainerDied","Data":"b87c93304f88b1f58d7211885ab174ca6ac1b1f524e319bb906f648be5939233"}
Jul 29 01:17:14.578844 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:14.578806    2558 generic.go:356] "Generic (PLEG): container finished" podID="c74bc35f-4c6b-425e-89da-ca2a536ccd51" containerID="724d53b10255673b79cc9d28a0cc0eef93d472e98b03683e5cd8f0c13ad40a39" exitCode=0
Jul 29 01:17:14.579319 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:14.578885    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt" event={"ID":"c74bc35f-4c6b-425e-89da-ca2a536ccd51","Type":"ContainerDied","Data":"724d53b10255673b79cc9d28a0cc0eef93d472e98b03683e5cd8f0c13ad40a39"}
Jul 29 01:17:15.701788 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:15.701763    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"
Jul 29 01:17:15.726315 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:15.726291    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzgjp\" (UniqueName: \"kubernetes.io/projected/c74bc35f-4c6b-425e-89da-ca2a536ccd51-kube-api-access-qzgjp\") pod \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\" (UID: \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\") "
Jul 29 01:17:15.726455 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:15.726329    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c74bc35f-4c6b-425e-89da-ca2a536ccd51-util\") pod \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\" (UID: \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\") "
Jul 29 01:17:15.726455 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:15.726394    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c74bc35f-4c6b-425e-89da-ca2a536ccd51-bundle\") pod \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\" (UID: \"c74bc35f-4c6b-425e-89da-ca2a536ccd51\") "
Jul 29 01:17:15.727270 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:15.727205    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c74bc35f-4c6b-425e-89da-ca2a536ccd51-bundle" (OuterVolumeSpecName: "bundle") pod "c74bc35f-4c6b-425e-89da-ca2a536ccd51" (UID: "c74bc35f-4c6b-425e-89da-ca2a536ccd51"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:17:15.728352 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:15.728327    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c74bc35f-4c6b-425e-89da-ca2a536ccd51-kube-api-access-qzgjp" (OuterVolumeSpecName: "kube-api-access-qzgjp") pod "c74bc35f-4c6b-425e-89da-ca2a536ccd51" (UID: "c74bc35f-4c6b-425e-89da-ca2a536ccd51"). InnerVolumeSpecName "kube-api-access-qzgjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:17:15.734500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:15.734471    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c74bc35f-4c6b-425e-89da-ca2a536ccd51-util" (OuterVolumeSpecName: "util") pod "c74bc35f-4c6b-425e-89da-ca2a536ccd51" (UID: "c74bc35f-4c6b-425e-89da-ca2a536ccd51"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:17:15.827401 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:15.827371    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzgjp\" (UniqueName: \"kubernetes.io/projected/c74bc35f-4c6b-425e-89da-ca2a536ccd51-kube-api-access-qzgjp\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:17:15.827401 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:15.827396    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c74bc35f-4c6b-425e-89da-ca2a536ccd51-util\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:17:15.827401 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:15.827405    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c74bc35f-4c6b-425e-89da-ca2a536ccd51-bundle\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:17:16.587936 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:16.587901    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt" event={"ID":"c74bc35f-4c6b-425e-89da-ca2a536ccd51","Type":"ContainerDied","Data":"f0dbd2f0eefabb0f58edc39c51575125538fd93400c20ec37566e10053d2606f"}
Jul 29 01:17:16.588100 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:16.587946    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzx6nt"
Jul 29 01:17:16.588100 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:16.587973    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0dbd2f0eefabb0f58edc39c51575125538fd93400c20ec37566e10053d2606f"
Jul 29 01:17:24.916862 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:24.916828    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:25.010459 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.010424    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:25.521057 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.521017    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:25.760120 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.760089    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:25.860880 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.860806    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:25.896957 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.896934    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"]
Jul 29 01:17:25.897192 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.897168    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c74bc35f-4c6b-425e-89da-ca2a536ccd51" containerName="util"
Jul 29 01:17:25.897236 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.897194    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c74bc35f-4c6b-425e-89da-ca2a536ccd51" containerName="util"
Jul 29 01:17:25.897236 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.897202    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c74bc35f-4c6b-425e-89da-ca2a536ccd51" containerName="extract"
Jul 29 01:17:25.897236 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.897207    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c74bc35f-4c6b-425e-89da-ca2a536ccd51" containerName="extract"
Jul 29 01:17:25.897236 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.897218    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c74bc35f-4c6b-425e-89da-ca2a536ccd51" containerName="pull"
Jul 29 01:17:25.897236 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.897223    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c74bc35f-4c6b-425e-89da-ca2a536ccd51" containerName="pull"
Jul 29 01:17:25.897385 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.897280    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c74bc35f-4c6b-425e-89da-ca2a536ccd51" containerName="extract"
Jul 29 01:17:25.900052 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.900038    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:25.902537 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.902508    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 01:17:25.902764 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.902562    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vl6gp\""
Jul 29 01:17:25.902835 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.902803    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 01:17:25.902902 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.902887    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 01:17:25.903116 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.903102    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 01:17:25.923790 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.923766    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"]
Jul 29 01:17:25.999379 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.999346    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-manifests\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:25.999531 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.999385    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-tmp\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:25.999531 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.999410    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:25.999531 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.999470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:25.999531 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:25.999490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49d4n\" (UniqueName: \"kubernetes.io/projected/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-kube-api-access-49d4n\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:26.035755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.035709    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:26.100519 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.100485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-tmp\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:26.100519 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.100523    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:26.100734 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.100571    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:26.100734 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.100595    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49d4n\" (UniqueName: \"kubernetes.io/projected/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-kube-api-access-49d4n\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:26.100891 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.100865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-manifests\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:26.101299 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.101261    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-manifests\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:26.103311 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.103285    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-tmp\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:26.103425 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.103348    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:26.103494 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.103476    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:26.109155 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.109123    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49d4n\" (UniqueName: \"kubernetes.io/projected/b1ba119c-f20a-4c48-adf4-1c89156f8ec8-kube-api-access-49d4n\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-cd9bc\" (UID: \"b1ba119c-f20a-4c48-adf4-1c89156f8ec8\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:26.136909 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.136847    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:26.210062 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.210028    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:26.236290 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.236259    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:26.338907 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.338875    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:26.344986 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.344965    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"]
Jul 29 01:17:26.346746 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:17:26.346721    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ba119c_f20a_4c48_adf4_1c89156f8ec8.slice/crio-7c3f93927ac2d21a6ca0233b74d006b00c954ee9b085caee50041ac155be82b1 WatchSource:0}: Error finding container 7c3f93927ac2d21a6ca0233b74d006b00c954ee9b085caee50041ac155be82b1: Status 404 returned error can't find the container with id 7c3f93927ac2d21a6ca0233b74d006b00c954ee9b085caee50041ac155be82b1
Jul 29 01:17:26.456469 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.456395    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:26.624998 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:26.624964    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc" event={"ID":"b1ba119c-f20a-4c48-adf4-1c89156f8ec8","Type":"ContainerStarted","Data":"7c3f93927ac2d21a6ca0233b74d006b00c954ee9b085caee50041ac155be82b1"}
Jul 29 01:17:27.093087 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:27.093018    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:29.640298 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:29.640216    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc" event={"ID":"b1ba119c-f20a-4c48-adf4-1c89156f8ec8","Type":"ContainerStarted","Data":"33fc12014128f6a4967a7cea4a24129204ff615c8bb3e9bc2eccdeb67057b30f"}
Jul 29 01:17:30.611413 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:30.611383    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:30.645930 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:30.645896    2558 generic.go:356] "Generic (PLEG): container finished" podID="b1ba119c-f20a-4c48-adf4-1c89156f8ec8" containerID="33fc12014128f6a4967a7cea4a24129204ff615c8bb3e9bc2eccdeb67057b30f" exitCode=0
Jul 29 01:17:30.646319 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:30.645943    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc" event={"ID":"b1ba119c-f20a-4c48-adf4-1c89156f8ec8","Type":"ContainerDied","Data":"33fc12014128f6a4967a7cea4a24129204ff615c8bb3e9bc2eccdeb67057b30f"}
Jul 29 01:17:30.674508 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:30.674478    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:31.652949 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:31.652916    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc" event={"ID":"b1ba119c-f20a-4c48-adf4-1c89156f8ec8","Type":"ContainerStarted","Data":"867137291d2e94526c229c1419732ceded723924ae7ec099684c1a9001f090ec"}
Jul 29 01:17:31.653359 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:31.653074    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:31.675227 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:31.675150    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc" podStartSLOduration=2.155331407 podStartE2EDuration="6.675130157s" totalImagesPullingTime="3.460131135s" totalInitContainerRuntime="1.059667615s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:31.674188608 +0000 UTC m=+481.174624073" watchObservedRunningTime="2026-07-29 01:17:31.675130157 +0000 UTC m=+481.175565610"
Jul 29 01:17:42.658634 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:42.658602    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-cd9bc"
Jul 29 01:17:45.342792 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:45.342749    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:45.459369 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:45.459332    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:45.981987 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:45.981942    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:46.014513 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.014480    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f844789c7-m989p"]
Jul 29 01:17:46.022280 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.022250    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p"
Jul 29 01:17:46.025361 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.025343    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 01:17:46.025467 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.025343    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 01:17:46.025467 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.025419    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r22pc\""
Jul 29 01:17:46.026447 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.026431    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 01:17:46.026518 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.026489    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 01:17:46.031840 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.031820    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f844789c7-m989p"]
Jul 29 01:17:46.149211 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.149163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0-tmp\") pod \"kube-auth-proxy-7f844789c7-m989p\" (UID: \"a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p"
Jul 29 01:17:46.149387 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.149222    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7kv2\" (UniqueName: \"kubernetes.io/projected/a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0-kube-api-access-h7kv2\") pod \"kube-auth-proxy-7f844789c7-m989p\" (UID: \"a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p"
Jul 29 01:17:46.149387 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.149304    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0-tls-certs\") pod \"kube-auth-proxy-7f844789c7-m989p\" (UID: \"a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p"
Jul 29 01:17:46.229974 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.229936    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:46.250196 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.250094    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0-tmp\") pod \"kube-auth-proxy-7f844789c7-m989p\" (UID: \"a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p"
Jul 29 01:17:46.250196 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.250145    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7kv2\" (UniqueName: \"kubernetes.io/projected/a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0-kube-api-access-h7kv2\") pod \"kube-auth-proxy-7f844789c7-m989p\" (UID: \"a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p"
Jul 29 01:17:46.250196 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.250188    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0-tls-certs\") pod \"kube-auth-proxy-7f844789c7-m989p\" (UID: \"a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p"
Jul 29 01:17:46.250447 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:17:46.250280    2558 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 29 01:17:46.250447 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:17:46.250331    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0-tls-certs podName:a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0 nodeName:}" failed. No retries permitted until 2026-07-29 01:17:46.750316118 +0000 UTC m=+496.250751548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0-tls-certs") pod "kube-auth-proxy-7f844789c7-m989p" (UID: "a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0") : secret "kube-auth-proxy-tls" not found
Jul 29 01:17:46.252444 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.252414    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0-tmp\") pod \"kube-auth-proxy-7f844789c7-m989p\" (UID: \"a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p"
Jul 29 01:17:46.259664 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.259635    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7kv2\" (UniqueName: \"kubernetes.io/projected/a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0-kube-api-access-h7kv2\") pod \"kube-auth-proxy-7f844789c7-m989p\" (UID: \"a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p"
Jul 29 01:17:46.331586 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.331545    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:46.435847 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.435802    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:46.532342 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.532303    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:46.636827 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.636795    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:46.755062 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.755027    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0-tls-certs\") pod \"kube-auth-proxy-7f844789c7-m989p\" (UID: \"a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p"
Jul 29 01:17:46.757667 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.757640    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0-tls-certs\") pod \"kube-auth-proxy-7f844789c7-m989p\" (UID: \"a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p"
Jul 29 01:17:46.932661 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.932579    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p"
Jul 29 01:17:46.998226 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:46.998025    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gmv9g"]
Jul 29 01:17:47.002151 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.002126    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gmv9g"
Jul 29 01:17:47.016915 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.016893    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 29 01:17:47.025924 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.025897    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gmv9g"]
Jul 29 01:17:47.051641 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.051614    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:47.057522 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.057499    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhkn7\" (UniqueName: \"kubernetes.io/projected/4254dcdf-83bd-4e47-b327-dcb11e7279b6-kube-api-access-jhkn7\") pod \"model-serving-api-54d89bd5fc-gmv9g\" (UID: \"4254dcdf-83bd-4e47-b327-dcb11e7279b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gmv9g"
Jul 29 01:17:47.057633 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.057536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4254dcdf-83bd-4e47-b327-dcb11e7279b6-tls-certs\") pod \"model-serving-api-54d89bd5fc-gmv9g\" (UID: \"4254dcdf-83bd-4e47-b327-dcb11e7279b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gmv9g"
Jul 29 01:17:47.086907 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.086884    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f844789c7-m989p"]
Jul 29 01:17:47.090699 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:17:47.090676    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9bf18c4_2ac1_464f_b8d0_5f4a3937b2f0.slice/crio-f35808d62ea566c47e1751f86378708f7177869b0a3429ad787598f8c99dad83 WatchSource:0}: Error finding container f35808d62ea566c47e1751f86378708f7177869b0a3429ad787598f8c99dad83: Status 404 returned error can't find the container with id f35808d62ea566c47e1751f86378708f7177869b0a3429ad787598f8c99dad83
Jul 29 01:17:47.158703 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.158664    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhkn7\" (UniqueName: \"kubernetes.io/projected/4254dcdf-83bd-4e47-b327-dcb11e7279b6-kube-api-access-jhkn7\") pod \"model-serving-api-54d89bd5fc-gmv9g\" (UID: \"4254dcdf-83bd-4e47-b327-dcb11e7279b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gmv9g"
Jul 29 01:17:47.158853 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.158714    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4254dcdf-83bd-4e47-b327-dcb11e7279b6-tls-certs\") pod \"model-serving-api-54d89bd5fc-gmv9g\" (UID: \"4254dcdf-83bd-4e47-b327-dcb11e7279b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gmv9g"
Jul 29 01:17:47.158898 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:17:47.158862    2558 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 29 01:17:47.158938 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:17:47.158929    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4254dcdf-83bd-4e47-b327-dcb11e7279b6-tls-certs podName:4254dcdf-83bd-4e47-b327-dcb11e7279b6 nodeName:}" failed. No retries permitted until 2026-07-29 01:17:47.658908596 +0000 UTC m=+497.159344033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4254dcdf-83bd-4e47-b327-dcb11e7279b6-tls-certs") pod "model-serving-api-54d89bd5fc-gmv9g" (UID: "4254dcdf-83bd-4e47-b327-dcb11e7279b6") : secret "model-serving-api-tls" not found
Jul 29 01:17:47.175611 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.175580    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhkn7\" (UniqueName: \"kubernetes.io/projected/4254dcdf-83bd-4e47-b327-dcb11e7279b6-kube-api-access-jhkn7\") pod \"model-serving-api-54d89bd5fc-gmv9g\" (UID: \"4254dcdf-83bd-4e47-b327-dcb11e7279b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gmv9g"
Jul 29 01:17:47.398138 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.398101    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"]
Jul 29 01:17:47.400580 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.400551    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:47.401382 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.401363    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.403768 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.403749    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 01:17:47.403768 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.403750    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 01:17:47.403887 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.403869    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 01:17:47.404439 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.404422    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-22gj9\""
Jul 29 01:17:47.404507 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.404428    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 01:17:47.414130 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.414111    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"]
Jul 29 01:17:47.461127 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.461102    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.461504 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.461131    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.461504 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.461156    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.461504 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.461206    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkbn2\" (UniqueName: \"kubernetes.io/projected/1d363bca-feac-4aa9-95e6-8cc733ea6bda-kube-api-access-tkbn2\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.461504 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.461283    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d363bca-feac-4aa9-95e6-8cc733ea6bda-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.461504 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.461316    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.461504 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.461341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.471637 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.471607    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:47.561869 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.561832    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.561869 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.561871    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.562128 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.561907    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.562128 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.561935    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkbn2\" (UniqueName: \"kubernetes.io/projected/1d363bca-feac-4aa9-95e6-8cc733ea6bda-kube-api-access-tkbn2\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.562128 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.561965    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d363bca-feac-4aa9-95e6-8cc733ea6bda-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.562128 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.561994    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.562128 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.562023    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.562795 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.562766    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.564463 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.564418    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d363bca-feac-4aa9-95e6-8cc733ea6bda-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.564639 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.564618    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.564764 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.564743    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.564962 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.564942    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.568026 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.567996    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:47.570538 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.570514    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.571296 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.571279    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkbn2\" (UniqueName: \"kubernetes.io/projected/1d363bca-feac-4aa9-95e6-8cc733ea6bda-kube-api-access-tkbn2\") pod \"istiod-openshift-gateway-7b7995d5cd-9dnf8\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.663342 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.663249    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4254dcdf-83bd-4e47-b327-dcb11e7279b6-tls-certs\") pod \"model-serving-api-54d89bd5fc-gmv9g\" (UID: \"4254dcdf-83bd-4e47-b327-dcb11e7279b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gmv9g"
Jul 29 01:17:47.665697 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.665669    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4254dcdf-83bd-4e47-b327-dcb11e7279b6-tls-certs\") pod \"model-serving-api-54d89bd5fc-gmv9g\" (UID: \"4254dcdf-83bd-4e47-b327-dcb11e7279b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gmv9g"
Jul 29 01:17:47.710647 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.710608    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:47.716003 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.715954    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p" event={"ID":"a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0","Type":"ContainerStarted","Data":"f35808d62ea566c47e1751f86378708f7177869b0a3429ad787598f8c99dad83"}
Jul 29 01:17:47.860364 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.860332    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"]
Jul 29 01:17:47.863017 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:17:47.862987    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d363bca_feac_4aa9_95e6_8cc733ea6bda.slice/crio-53cac9576ef2558a09f46a60c425fde6dac0320eb2b96681275881acaa6b49b0 WatchSource:0}: Error finding container 53cac9576ef2558a09f46a60c425fde6dac0320eb2b96681275881acaa6b49b0: Status 404 returned error can't find the container with id 53cac9576ef2558a09f46a60c425fde6dac0320eb2b96681275881acaa6b49b0
Jul 29 01:17:47.916015 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:47.915931    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gmv9g"
Jul 29 01:17:48.067488 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:48.067452    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gmv9g"]
Jul 29 01:17:48.072696 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:17:48.072671    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4254dcdf_83bd_4e47_b327_dcb11e7279b6.slice/crio-7fab550b5262fa3f133ca4bd472a79c5f521d1aef4939a3be87a76c75940f25f WatchSource:0}: Error finding container 7fab550b5262fa3f133ca4bd472a79c5f521d1aef4939a3be87a76c75940f25f: Status 404 returned error can't find the container with id 7fab550b5262fa3f133ca4bd472a79c5f521d1aef4939a3be87a76c75940f25f
Jul 29 01:17:48.473059 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:48.473016    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:48.723015 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:48.722980    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gmv9g" event={"ID":"4254dcdf-83bd-4e47-b327-dcb11e7279b6","Type":"ContainerStarted","Data":"7fab550b5262fa3f133ca4bd472a79c5f521d1aef4939a3be87a76c75940f25f"}
Jul 29 01:17:48.724496 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:48.724418    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8" event={"ID":"1d363bca-feac-4aa9-95e6-8cc733ea6bda","Type":"ContainerStarted","Data":"53cac9576ef2558a09f46a60c425fde6dac0320eb2b96681275881acaa6b49b0"}
Jul 29 01:17:50.733891 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:50.733857    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gmv9g" event={"ID":"4254dcdf-83bd-4e47-b327-dcb11e7279b6","Type":"ContainerStarted","Data":"de824bbbfb068015fcb42b72d30467c87ae6a51a794740b75c2035ecaeb919ad"}
Jul 29 01:17:50.734343 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:50.733921    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gmv9g"
Jul 29 01:17:50.735495 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:50.735466    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p" event={"ID":"a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0","Type":"ContainerStarted","Data":"e05b8c756fcb535a5729a055b7fbb28fdc072abeb44b72947328907b1a59865f"}
Jul 29 01:17:50.752311 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:50.752259    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gmv9g" podStartSLOduration=2.715687258 podStartE2EDuration="4.752239729s" totalImagesPullingTime="2.036552471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:50.750188494 +0000 UTC m=+500.250623945" watchObservedRunningTime="2026-07-29 01:17:50.752239729 +0000 UTC m=+500.252675181"
Jul 29 01:17:50.767993 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:50.767943    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f844789c7-m989p" podStartSLOduration=2.74751825 podStartE2EDuration="5.767923898s" totalImagesPullingTime="3.020405648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:50.766674169 +0000 UTC m=+500.267109621" watchObservedRunningTime="2026-07-29 01:17:50.767923898 +0000 UTC m=+500.268359351"
Jul 29 01:17:51.653794 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:51.653745    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:17:51.653901 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:51.653820    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 01:17:51.742215 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:51.742165    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8" event={"ID":"1d363bca-feac-4aa9-95e6-8cc733ea6bda","Type":"ContainerStarted","Data":"78ca5b15d5b9c65b64ce982c8cf000b67b439be5edd7ee56a656d563099c0c77"}
Jul 29 01:17:51.742645 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:51.742488    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:51.764888 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:51.764839    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8" podStartSLOduration=0.976853758 podStartE2EDuration="4.764822427s" totalImagesPullingTime="3.787968669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:51.762255862 +0000 UTC m=+501.262691317" watchObservedRunningTime="2026-07-29 01:17:51.764822427 +0000 UTC m=+501.265257878"
Jul 29 01:17:52.748932 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:52.748896    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-9dnf8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 01:17:52.749329 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:52.748952    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8" podUID="1d363bca-feac-4aa9-95e6-8cc733ea6bda" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:17:52.950160 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:52.950080    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:53.138639 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:53.138601    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:53.354861 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:53.354804    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:53.703700 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:53.703653    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:54.096200 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:54.096149    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:55.748828 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:55.748800    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:17:57.061769 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.061724    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:57.122563 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.122525    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f"]
Jul 29 01:17:57.126129 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.126111    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f"
Jul 29 01:17:57.129340 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.129319    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 29 01:17:57.129465 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.129419    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-66qcd\""
Jul 29 01:17:57.139843 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.139821    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg"]
Jul 29 01:17:57.142838 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.142818    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg"
Jul 29 01:17:57.142936 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.142886    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f"]
Jul 29 01:17:57.145693 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.145671    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 29 01:17:57.145929 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.145908    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qbq68\""
Jul 29 01:17:57.159158 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.159136    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg"]
Jul 29 01:17:57.189092 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.189062    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:57.246900 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.246863    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhgq4\" (UniqueName: \"kubernetes.io/projected/091d2f22-0009-46d4-8a04-cd4030ebd1f4-kube-api-access-vhgq4\") pod \"llmisvc-controller-manager-777c6bd7d5-bp7qg\" (UID: \"091d2f22-0009-46d4-8a04-cd4030ebd1f4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg"
Jul 29 01:17:57.247042 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.246917    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4rjd\" (UniqueName: \"kubernetes.io/projected/5cbbd24e-5945-4ef5-9b23-f95383e50e15-kube-api-access-r4rjd\") pod \"kserve-controller-manager-d6f4b65b8-cjz6f\" (UID: \"5cbbd24e-5945-4ef5-9b23-f95383e50e15\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f"
Jul 29 01:17:57.247042 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.246971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cbbd24e-5945-4ef5-9b23-f95383e50e15-cert\") pod \"kserve-controller-manager-d6f4b65b8-cjz6f\" (UID: \"5cbbd24e-5945-4ef5-9b23-f95383e50e15\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f"
Jul 29 01:17:57.247042 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.246991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/091d2f22-0009-46d4-8a04-cd4030ebd1f4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bp7qg\" (UID: \"091d2f22-0009-46d4-8a04-cd4030ebd1f4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg"
Jul 29 01:17:57.347647 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.347558    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4rjd\" (UniqueName: \"kubernetes.io/projected/5cbbd24e-5945-4ef5-9b23-f95383e50e15-kube-api-access-r4rjd\") pod \"kserve-controller-manager-d6f4b65b8-cjz6f\" (UID: \"5cbbd24e-5945-4ef5-9b23-f95383e50e15\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f"
Jul 29 01:17:57.347647 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.347604    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cbbd24e-5945-4ef5-9b23-f95383e50e15-cert\") pod \"kserve-controller-manager-d6f4b65b8-cjz6f\" (UID: \"5cbbd24e-5945-4ef5-9b23-f95383e50e15\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f"
Jul 29 01:17:57.347647 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.347627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/091d2f22-0009-46d4-8a04-cd4030ebd1f4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bp7qg\" (UID: \"091d2f22-0009-46d4-8a04-cd4030ebd1f4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg"
Jul 29 01:17:57.347914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.347683    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhgq4\" (UniqueName: \"kubernetes.io/projected/091d2f22-0009-46d4-8a04-cd4030ebd1f4-kube-api-access-vhgq4\") pod \"llmisvc-controller-manager-777c6bd7d5-bp7qg\" (UID: \"091d2f22-0009-46d4-8a04-cd4030ebd1f4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg"
Jul 29 01:17:57.347914 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:17:57.347727    2558 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 29 01:17:57.347914 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:17:57.347798    2558 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 29 01:17:57.347914 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:17:57.347803    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbbd24e-5945-4ef5-9b23-f95383e50e15-cert podName:5cbbd24e-5945-4ef5-9b23-f95383e50e15 nodeName:}" failed. No retries permitted until 2026-07-29 01:17:57.847783001 +0000 UTC m=+507.348218436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5cbbd24e-5945-4ef5-9b23-f95383e50e15-cert") pod "kserve-controller-manager-d6f4b65b8-cjz6f" (UID: "5cbbd24e-5945-4ef5-9b23-f95383e50e15") : secret "kserve-webhook-server-cert" not found
Jul 29 01:17:57.347914 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:17:57.347863    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091d2f22-0009-46d4-8a04-cd4030ebd1f4-cert podName:091d2f22-0009-46d4-8a04-cd4030ebd1f4 nodeName:}" failed. No retries permitted until 2026-07-29 01:17:57.847846341 +0000 UTC m=+507.348281772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/091d2f22-0009-46d4-8a04-cd4030ebd1f4-cert") pod "llmisvc-controller-manager-777c6bd7d5-bp7qg" (UID: "091d2f22-0009-46d4-8a04-cd4030ebd1f4") : secret "llmisvc-webhook-server-cert" not found
Jul 29 01:17:57.381292 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.381266    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhgq4\" (UniqueName: \"kubernetes.io/projected/091d2f22-0009-46d4-8a04-cd4030ebd1f4-kube-api-access-vhgq4\") pod \"llmisvc-controller-manager-777c6bd7d5-bp7qg\" (UID: \"091d2f22-0009-46d4-8a04-cd4030ebd1f4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg"
Jul 29 01:17:57.385530 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.385508    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4rjd\" (UniqueName: \"kubernetes.io/projected/5cbbd24e-5945-4ef5-9b23-f95383e50e15-kube-api-access-r4rjd\") pod \"kserve-controller-manager-d6f4b65b8-cjz6f\" (UID: \"5cbbd24e-5945-4ef5-9b23-f95383e50e15\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f"
Jul 29 01:17:57.455513 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.455483    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:57.569378 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.569345    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:57.675168 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.675087    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:57.774785 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.774757    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:57.851747 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.851716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cbbd24e-5945-4ef5-9b23-f95383e50e15-cert\") pod \"kserve-controller-manager-d6f4b65b8-cjz6f\" (UID: \"5cbbd24e-5945-4ef5-9b23-f95383e50e15\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f"
Jul 29 01:17:57.851747 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.851749    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/091d2f22-0009-46d4-8a04-cd4030ebd1f4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bp7qg\" (UID: \"091d2f22-0009-46d4-8a04-cd4030ebd1f4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg"
Jul 29 01:17:57.854498 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.854478    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/091d2f22-0009-46d4-8a04-cd4030ebd1f4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bp7qg\" (UID: \"091d2f22-0009-46d4-8a04-cd4030ebd1f4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg"
Jul 29 01:17:57.854665 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.854645    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cbbd24e-5945-4ef5-9b23-f95383e50e15-cert\") pod \"kserve-controller-manager-d6f4b65b8-cjz6f\" (UID: \"5cbbd24e-5945-4ef5-9b23-f95383e50e15\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f"
Jul 29 01:17:57.872528 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:57.872502    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:17:58.035761 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:58.035715    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f"
Jul 29 01:17:58.052998 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:58.052975    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg"
Jul 29 01:17:58.181256 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:58.181231    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f"]
Jul 29 01:17:58.182486 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:17:58.182462    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cbbd24e_5945_4ef5_9b23_f95383e50e15.slice/crio-d36bf6e56ed3e67bdb707321687c15f88c55e1003039971f7a1c2b8c1da8382d WatchSource:0}: Error finding container d36bf6e56ed3e67bdb707321687c15f88c55e1003039971f7a1c2b8c1da8382d: Status 404 returned error can't find the container with id d36bf6e56ed3e67bdb707321687c15f88c55e1003039971f7a1c2b8c1da8382d
Jul 29 01:17:58.196430 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:58.196383    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg"]
Jul 29 01:17:58.198554 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:17:58.198531    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod091d2f22_0009_46d4_8a04_cd4030ebd1f4.slice/crio-d27c26d8d316bf47b36bd0af085eabc96d50c6010fa7e0b9996816abbdaca9bb WatchSource:0}: Error finding container d27c26d8d316bf47b36bd0af085eabc96d50c6010fa7e0b9996816abbdaca9bb: Status 404 returned error can't find the container with id d27c26d8d316bf47b36bd0af085eabc96d50c6010fa7e0b9996816abbdaca9bb
Jul 29 01:17:58.772002 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:58.771969    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f" event={"ID":"5cbbd24e-5945-4ef5-9b23-f95383e50e15","Type":"ContainerStarted","Data":"d36bf6e56ed3e67bdb707321687c15f88c55e1003039971f7a1c2b8c1da8382d"}
Jul 29 01:17:58.773003 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:58.772980    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg" event={"ID":"091d2f22-0009-46d4-8a04-cd4030ebd1f4","Type":"ContainerStarted","Data":"d27c26d8d316bf47b36bd0af085eabc96d50c6010fa7e0b9996816abbdaca9bb"}
Jul 29 01:17:59.906755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:59.906712    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"]
Jul 29 01:17:59.907165 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:17:59.906909    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8" podUID="1d363bca-feac-4aa9-95e6-8cc733ea6bda" containerName="discovery" containerID="cri-o://78ca5b15d5b9c65b64ce982c8cf000b67b439be5edd7ee56a656d563099c0c77" gracePeriod=30
Jul 29 01:18:00.607881 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.607852    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:18:00.777384 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.777353    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-csr-ca-configmap\") pod \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") "
Jul 29 01:18:00.777562 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.777404    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-csr-dns-cert\") pod \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") "
Jul 29 01:18:00.777562 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.777436    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-token\") pod \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") "
Jul 29 01:18:00.777562 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.777550    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d363bca-feac-4aa9-95e6-8cc733ea6bda-local-certs\") pod \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") "
Jul 29 01:18:00.777736 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.777600    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-cacerts\") pod \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") "
Jul 29 01:18:00.777736 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.777641    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkbn2\" (UniqueName: \"kubernetes.io/projected/1d363bca-feac-4aa9-95e6-8cc733ea6bda-kube-api-access-tkbn2\") pod \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") "
Jul 29 01:18:00.777736 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.777724    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-kubeconfig\") pod \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\" (UID: \"1d363bca-feac-4aa9-95e6-8cc733ea6bda\") "
Jul 29 01:18:00.777876 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.777833    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1d363bca-feac-4aa9-95e6-8cc733ea6bda" (UID: "1d363bca-feac-4aa9-95e6-8cc733ea6bda"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:18:00.778018 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.777995    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-csr-ca-configmap\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:18:00.780542 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.780512    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d363bca-feac-4aa9-95e6-8cc733ea6bda-local-certs" (OuterVolumeSpecName: "local-certs") pod "1d363bca-feac-4aa9-95e6-8cc733ea6bda" (UID: "1d363bca-feac-4aa9-95e6-8cc733ea6bda"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:18:00.780542 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.780597    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-cacerts" (OuterVolumeSpecName: "cacerts") pod "1d363bca-feac-4aa9-95e6-8cc733ea6bda" (UID: "1d363bca-feac-4aa9-95e6-8cc733ea6bda"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:18:00.780859 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.780713    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1d363bca-feac-4aa9-95e6-8cc733ea6bda" (UID: "1d363bca-feac-4aa9-95e6-8cc733ea6bda"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:18:00.781035 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.780874    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d363bca-feac-4aa9-95e6-8cc733ea6bda-kube-api-access-tkbn2" (OuterVolumeSpecName: "kube-api-access-tkbn2") pod "1d363bca-feac-4aa9-95e6-8cc733ea6bda" (UID: "1d363bca-feac-4aa9-95e6-8cc733ea6bda"). InnerVolumeSpecName "kube-api-access-tkbn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:18:00.781098 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.781057    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d363bca-feac-4aa9-95e6-8cc733ea6bda" (UID: "1d363bca-feac-4aa9-95e6-8cc733ea6bda"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:18:00.781442 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.781414    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1d363bca-feac-4aa9-95e6-8cc733ea6bda" (UID: "1d363bca-feac-4aa9-95e6-8cc733ea6bda"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:18:00.787780 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.787747    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f" event={"ID":"5cbbd24e-5945-4ef5-9b23-f95383e50e15","Type":"ContainerStarted","Data":"1c789f6c72f2ec49fc71f579afb10cd8f3f8db3705727e5859cbbcbc96731915"}
Jul 29 01:18:00.787875 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.787852    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f"
Jul 29 01:18:00.789482 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.789449    2558 generic.go:356] "Generic (PLEG): container finished" podID="1d363bca-feac-4aa9-95e6-8cc733ea6bda" containerID="78ca5b15d5b9c65b64ce982c8cf000b67b439be5edd7ee56a656d563099c0c77" exitCode=0
Jul 29 01:18:00.789597 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.789501    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"
Jul 29 01:18:00.789662 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.789503    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8" event={"ID":"1d363bca-feac-4aa9-95e6-8cc733ea6bda","Type":"ContainerDied","Data":"78ca5b15d5b9c65b64ce982c8cf000b67b439be5edd7ee56a656d563099c0c77"}
Jul 29 01:18:00.789662 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.789642    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8" event={"ID":"1d363bca-feac-4aa9-95e6-8cc733ea6bda","Type":"ContainerDied","Data":"53cac9576ef2558a09f46a60c425fde6dac0320eb2b96681275881acaa6b49b0"}
Jul 29 01:18:00.789778 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.789709    2558 scope.go:117] "RemoveContainer" containerID="78ca5b15d5b9c65b64ce982c8cf000b67b439be5edd7ee56a656d563099c0c77"
Jul 29 01:18:00.821535 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.821489    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f" podStartSLOduration=1.494221767 podStartE2EDuration="3.821473598s" totalImagesPullingTime="2.327251831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:18:00.805694265 +0000 UTC m=+510.306129719" watchObservedRunningTime="2026-07-29 01:18:00.821473598 +0000 UTC m=+510.321909049"
Jul 29 01:18:00.822051 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.822034    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"]
Jul 29 01:18:00.828489 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.828468    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9dnf8"]
Jul 29 01:18:00.879450 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.879427    2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-kubeconfig\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:18:00.879450 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.879449    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-csr-dns-cert\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:18:00.879450 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.879460    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d363bca-feac-4aa9-95e6-8cc733ea6bda-istio-token\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:18:00.879671 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.879472    2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d363bca-feac-4aa9-95e6-8cc733ea6bda-local-certs\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:18:00.879671 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.879483    2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1d363bca-feac-4aa9-95e6-8cc733ea6bda-cacerts\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:18:00.879671 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:00.879491    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkbn2\" (UniqueName: \"kubernetes.io/projected/1d363bca-feac-4aa9-95e6-8cc733ea6bda-kube-api-access-tkbn2\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:18:01.039968 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:01.039883    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d363bca-feac-4aa9-95e6-8cc733ea6bda" path="/var/lib/kubelet/pods/1d363bca-feac-4aa9-95e6-8cc733ea6bda/volumes"
Jul 29 01:18:01.147125 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:01.146953    2558 scope.go:117] "RemoveContainer" containerID="78ca5b15d5b9c65b64ce982c8cf000b67b439be5edd7ee56a656d563099c0c77"
Jul 29 01:18:01.147339 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:18:01.147318    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78ca5b15d5b9c65b64ce982c8cf000b67b439be5edd7ee56a656d563099c0c77\": container with ID starting with 78ca5b15d5b9c65b64ce982c8cf000b67b439be5edd7ee56a656d563099c0c77 not found: ID does not exist" containerID="78ca5b15d5b9c65b64ce982c8cf000b67b439be5edd7ee56a656d563099c0c77"
Jul 29 01:18:01.147391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:01.147349    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78ca5b15d5b9c65b64ce982c8cf000b67b439be5edd7ee56a656d563099c0c77"} err="failed to get container status \"78ca5b15d5b9c65b64ce982c8cf000b67b439be5edd7ee56a656d563099c0c77\": rpc error: code = NotFound desc = could not find container \"78ca5b15d5b9c65b64ce982c8cf000b67b439be5edd7ee56a656d563099c0c77\": container with ID starting with 78ca5b15d5b9c65b64ce982c8cf000b67b439be5edd7ee56a656d563099c0c77 not found: ID does not exist"
Jul 29 01:18:01.747055 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:01.747030    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gmv9g"
Jul 29 01:18:01.796584 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:01.796547    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg" event={"ID":"091d2f22-0009-46d4-8a04-cd4030ebd1f4","Type":"ContainerStarted","Data":"10c4d846f04ce54ecade9c5490169ae6a76829d2647cae2138f190527de861f4"}
Jul 29 01:18:01.796768 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:01.796718    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg"
Jul 29 01:18:01.815893 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:01.815849    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg" podStartSLOduration=1.821346645 podStartE2EDuration="4.815834569s" totalImagesPullingTime="2.994487924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:18:01.814060878 +0000 UTC m=+511.314496339" watchObservedRunningTime="2026-07-29 01:18:01.815834569 +0000 UTC m=+511.316270021"
Jul 29 01:18:03.264700 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:03.264659    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:03.332035 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:03.332003    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:31.803390 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:31.803358    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjz6f"
Jul 29 01:18:32.803485 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:32.803452    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bp7qg"
Jul 29 01:18:44.435326 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:44.435275    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:46.782828 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:46.782789    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:46.880962 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:46.880927    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:46.915115 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:46.915080    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n6bmx"]
Jul 29 01:18:46.915427 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:46.915413    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d363bca-feac-4aa9-95e6-8cc733ea6bda" containerName="discovery"
Jul 29 01:18:46.915487 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:46.915428    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d363bca-feac-4aa9-95e6-8cc733ea6bda" containerName="discovery"
Jul 29 01:18:46.915487 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:46.915478    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d363bca-feac-4aa9-95e6-8cc733ea6bda" containerName="discovery"
Jul 29 01:18:46.922838 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:46.922817    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n6bmx"
Jul 29 01:18:46.925859 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:46.925748    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 01:18:46.925859 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:46.925798    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 01:18:46.926924 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:46.926901    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fk7zl\""
Jul 29 01:18:46.929522 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:46.929502    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n6bmx"]
Jul 29 01:18:46.961384 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:46.961358    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:47.017286 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.017261    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvffm\" (UniqueName: \"kubernetes.io/projected/0a454503-4350-4845-ba64-241ded89ae2e-kube-api-access-bvffm\") pod \"kuadrant-operator-catalog-n6bmx\" (UID: \"0a454503-4350-4845-ba64-241ded89ae2e\") " pod="kuadrant-system/kuadrant-operator-catalog-n6bmx"
Jul 29 01:18:47.118213 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.118124    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvffm\" (UniqueName: \"kubernetes.io/projected/0a454503-4350-4845-ba64-241ded89ae2e-kube-api-access-bvffm\") pod \"kuadrant-operator-catalog-n6bmx\" (UID: \"0a454503-4350-4845-ba64-241ded89ae2e\") " pod="kuadrant-system/kuadrant-operator-catalog-n6bmx"
Jul 29 01:18:47.126529 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.126498    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvffm\" (UniqueName: \"kubernetes.io/projected/0a454503-4350-4845-ba64-241ded89ae2e-kube-api-access-bvffm\") pod \"kuadrant-operator-catalog-n6bmx\" (UID: \"0a454503-4350-4845-ba64-241ded89ae2e\") " pod="kuadrant-system/kuadrant-operator-catalog-n6bmx"
Jul 29 01:18:47.234383 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.234347    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n6bmx"
Jul 29 01:18:47.288604 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.288572    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n6bmx"]
Jul 29 01:18:47.358074 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.358051    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n6bmx"]
Jul 29 01:18:47.360747 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:18:47.360720    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a454503_4350_4845_ba64_241ded89ae2e.slice/crio-13ccc8e9b8587664083c6aad98e110cd70a22a1bb4c8703bfe756d87f218b85d WatchSource:0}: Error finding container 13ccc8e9b8587664083c6aad98e110cd70a22a1bb4c8703bfe756d87f218b85d: Status 404 returned error can't find the container with id 13ccc8e9b8587664083c6aad98e110cd70a22a1bb4c8703bfe756d87f218b85d
Jul 29 01:18:47.497823 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.497745    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-czcms"]
Jul 29 01:18:47.500405 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.500388    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-czcms"
Jul 29 01:18:47.509246 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.509215    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-czcms"]
Jul 29 01:18:47.623232 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.623200    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqh2l\" (UniqueName: \"kubernetes.io/projected/4b30dc6b-0333-4fad-beba-9e1afc342bd4-kube-api-access-vqh2l\") pod \"kuadrant-operator-catalog-czcms\" (UID: \"4b30dc6b-0333-4fad-beba-9e1afc342bd4\") " pod="kuadrant-system/kuadrant-operator-catalog-czcms"
Jul 29 01:18:47.722735 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.722703    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:47.723649 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.723630    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqh2l\" (UniqueName: \"kubernetes.io/projected/4b30dc6b-0333-4fad-beba-9e1afc342bd4-kube-api-access-vqh2l\") pod \"kuadrant-operator-catalog-czcms\" (UID: \"4b30dc6b-0333-4fad-beba-9e1afc342bd4\") " pod="kuadrant-system/kuadrant-operator-catalog-czcms"
Jul 29 01:18:47.731790 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.731766    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqh2l\" (UniqueName: \"kubernetes.io/projected/4b30dc6b-0333-4fad-beba-9e1afc342bd4-kube-api-access-vqh2l\") pod \"kuadrant-operator-catalog-czcms\" (UID: \"4b30dc6b-0333-4fad-beba-9e1afc342bd4\") " pod="kuadrant-system/kuadrant-operator-catalog-czcms"
Jul 29 01:18:47.810698 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.810660    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-czcms"
Jul 29 01:18:47.921007 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.920809    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:18:47.943635 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.943410    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-czcms"]
Jul 29 01:18:47.960606 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:18:47.960578    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b30dc6b_0333_4fad_beba_9e1afc342bd4.slice/crio-f3b66f654efdbffa45b2b5ff3703b68423f5d5674ad181385bae6ac2d2b19f8e WatchSource:0}: Error finding container f3b66f654efdbffa45b2b5ff3703b68423f5d5674ad181385bae6ac2d2b19f8e: Status 404 returned error can't find the container with id f3b66f654efdbffa45b2b5ff3703b68423f5d5674ad181385bae6ac2d2b19f8e
Jul 29 01:18:47.990711 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.990683    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n6bmx" event={"ID":"0a454503-4350-4845-ba64-241ded89ae2e","Type":"ContainerStarted","Data":"13ccc8e9b8587664083c6aad98e110cd70a22a1bb4c8703bfe756d87f218b85d"}
Jul 29 01:18:47.991798 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:47.991776    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-czcms" event={"ID":"4b30dc6b-0333-4fad-beba-9e1afc342bd4","Type":"ContainerStarted","Data":"f3b66f654efdbffa45b2b5ff3703b68423f5d5674ad181385bae6ac2d2b19f8e"}
Jul 29 01:18:50.002192 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:50.002137    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-czcms" event={"ID":"4b30dc6b-0333-4fad-beba-9e1afc342bd4","Type":"ContainerStarted","Data":"6d97ee87a29f1f9ff680bb9fb2cdd9f8bc8e48ffc74a89c1bb17dbe9eb902e18"}
Jul 29 01:18:50.003607 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:50.003583    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n6bmx" event={"ID":"0a454503-4350-4845-ba64-241ded89ae2e","Type":"ContainerStarted","Data":"53909e7f13240e8d444909063432f83c5054923c14360eb260d56786e58c097a"}
Jul 29 01:18:50.003716 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:50.003659    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-n6bmx" podUID="0a454503-4350-4845-ba64-241ded89ae2e" containerName="registry-server" containerID="cri-o://53909e7f13240e8d444909063432f83c5054923c14360eb260d56786e58c097a" gracePeriod=2
Jul 29 01:18:50.019024 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:50.018976    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-czcms" podStartSLOduration=1.716005032 podStartE2EDuration="3.01896047s" totalImagesPullingTime="1.302955438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:18:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:18:50.018067023 +0000 UTC m=+559.518502474" watchObservedRunningTime="2026-07-29 01:18:50.01896047 +0000 UTC m=+559.519395921"
Jul 29 01:18:50.247419 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:50.247392    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n6bmx"
Jul 29 01:18:50.345210 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:50.345157    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvffm\" (UniqueName: \"kubernetes.io/projected/0a454503-4350-4845-ba64-241ded89ae2e-kube-api-access-bvffm\") pod \"0a454503-4350-4845-ba64-241ded89ae2e\" (UID: \"0a454503-4350-4845-ba64-241ded89ae2e\") "
Jul 29 01:18:50.347321 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:50.347284    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a454503-4350-4845-ba64-241ded89ae2e-kube-api-access-bvffm" (OuterVolumeSpecName: "kube-api-access-bvffm") pod "0a454503-4350-4845-ba64-241ded89ae2e" (UID: "0a454503-4350-4845-ba64-241ded89ae2e"). InnerVolumeSpecName "kube-api-access-bvffm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:18:50.445915 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:50.445880    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvffm\" (UniqueName: \"kubernetes.io/projected/0a454503-4350-4845-ba64-241ded89ae2e-kube-api-access-bvffm\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:18:51.008744 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:51.008708    2558 generic.go:356] "Generic (PLEG): container finished" podID="0a454503-4350-4845-ba64-241ded89ae2e" containerID="53909e7f13240e8d444909063432f83c5054923c14360eb260d56786e58c097a" exitCode=0
Jul 29 01:18:51.009236 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:51.008756    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n6bmx"
Jul 29 01:18:51.009236 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:51.008788    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n6bmx" event={"ID":"0a454503-4350-4845-ba64-241ded89ae2e","Type":"ContainerDied","Data":"53909e7f13240e8d444909063432f83c5054923c14360eb260d56786e58c097a"}
Jul 29 01:18:51.009236 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:51.008839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n6bmx" event={"ID":"0a454503-4350-4845-ba64-241ded89ae2e","Type":"ContainerDied","Data":"13ccc8e9b8587664083c6aad98e110cd70a22a1bb4c8703bfe756d87f218b85d"}
Jul 29 01:18:51.009236 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:51.008861    2558 scope.go:117] "RemoveContainer" containerID="53909e7f13240e8d444909063432f83c5054923c14360eb260d56786e58c097a"
Jul 29 01:18:51.017063 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:51.017043    2558 scope.go:117] "RemoveContainer" containerID="53909e7f13240e8d444909063432f83c5054923c14360eb260d56786e58c097a"
Jul 29 01:18:51.017388 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:18:51.017370    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53909e7f13240e8d444909063432f83c5054923c14360eb260d56786e58c097a\": container with ID starting with 53909e7f13240e8d444909063432f83c5054923c14360eb260d56786e58c097a not found: ID does not exist" containerID="53909e7f13240e8d444909063432f83c5054923c14360eb260d56786e58c097a"
Jul 29 01:18:51.017443 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:51.017398    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53909e7f13240e8d444909063432f83c5054923c14360eb260d56786e58c097a"} err="failed to get container status \"53909e7f13240e8d444909063432f83c5054923c14360eb260d56786e58c097a\": rpc error: code = NotFound desc = could not find container \"53909e7f13240e8d444909063432f83c5054923c14360eb260d56786e58c097a\": container with ID starting with 53909e7f13240e8d444909063432f83c5054923c14360eb260d56786e58c097a not found: ID does not exist"
Jul 29 01:18:51.031449 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:51.031426    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n6bmx"]
Jul 29 01:18:51.036921 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:51.036903    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n6bmx"]
Jul 29 01:18:53.037159 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:53.037125    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a454503-4350-4845-ba64-241ded89ae2e" path="/var/lib/kubelet/pods/0a454503-4350-4845-ba64-241ded89ae2e/volumes"
Jul 29 01:18:57.810778 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:57.810748    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-czcms"
Jul 29 01:18:57.811287 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:57.810809    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-czcms"
Jul 29 01:18:57.831736 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:57.831711    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-czcms"
Jul 29 01:18:58.058075 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:18:58.058040    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-czcms"
Jul 29 01:19:00.651192 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:00.651136    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:00.738277 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:00.738242    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:02.499244 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.499204    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:02.539791 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.539761    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"]
Jul 29 01:19:02.540075 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.540060    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a454503-4350-4845-ba64-241ded89ae2e" containerName="registry-server"
Jul 29 01:19:02.540117 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.540077    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a454503-4350-4845-ba64-241ded89ae2e" containerName="registry-server"
Jul 29 01:19:02.540150 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.540133    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a454503-4350-4845-ba64-241ded89ae2e" containerName="registry-server"
Jul 29 01:19:02.543285 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.543264    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"
Jul 29 01:19:02.545900 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.545878    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l69wn\""
Jul 29 01:19:02.551798 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.551776    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"]
Jul 29 01:19:02.572712 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.572686    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:02.636863 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.636833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/118d8147-efc8-45ce-a1d2-82018f862ac5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv\" (UID: \"118d8147-efc8-45ce-a1d2-82018f862ac5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"
Jul 29 01:19:02.636972 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.636885    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/118d8147-efc8-45ce-a1d2-82018f862ac5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv\" (UID: \"118d8147-efc8-45ce-a1d2-82018f862ac5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"
Jul 29 01:19:02.636972 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.636945    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkrtc\" (UniqueName: \"kubernetes.io/projected/118d8147-efc8-45ce-a1d2-82018f862ac5-kube-api-access-pkrtc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv\" (UID: \"118d8147-efc8-45ce-a1d2-82018f862ac5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"
Jul 29 01:19:02.737935 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.737905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/118d8147-efc8-45ce-a1d2-82018f862ac5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv\" (UID: \"118d8147-efc8-45ce-a1d2-82018f862ac5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"
Jul 29 01:19:02.738062 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.737949    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/118d8147-efc8-45ce-a1d2-82018f862ac5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv\" (UID: \"118d8147-efc8-45ce-a1d2-82018f862ac5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"
Jul 29 01:19:02.738062 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.737987    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkrtc\" (UniqueName: \"kubernetes.io/projected/118d8147-efc8-45ce-a1d2-82018f862ac5-kube-api-access-pkrtc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv\" (UID: \"118d8147-efc8-45ce-a1d2-82018f862ac5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"
Jul 29 01:19:02.738319 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.738299    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/118d8147-efc8-45ce-a1d2-82018f862ac5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv\" (UID: \"118d8147-efc8-45ce-a1d2-82018f862ac5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"
Jul 29 01:19:02.738364 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.738337    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/118d8147-efc8-45ce-a1d2-82018f862ac5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv\" (UID: \"118d8147-efc8-45ce-a1d2-82018f862ac5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"
Jul 29 01:19:02.746990 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.746969    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkrtc\" (UniqueName: \"kubernetes.io/projected/118d8147-efc8-45ce-a1d2-82018f862ac5-kube-api-access-pkrtc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv\" (UID: \"118d8147-efc8-45ce-a1d2-82018f862ac5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"
Jul 29 01:19:02.851959 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.851931    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"
Jul 29 01:19:02.932408 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.932326    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"]
Jul 29 01:19:02.937201 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.937161    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"
Jul 29 01:19:02.946749 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.946707    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"]
Jul 29 01:19:02.978486 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:02.978449    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"]
Jul 29 01:19:02.981105 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:19:02.981083    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118d8147_efc8_45ce_a1d2_82018f862ac5.slice/crio-74751cfd330dc75c3ababaa96f646fd01b44cb2e5cde5a3016a0e369474f8844 WatchSource:0}: Error finding container 74751cfd330dc75c3ababaa96f646fd01b44cb2e5cde5a3016a0e369474f8844: Status 404 returned error can't find the container with id 74751cfd330dc75c3ababaa96f646fd01b44cb2e5cde5a3016a0e369474f8844
Jul 29 01:19:03.040093 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.040069    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bb9153-dac6-44bf-a94d-6ad2cc7df018-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc\" (UID: \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"
Jul 29 01:19:03.040231 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.040138    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bb9153-dac6-44bf-a94d-6ad2cc7df018-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc\" (UID: \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"
Jul 29 01:19:03.040302 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.040231    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6qx7\" (UniqueName: \"kubernetes.io/projected/60bb9153-dac6-44bf-a94d-6ad2cc7df018-kube-api-access-t6qx7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc\" (UID: \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"
Jul 29 01:19:03.058094 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.058064    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv" event={"ID":"118d8147-efc8-45ce-a1d2-82018f862ac5","Type":"ContainerStarted","Data":"56c0610c0392b150e8dde7c338bcc67502bb5f978cb7ea28c26d714da8a3da12"}
Jul 29 01:19:03.058248 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.058124    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv" event={"ID":"118d8147-efc8-45ce-a1d2-82018f862ac5","Type":"ContainerStarted","Data":"74751cfd330dc75c3ababaa96f646fd01b44cb2e5cde5a3016a0e369474f8844"}
Jul 29 01:19:03.141251 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.141189    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6qx7\" (UniqueName: \"kubernetes.io/projected/60bb9153-dac6-44bf-a94d-6ad2cc7df018-kube-api-access-t6qx7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc\" (UID: \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"
Jul 29 01:19:03.141251 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.141245    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bb9153-dac6-44bf-a94d-6ad2cc7df018-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc\" (UID: \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"
Jul 29 01:19:03.141402 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.141291    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bb9153-dac6-44bf-a94d-6ad2cc7df018-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc\" (UID: \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"
Jul 29 01:19:03.141597 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.141579    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bb9153-dac6-44bf-a94d-6ad2cc7df018-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc\" (UID: \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"
Jul 29 01:19:03.141666 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.141641    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bb9153-dac6-44bf-a94d-6ad2cc7df018-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc\" (UID: \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"
Jul 29 01:19:03.149849 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.149827    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6qx7\" (UniqueName: \"kubernetes.io/projected/60bb9153-dac6-44bf-a94d-6ad2cc7df018-kube-api-access-t6qx7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc\" (UID: \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"
Jul 29 01:19:03.247662 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.247622    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"
Jul 29 01:19:03.377373 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.377351    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"]
Jul 29 01:19:03.379440 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:19:03.379413    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60bb9153_dac6_44bf_a94d_6ad2cc7df018.slice/crio-fe724085dc1d35cde11eb81377274f39f870eb6a89cae618ec3ba3e469e533d7 WatchSource:0}: Error finding container fe724085dc1d35cde11eb81377274f39f870eb6a89cae618ec3ba3e469e533d7: Status 404 returned error can't find the container with id fe724085dc1d35cde11eb81377274f39f870eb6a89cae618ec3ba3e469e533d7
Jul 29 01:19:03.411701 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.411676    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"]
Jul 29 01:19:03.415649 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.415635    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"
Jul 29 01:19:03.426129 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.426101    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"]
Jul 29 01:19:03.544321 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.544292    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df35e547-f77b-4d99-b524-b81927058a29-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz\" (UID: \"df35e547-f77b-4d99-b524-b81927058a29\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"
Jul 29 01:19:03.544690 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.544350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgmps\" (UniqueName: \"kubernetes.io/projected/df35e547-f77b-4d99-b524-b81927058a29-kube-api-access-wgmps\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz\" (UID: \"df35e547-f77b-4d99-b524-b81927058a29\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"
Jul 29 01:19:03.544690 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.544400    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df35e547-f77b-4d99-b524-b81927058a29-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz\" (UID: \"df35e547-f77b-4d99-b524-b81927058a29\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"
Jul 29 01:19:03.645202 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.645101    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgmps\" (UniqueName: \"kubernetes.io/projected/df35e547-f77b-4d99-b524-b81927058a29-kube-api-access-wgmps\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz\" (UID: \"df35e547-f77b-4d99-b524-b81927058a29\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"
Jul 29 01:19:03.645202 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.645132    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df35e547-f77b-4d99-b524-b81927058a29-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz\" (UID: \"df35e547-f77b-4d99-b524-b81927058a29\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"
Jul 29 01:19:03.645475 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.645274    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df35e547-f77b-4d99-b524-b81927058a29-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz\" (UID: \"df35e547-f77b-4d99-b524-b81927058a29\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"
Jul 29 01:19:03.645577 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.645559    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df35e547-f77b-4d99-b524-b81927058a29-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz\" (UID: \"df35e547-f77b-4d99-b524-b81927058a29\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"
Jul 29 01:19:03.645610 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.645596    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df35e547-f77b-4d99-b524-b81927058a29-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz\" (UID: \"df35e547-f77b-4d99-b524-b81927058a29\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"
Jul 29 01:19:03.653750 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.653729    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgmps\" (UniqueName: \"kubernetes.io/projected/df35e547-f77b-4d99-b524-b81927058a29-kube-api-access-wgmps\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz\" (UID: \"df35e547-f77b-4d99-b524-b81927058a29\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"
Jul 29 01:19:03.726328 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.726301    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"
Jul 29 01:19:03.738966 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.738940    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"]
Jul 29 01:19:03.742581 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.742564    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"
Jul 29 01:19:03.752142 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.752116    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"]
Jul 29 01:19:03.846069 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.846036    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2\" (UID: \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"
Jul 29 01:19:03.846233 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.846088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2\" (UID: \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"
Jul 29 01:19:03.846233 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.846114    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgjtd\" (UniqueName: \"kubernetes.io/projected/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-kube-api-access-bgjtd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2\" (UID: \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"
Jul 29 01:19:03.857985 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.857927    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"]
Jul 29 01:19:03.860090 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:19:03.860065    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf35e547_f77b_4d99_b524_b81927058a29.slice/crio-c290a6fd4ee72dd092167a3166d0c5d67d20d5e2d5074a7a55052bb7dd1a082b WatchSource:0}: Error finding container c290a6fd4ee72dd092167a3166d0c5d67d20d5e2d5074a7a55052bb7dd1a082b: Status 404 returned error can't find the container with id c290a6fd4ee72dd092167a3166d0c5d67d20d5e2d5074a7a55052bb7dd1a082b
Jul 29 01:19:03.947256 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.947224    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2\" (UID: \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"
Jul 29 01:19:03.947419 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.947284    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2\" (UID: \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"
Jul 29 01:19:03.947419 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.947313    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgjtd\" (UniqueName: \"kubernetes.io/projected/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-kube-api-access-bgjtd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2\" (UID: \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"
Jul 29 01:19:03.947684 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.947665    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2\" (UID: \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"
Jul 29 01:19:03.947731 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.947713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2\" (UID: \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"
Jul 29 01:19:03.957209 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:03.957163    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgjtd\" (UniqueName: \"kubernetes.io/projected/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-kube-api-access-bgjtd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2\" (UID: \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"
Jul 29 01:19:04.063999 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:04.063965    2558 generic.go:356] "Generic (PLEG): container finished" podID="60bb9153-dac6-44bf-a94d-6ad2cc7df018" containerID="ba8a519b3e1ef753a9f529255f0892a46a3698b7b65a5bd15157b51aaf6be3f5" exitCode=0
Jul 29 01:19:04.064202 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:04.063996    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc" event={"ID":"60bb9153-dac6-44bf-a94d-6ad2cc7df018","Type":"ContainerDied","Data":"ba8a519b3e1ef753a9f529255f0892a46a3698b7b65a5bd15157b51aaf6be3f5"}
Jul 29 01:19:04.064202 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:04.064052    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc" event={"ID":"60bb9153-dac6-44bf-a94d-6ad2cc7df018","Type":"ContainerStarted","Data":"fe724085dc1d35cde11eb81377274f39f870eb6a89cae618ec3ba3e469e533d7"}
Jul 29 01:19:04.065860 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:04.065837    2558 generic.go:356] "Generic (PLEG): container finished" podID="118d8147-efc8-45ce-a1d2-82018f862ac5" containerID="56c0610c0392b150e8dde7c338bcc67502bb5f978cb7ea28c26d714da8a3da12" exitCode=0
Jul 29 01:19:04.065947 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:04.065918    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv" event={"ID":"118d8147-efc8-45ce-a1d2-82018f862ac5","Type":"ContainerDied","Data":"56c0610c0392b150e8dde7c338bcc67502bb5f978cb7ea28c26d714da8a3da12"}
Jul 29 01:19:04.067570 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:04.067546    2558 generic.go:356] "Generic (PLEG): container finished" podID="df35e547-f77b-4d99-b524-b81927058a29" containerID="20ef69dd4e2b09ea8c56449ebb40ac7d5dd5ce6237d13b0a4ff8299eded12fb4" exitCode=0
Jul 29 01:19:04.067683 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:04.067610    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz" event={"ID":"df35e547-f77b-4d99-b524-b81927058a29","Type":"ContainerDied","Data":"20ef69dd4e2b09ea8c56449ebb40ac7d5dd5ce6237d13b0a4ff8299eded12fb4"}
Jul 29 01:19:04.067683 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:04.067648    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz" event={"ID":"df35e547-f77b-4d99-b524-b81927058a29","Type":"ContainerStarted","Data":"c290a6fd4ee72dd092167a3166d0c5d67d20d5e2d5074a7a55052bb7dd1a082b"}
Jul 29 01:19:04.068858 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:04.068838    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"
Jul 29 01:19:04.208842 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:04.208686    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"]
Jul 29 01:19:04.211425 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:19:04.211396    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b3d49c7_6d36_4903_8313_6f4cd3b8dcc5.slice/crio-2f0fed8de92aa956f62eb391e6becf5dd3d238a5de73c763f1fcd9b036084c04 WatchSource:0}: Error finding container 2f0fed8de92aa956f62eb391e6becf5dd3d238a5de73c763f1fcd9b036084c04: Status 404 returned error can't find the container with id 2f0fed8de92aa956f62eb391e6becf5dd3d238a5de73c763f1fcd9b036084c04
Jul 29 01:19:05.074826 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:05.074801    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc" event={"ID":"60bb9153-dac6-44bf-a94d-6ad2cc7df018","Type":"ContainerStarted","Data":"92dc04e6ff7c6f13951f58bd4e987a947f118ae5124fe16ed12494a6f230724b"}
Jul 29 01:19:05.076720 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:05.076688    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv" event={"ID":"118d8147-efc8-45ce-a1d2-82018f862ac5","Type":"ContainerStarted","Data":"369a7be87c1b916c4d65418d99fee974384df0d1e24564ab27c3c79646d6e628"}
Jul 29 01:19:05.078925 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:05.078900    2558 generic.go:356] "Generic (PLEG): container finished" podID="df35e547-f77b-4d99-b524-b81927058a29" containerID="39f9d0c3da291dbd6f44746b1843af3a5f92ea548d5180c7b9b98d93c4734085" exitCode=0
Jul 29 01:19:05.079038 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:05.078989    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz" event={"ID":"df35e547-f77b-4d99-b524-b81927058a29","Type":"ContainerDied","Data":"39f9d0c3da291dbd6f44746b1843af3a5f92ea548d5180c7b9b98d93c4734085"}
Jul 29 01:19:05.081165 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:05.081033    2558 generic.go:356] "Generic (PLEG): container finished" podID="8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5" containerID="f1eef872c0f18a29abc0fb63efb092d6c05864c62442a67909de7afb17eb905c" exitCode=0
Jul 29 01:19:05.081165 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:05.081102    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2" event={"ID":"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5","Type":"ContainerDied","Data":"f1eef872c0f18a29abc0fb63efb092d6c05864c62442a67909de7afb17eb905c"}
Jul 29 01:19:05.081165 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:05.081137    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2" event={"ID":"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5","Type":"ContainerStarted","Data":"2f0fed8de92aa956f62eb391e6becf5dd3d238a5de73c763f1fcd9b036084c04"}
Jul 29 01:19:06.087466 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:06.087438    2558 generic.go:356] "Generic (PLEG): container finished" podID="118d8147-efc8-45ce-a1d2-82018f862ac5" containerID="369a7be87c1b916c4d65418d99fee974384df0d1e24564ab27c3c79646d6e628" exitCode=0
Jul 29 01:19:06.087830 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:06.087515    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv" event={"ID":"118d8147-efc8-45ce-a1d2-82018f862ac5","Type":"ContainerDied","Data":"369a7be87c1b916c4d65418d99fee974384df0d1e24564ab27c3c79646d6e628"}
Jul 29 01:19:06.089737 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:06.089710    2558 generic.go:356] "Generic (PLEG): container finished" podID="df35e547-f77b-4d99-b524-b81927058a29" containerID="bde70925a8bd96b834ca1bff21504072eba600af9731def75ea3c974f57716e5" exitCode=0
Jul 29 01:19:06.089843 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:06.089788    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz" event={"ID":"df35e547-f77b-4d99-b524-b81927058a29","Type":"ContainerDied","Data":"bde70925a8bd96b834ca1bff21504072eba600af9731def75ea3c974f57716e5"}
Jul 29 01:19:06.091602 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:06.091583    2558 generic.go:356] "Generic (PLEG): container finished" podID="8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5" containerID="9a42cae8f4a786509bc348edfb11dbefe64d615078936c3da321edaf52856750" exitCode=0
Jul 29 01:19:06.091710 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:06.091661    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2" event={"ID":"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5","Type":"ContainerDied","Data":"9a42cae8f4a786509bc348edfb11dbefe64d615078936c3da321edaf52856750"}
Jul 29 01:19:06.093820 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:06.093800    2558 generic.go:356] "Generic (PLEG): container finished" podID="60bb9153-dac6-44bf-a94d-6ad2cc7df018" containerID="92dc04e6ff7c6f13951f58bd4e987a947f118ae5124fe16ed12494a6f230724b" exitCode=0
Jul 29 01:19:06.093942 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:06.093829    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc" event={"ID":"60bb9153-dac6-44bf-a94d-6ad2cc7df018","Type":"ContainerDied","Data":"92dc04e6ff7c6f13951f58bd4e987a947f118ae5124fe16ed12494a6f230724b"}
Jul 29 01:19:07.103768 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.103729    2558 generic.go:356] "Generic (PLEG): container finished" podID="8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5" containerID="e79580f60bb9b9d4d88dcaa54e95473c3cf848adfe048f381b93a95b566cd4ad" exitCode=0
Jul 29 01:19:07.104238 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.103853    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2" event={"ID":"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5","Type":"ContainerDied","Data":"e79580f60bb9b9d4d88dcaa54e95473c3cf848adfe048f381b93a95b566cd4ad"}
Jul 29 01:19:07.105777 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.105753    2558 generic.go:356] "Generic (PLEG): container finished" podID="60bb9153-dac6-44bf-a94d-6ad2cc7df018" containerID="7f5edfd6b4b9d8d3aceab504686c6ed889fc8a25149738f4ca753bff80ffd592" exitCode=0
Jul 29 01:19:07.105876 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.105830    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc" event={"ID":"60bb9153-dac6-44bf-a94d-6ad2cc7df018","Type":"ContainerDied","Data":"7f5edfd6b4b9d8d3aceab504686c6ed889fc8a25149738f4ca753bff80ffd592"}
Jul 29 01:19:07.107698 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.107677    2558 generic.go:356] "Generic (PLEG): container finished" podID="118d8147-efc8-45ce-a1d2-82018f862ac5" containerID="cf5a567b9b2c193554ef3fc207baaea9a59ccb01b60cf645c4cd9e95e3c3fa97" exitCode=0
Jul 29 01:19:07.107806 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.107754    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv" event={"ID":"118d8147-efc8-45ce-a1d2-82018f862ac5","Type":"ContainerDied","Data":"cf5a567b9b2c193554ef3fc207baaea9a59ccb01b60cf645c4cd9e95e3c3fa97"}
Jul 29 01:19:07.233627 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.233604    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"
Jul 29 01:19:07.376789 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.376707    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df35e547-f77b-4d99-b524-b81927058a29-bundle\") pod \"df35e547-f77b-4d99-b524-b81927058a29\" (UID: \"df35e547-f77b-4d99-b524-b81927058a29\") "
Jul 29 01:19:07.376789 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.376743    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgmps\" (UniqueName: \"kubernetes.io/projected/df35e547-f77b-4d99-b524-b81927058a29-kube-api-access-wgmps\") pod \"df35e547-f77b-4d99-b524-b81927058a29\" (UID: \"df35e547-f77b-4d99-b524-b81927058a29\") "
Jul 29 01:19:07.377009 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.376792    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df35e547-f77b-4d99-b524-b81927058a29-util\") pod \"df35e547-f77b-4d99-b524-b81927058a29\" (UID: \"df35e547-f77b-4d99-b524-b81927058a29\") "
Jul 29 01:19:07.377411 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.377383    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df35e547-f77b-4d99-b524-b81927058a29-bundle" (OuterVolumeSpecName: "bundle") pod "df35e547-f77b-4d99-b524-b81927058a29" (UID: "df35e547-f77b-4d99-b524-b81927058a29"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:07.378827 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.378803    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df35e547-f77b-4d99-b524-b81927058a29-kube-api-access-wgmps" (OuterVolumeSpecName: "kube-api-access-wgmps") pod "df35e547-f77b-4d99-b524-b81927058a29" (UID: "df35e547-f77b-4d99-b524-b81927058a29"). InnerVolumeSpecName "kube-api-access-wgmps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:19:07.381968 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.381937    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df35e547-f77b-4d99-b524-b81927058a29-util" (OuterVolumeSpecName: "util") pod "df35e547-f77b-4d99-b524-b81927058a29" (UID: "df35e547-f77b-4d99-b524-b81927058a29"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:07.477342 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.477312    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df35e547-f77b-4d99-b524-b81927058a29-bundle\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:07.477342 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.477337    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgmps\" (UniqueName: \"kubernetes.io/projected/df35e547-f77b-4d99-b524-b81927058a29-kube-api-access-wgmps\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:07.477342 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:07.477347    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df35e547-f77b-4d99-b524-b81927058a29-util\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:08.113941 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.113915    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz"
Jul 29 01:19:08.114386 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.113941    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz" event={"ID":"df35e547-f77b-4d99-b524-b81927058a29","Type":"ContainerDied","Data":"c290a6fd4ee72dd092167a3166d0c5d67d20d5e2d5074a7a55052bb7dd1a082b"}
Jul 29 01:19:08.114386 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.113985    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c290a6fd4ee72dd092167a3166d0c5d67d20d5e2d5074a7a55052bb7dd1a082b"
Jul 29 01:19:08.266586 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.266567    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"
Jul 29 01:19:08.269464 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.269446    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"
Jul 29 01:19:08.297136 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.297118    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"
Jul 29 01:19:08.387195 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.387089    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/118d8147-efc8-45ce-a1d2-82018f862ac5-util\") pod \"118d8147-efc8-45ce-a1d2-82018f862ac5\" (UID: \"118d8147-efc8-45ce-a1d2-82018f862ac5\") "
Jul 29 01:19:08.387195 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.387137    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/118d8147-efc8-45ce-a1d2-82018f862ac5-bundle\") pod \"118d8147-efc8-45ce-a1d2-82018f862ac5\" (UID: \"118d8147-efc8-45ce-a1d2-82018f862ac5\") "
Jul 29 01:19:08.387195 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.387169    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6qx7\" (UniqueName: \"kubernetes.io/projected/60bb9153-dac6-44bf-a94d-6ad2cc7df018-kube-api-access-t6qx7\") pod \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\" (UID: \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\") "
Jul 29 01:19:08.387450 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.387226    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgjtd\" (UniqueName: \"kubernetes.io/projected/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-kube-api-access-bgjtd\") pod \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\" (UID: \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\") "
Jul 29 01:19:08.387450 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.387279    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bb9153-dac6-44bf-a94d-6ad2cc7df018-util\") pod \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\" (UID: \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\") "
Jul 29 01:19:08.387450 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.387318    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-bundle\") pod \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\" (UID: \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\") "
Jul 29 01:19:08.387450 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.387342    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-util\") pod \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\" (UID: \"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5\") "
Jul 29 01:19:08.387450 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.387378    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkrtc\" (UniqueName: \"kubernetes.io/projected/118d8147-efc8-45ce-a1d2-82018f862ac5-kube-api-access-pkrtc\") pod \"118d8147-efc8-45ce-a1d2-82018f862ac5\" (UID: \"118d8147-efc8-45ce-a1d2-82018f862ac5\") "
Jul 29 01:19:08.387450 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.387412    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bb9153-dac6-44bf-a94d-6ad2cc7df018-bundle\") pod \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\" (UID: \"60bb9153-dac6-44bf-a94d-6ad2cc7df018\") "
Jul 29 01:19:08.387778 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.387752    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/118d8147-efc8-45ce-a1d2-82018f862ac5-bundle" (OuterVolumeSpecName: "bundle") pod "118d8147-efc8-45ce-a1d2-82018f862ac5" (UID: "118d8147-efc8-45ce-a1d2-82018f862ac5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:08.388051 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.388021    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-bundle" (OuterVolumeSpecName: "bundle") pod "8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5" (UID: "8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:08.388680 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.388639    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60bb9153-dac6-44bf-a94d-6ad2cc7df018-bundle" (OuterVolumeSpecName: "bundle") pod "60bb9153-dac6-44bf-a94d-6ad2cc7df018" (UID: "60bb9153-dac6-44bf-a94d-6ad2cc7df018"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:08.389849 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.389825    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/118d8147-efc8-45ce-a1d2-82018f862ac5-kube-api-access-pkrtc" (OuterVolumeSpecName: "kube-api-access-pkrtc") pod "118d8147-efc8-45ce-a1d2-82018f862ac5" (UID: "118d8147-efc8-45ce-a1d2-82018f862ac5"). InnerVolumeSpecName "kube-api-access-pkrtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:19:08.389980 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.389918    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-kube-api-access-bgjtd" (OuterVolumeSpecName: "kube-api-access-bgjtd") pod "8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5" (UID: "8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5"). InnerVolumeSpecName "kube-api-access-bgjtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:19:08.389980 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.389970    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60bb9153-dac6-44bf-a94d-6ad2cc7df018-kube-api-access-t6qx7" (OuterVolumeSpecName: "kube-api-access-t6qx7") pod "60bb9153-dac6-44bf-a94d-6ad2cc7df018" (UID: "60bb9153-dac6-44bf-a94d-6ad2cc7df018"). InnerVolumeSpecName "kube-api-access-t6qx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:19:08.393827 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.393802    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60bb9153-dac6-44bf-a94d-6ad2cc7df018-util" (OuterVolumeSpecName: "util") pod "60bb9153-dac6-44bf-a94d-6ad2cc7df018" (UID: "60bb9153-dac6-44bf-a94d-6ad2cc7df018"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:08.394036 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.394015    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/118d8147-efc8-45ce-a1d2-82018f862ac5-util" (OuterVolumeSpecName: "util") pod "118d8147-efc8-45ce-a1d2-82018f862ac5" (UID: "118d8147-efc8-45ce-a1d2-82018f862ac5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:08.395910 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.395886    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-util" (OuterVolumeSpecName: "util") pod "8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5" (UID: "8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:08.488440 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.488415    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/118d8147-efc8-45ce-a1d2-82018f862ac5-util\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:08.488440 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.488436    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/118d8147-efc8-45ce-a1d2-82018f862ac5-bundle\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:08.488569 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.488445    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6qx7\" (UniqueName: \"kubernetes.io/projected/60bb9153-dac6-44bf-a94d-6ad2cc7df018-kube-api-access-t6qx7\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:08.488569 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.488456    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgjtd\" (UniqueName: \"kubernetes.io/projected/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-kube-api-access-bgjtd\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:08.488569 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.488464    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bb9153-dac6-44bf-a94d-6ad2cc7df018-util\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:08.488569 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.488473    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-bundle\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:08.488569 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.488480    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5-util\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:08.488569 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.488487    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkrtc\" (UniqueName: \"kubernetes.io/projected/118d8147-efc8-45ce-a1d2-82018f862ac5-kube-api-access-pkrtc\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:08.488569 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:08.488495    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bb9153-dac6-44bf-a94d-6ad2cc7df018-bundle\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:09.120824 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:09.120792    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2"
Jul 29 01:19:09.120824 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:09.120805    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2" event={"ID":"8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5","Type":"ContainerDied","Data":"2f0fed8de92aa956f62eb391e6becf5dd3d238a5de73c763f1fcd9b036084c04"}
Jul 29 01:19:09.121290 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:09.120848    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f0fed8de92aa956f62eb391e6becf5dd3d238a5de73c763f1fcd9b036084c04"
Jul 29 01:19:09.122747 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:09.122725    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc"
Jul 29 01:19:09.122886 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:09.122756    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc" event={"ID":"60bb9153-dac6-44bf-a94d-6ad2cc7df018","Type":"ContainerDied","Data":"fe724085dc1d35cde11eb81377274f39f870eb6a89cae618ec3ba3e469e533d7"}
Jul 29 01:19:09.122886 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:09.122797    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe724085dc1d35cde11eb81377274f39f870eb6a89cae618ec3ba3e469e533d7"
Jul 29 01:19:09.124949 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:09.124925    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv" event={"ID":"118d8147-efc8-45ce-a1d2-82018f862ac5","Type":"ContainerDied","Data":"74751cfd330dc75c3ababaa96f646fd01b44cb2e5cde5a3016a0e369474f8844"}
Jul 29 01:19:09.125037 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:09.124954    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv"
Jul 29 01:19:09.125037 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:09.124961    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74751cfd330dc75c3ababaa96f646fd01b44cb2e5cde5a3016a0e369474f8844"
Jul 29 01:19:15.354225 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:15.354188    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:18.824944 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:18.824911    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:20.238260 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238230    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"]
Jul 29 01:19:20.238623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238521    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="118d8147-efc8-45ce-a1d2-82018f862ac5" containerName="pull"
Jul 29 01:19:20.238623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238536    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="118d8147-efc8-45ce-a1d2-82018f862ac5" containerName="pull"
Jul 29 01:19:20.238623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238547    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df35e547-f77b-4d99-b524-b81927058a29" containerName="extract"
Jul 29 01:19:20.238623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238554    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="df35e547-f77b-4d99-b524-b81927058a29" containerName="extract"
Jul 29 01:19:20.238623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238560    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="118d8147-efc8-45ce-a1d2-82018f862ac5" containerName="extract"
Jul 29 01:19:20.238623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238567    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="118d8147-efc8-45ce-a1d2-82018f862ac5" containerName="extract"
Jul 29 01:19:20.238623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238573    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5" containerName="extract"
Jul 29 01:19:20.238623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238579    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5" containerName="extract"
Jul 29 01:19:20.238623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238588    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5" containerName="pull"
Jul 29 01:19:20.238623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238593    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5" containerName="pull"
Jul 29 01:19:20.238623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238601    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bb9153-dac6-44bf-a94d-6ad2cc7df018" containerName="extract"
Jul 29 01:19:20.238623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238610    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bb9153-dac6-44bf-a94d-6ad2cc7df018" containerName="extract"
Jul 29 01:19:20.238623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238620    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="118d8147-efc8-45ce-a1d2-82018f862ac5" containerName="util"
Jul 29 01:19:20.238623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238625    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="118d8147-efc8-45ce-a1d2-82018f862ac5" containerName="util"
Jul 29 01:19:20.239053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238634    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bb9153-dac6-44bf-a94d-6ad2cc7df018" containerName="util"
Jul 29 01:19:20.239053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238639    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bb9153-dac6-44bf-a94d-6ad2cc7df018" containerName="util"
Jul 29 01:19:20.239053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238646    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bb9153-dac6-44bf-a94d-6ad2cc7df018" containerName="pull"
Jul 29 01:19:20.239053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238652    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bb9153-dac6-44bf-a94d-6ad2cc7df018" containerName="pull"
Jul 29 01:19:20.239053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238661    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df35e547-f77b-4d99-b524-b81927058a29" containerName="util"
Jul 29 01:19:20.239053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238666    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="df35e547-f77b-4d99-b524-b81927058a29" containerName="util"
Jul 29 01:19:20.239053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238672    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5" containerName="util"
Jul 29 01:19:20.239053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238677    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5" containerName="util"
Jul 29 01:19:20.239053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238688    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df35e547-f77b-4d99-b524-b81927058a29" containerName="pull"
Jul 29 01:19:20.239053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238696    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="df35e547-f77b-4d99-b524-b81927058a29" containerName="pull"
Jul 29 01:19:20.239053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238742    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="60bb9153-dac6-44bf-a94d-6ad2cc7df018" containerName="extract"
Jul 29 01:19:20.239053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238751    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5" containerName="extract"
Jul 29 01:19:20.239053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238757    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="df35e547-f77b-4d99-b524-b81927058a29" containerName="extract"
Jul 29 01:19:20.239053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.238765    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="118d8147-efc8-45ce-a1d2-82018f862ac5" containerName="extract"
Jul 29 01:19:20.246578 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.246562    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:20.250280 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.250258    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xmxjt\""
Jul 29 01:19:20.255797 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.255775    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"]
Jul 29 01:19:20.292832 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.292800    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx4pm\" (UniqueName: \"kubernetes.io/projected/6841abc6-b5ca-4132-a10a-9e5655cde723-kube-api-access-jx4pm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9pcjf\" (UID: \"6841abc6-b5ca-4132-a10a-9e5655cde723\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:20.292977 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.292890    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6841abc6-b5ca-4132-a10a-9e5655cde723-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9pcjf\" (UID: \"6841abc6-b5ca-4132-a10a-9e5655cde723\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:20.360638 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.360593    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:20.393906 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.393880    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx4pm\" (UniqueName: \"kubernetes.io/projected/6841abc6-b5ca-4132-a10a-9e5655cde723-kube-api-access-jx4pm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9pcjf\" (UID: \"6841abc6-b5ca-4132-a10a-9e5655cde723\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:20.394074 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.393946    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6841abc6-b5ca-4132-a10a-9e5655cde723-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9pcjf\" (UID: \"6841abc6-b5ca-4132-a10a-9e5655cde723\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:20.394575 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.394310    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6841abc6-b5ca-4132-a10a-9e5655cde723-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9pcjf\" (UID: \"6841abc6-b5ca-4132-a10a-9e5655cde723\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:20.403130 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.403105    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx4pm\" (UniqueName: \"kubernetes.io/projected/6841abc6-b5ca-4132-a10a-9e5655cde723-kube-api-access-jx4pm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9pcjf\" (UID: \"6841abc6-b5ca-4132-a10a-9e5655cde723\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:20.556924 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.556892    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:20.685485 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:20.685460    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"]
Jul 29 01:19:20.688397 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:19:20.688361    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6841abc6_b5ca_4132_a10a_9e5655cde723.slice/crio-474905b59e668c5fbfb758f86642fa7e04ec9d923b410ffb48eecacabc114281 WatchSource:0}: Error finding container 474905b59e668c5fbfb758f86642fa7e04ec9d923b410ffb48eecacabc114281: Status 404 returned error can't find the container with id 474905b59e668c5fbfb758f86642fa7e04ec9d923b410ffb48eecacabc114281
Jul 29 01:19:21.179002 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:21.178967    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf" event={"ID":"6841abc6-b5ca-4132-a10a-9e5655cde723","Type":"ContainerStarted","Data":"474905b59e668c5fbfb758f86642fa7e04ec9d923b410ffb48eecacabc114281"}
Jul 29 01:19:21.558724 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:21.558685    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:21.830807 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:21.830727    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:22.690910 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:22.690870    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v5h4f"]
Jul 29 01:19:22.694626 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:22.694603    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v5h4f"
Jul 29 01:19:22.699202 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:22.699168    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2dbw7\""
Jul 29 01:19:22.712914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:22.712887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq66x\" (UniqueName: \"kubernetes.io/projected/f71fa537-a9af-4353-b95e-61c99ca59ccf-kube-api-access-wq66x\") pod \"authorino-operator-75cc8d5cb7-v5h4f\" (UID: \"f71fa537-a9af-4353-b95e-61c99ca59ccf\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v5h4f"
Jul 29 01:19:22.715553 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:22.715529    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v5h4f"]
Jul 29 01:19:22.813995 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:22.813965    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq66x\" (UniqueName: \"kubernetes.io/projected/f71fa537-a9af-4353-b95e-61c99ca59ccf-kube-api-access-wq66x\") pod \"authorino-operator-75cc8d5cb7-v5h4f\" (UID: \"f71fa537-a9af-4353-b95e-61c99ca59ccf\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v5h4f"
Jul 29 01:19:22.838614 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:22.838584    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq66x\" (UniqueName: \"kubernetes.io/projected/f71fa537-a9af-4353-b95e-61c99ca59ccf-kube-api-access-wq66x\") pod \"authorino-operator-75cc8d5cb7-v5h4f\" (UID: \"f71fa537-a9af-4353-b95e-61c99ca59ccf\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v5h4f"
Jul 29 01:19:23.008406 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:23.008326    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v5h4f"
Jul 29 01:19:23.179290 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:23.179264    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v5h4f"]
Jul 29 01:19:23.181293 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:19:23.181265    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf71fa537_a9af_4353_b95e_61c99ca59ccf.slice/crio-0ce459c1dd39a1d5b45fb81ff51b62853d11baf468a0524f590288d84b1468a2 WatchSource:0}: Error finding container 0ce459c1dd39a1d5b45fb81ff51b62853d11baf468a0524f590288d84b1468a2: Status 404 returned error can't find the container with id 0ce459c1dd39a1d5b45fb81ff51b62853d11baf468a0524f590288d84b1468a2
Jul 29 01:19:23.192155 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:23.192123    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v5h4f" event={"ID":"f71fa537-a9af-4353-b95e-61c99ca59ccf","Type":"ContainerStarted","Data":"0ce459c1dd39a1d5b45fb81ff51b62853d11baf468a0524f590288d84b1468a2"}
Jul 29 01:19:23.422037 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:23.422000    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:23.570639 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:23.570595    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:24.908264 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:24.908221    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pkbv4"]
Jul 29 01:19:24.911835 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:24.911811    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pkbv4"
Jul 29 01:19:24.914548 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:24.914523    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cg6hd\""
Jul 29 01:19:24.914548 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:24.914545    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 29 01:19:24.923306 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:24.923281    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pkbv4"]
Jul 29 01:19:24.932839 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:24.932810    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnkmt\" (UniqueName: \"kubernetes.io/projected/2978bb74-da9e-4a5c-86d2-70650fe5400e-kube-api-access-fnkmt\") pod \"dns-operator-controller-manager-864dd78c4c-pkbv4\" (UID: \"2978bb74-da9e-4a5c-86d2-70650fe5400e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pkbv4"
Jul 29 01:19:25.033633 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:25.033591    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnkmt\" (UniqueName: \"kubernetes.io/projected/2978bb74-da9e-4a5c-86d2-70650fe5400e-kube-api-access-fnkmt\") pod \"dns-operator-controller-manager-864dd78c4c-pkbv4\" (UID: \"2978bb74-da9e-4a5c-86d2-70650fe5400e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pkbv4"
Jul 29 01:19:25.045024 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:25.044995    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnkmt\" (UniqueName: \"kubernetes.io/projected/2978bb74-da9e-4a5c-86d2-70650fe5400e-kube-api-access-fnkmt\") pod \"dns-operator-controller-manager-864dd78c4c-pkbv4\" (UID: \"2978bb74-da9e-4a5c-86d2-70650fe5400e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pkbv4"
Jul 29 01:19:25.225750 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:25.225661    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pkbv4"
Jul 29 01:19:25.537098 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:25.537063    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:26.431344 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:26.431322    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pkbv4"]
Jul 29 01:19:26.432993 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:19:26.432963    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2978bb74_da9e_4a5c_86d2_70650fe5400e.slice/crio-6e6d4fd27667b77445707f65c548250fb343290dba861f52649a77cf5b686d8d WatchSource:0}: Error finding container 6e6d4fd27667b77445707f65c548250fb343290dba861f52649a77cf5b686d8d: Status 404 returned error can't find the container with id 6e6d4fd27667b77445707f65c548250fb343290dba861f52649a77cf5b686d8d
Jul 29 01:19:27.138190 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.138147    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"]
Jul 29 01:19:27.142597 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.142575    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"
Jul 29 01:19:27.145405 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.145247    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zmnsb\""
Jul 29 01:19:27.151781 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.151752    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"]
Jul 29 01:19:27.152063 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.151978    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxdxx\" (UniqueName: \"kubernetes.io/projected/74e456f2-cb84-46ff-b42f-463538e6fedd-kube-api-access-hxdxx\") pod \"limitador-operator-controller-manager-859d7b78bd-sg6t4\" (UID: \"74e456f2-cb84-46ff-b42f-463538e6fedd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"
Jul 29 01:19:27.215359 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.215321    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pkbv4" event={"ID":"2978bb74-da9e-4a5c-86d2-70650fe5400e","Type":"ContainerStarted","Data":"6e6d4fd27667b77445707f65c548250fb343290dba861f52649a77cf5b686d8d"}
Jul 29 01:19:27.216803 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.216777    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v5h4f" event={"ID":"f71fa537-a9af-4353-b95e-61c99ca59ccf","Type":"ContainerStarted","Data":"30ced09d6f71bc522864947eb3f524ed9aa034efdd6caa56f04e79ed142177fd"}
Jul 29 01:19:27.216944 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.216859    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v5h4f"
Jul 29 01:19:27.218293 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.218272    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf" event={"ID":"6841abc6-b5ca-4132-a10a-9e5655cde723","Type":"ContainerStarted","Data":"acff88c5ef5befae547ff3c7ab483bee9976932bd0f7da550249474daf24fbd2"}
Jul 29 01:19:27.218410 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.218397    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:27.234828 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.234780    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v5h4f" podStartSLOduration=2.062823877 podStartE2EDuration="5.234765897s" totalImagesPullingTime="3.17194202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:27.233026487 +0000 UTC m=+596.733461941" watchObservedRunningTime="2026-07-29 01:19:27.234765897 +0000 UTC m=+596.735201382"
Jul 29 01:19:27.252578 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.252548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxdxx\" (UniqueName: \"kubernetes.io/projected/74e456f2-cb84-46ff-b42f-463538e6fedd-kube-api-access-hxdxx\") pod \"limitador-operator-controller-manager-859d7b78bd-sg6t4\" (UID: \"74e456f2-cb84-46ff-b42f-463538e6fedd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"
Jul 29 01:19:27.253051 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.252997    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf" podStartSLOduration=1.595785934 podStartE2EDuration="7.25297855s" totalImagesPullingTime="5.657192616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:27.250999877 +0000 UTC m=+596.751435330" watchObservedRunningTime="2026-07-29 01:19:27.25297855 +0000 UTC m=+596.753414003"
Jul 29 01:19:27.265052 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.265026    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxdxx\" (UniqueName: \"kubernetes.io/projected/74e456f2-cb84-46ff-b42f-463538e6fedd-kube-api-access-hxdxx\") pod \"limitador-operator-controller-manager-859d7b78bd-sg6t4\" (UID: \"74e456f2-cb84-46ff-b42f-463538e6fedd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"
Jul 29 01:19:27.394399 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.394208    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:27.456160 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.456128    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"
Jul 29 01:19:27.813685 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:27.813615    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"]
Jul 29 01:19:28.027669 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:19:28.027631    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e456f2_cb84_46ff_b42f_463538e6fedd.slice/crio-36bce4afcb1d2dca9f351bb03f3c2228ab6caa2fdf19dfbdbe0b5f7c74699ac7 WatchSource:0}: Error finding container 36bce4afcb1d2dca9f351bb03f3c2228ab6caa2fdf19dfbdbe0b5f7c74699ac7: Status 404 returned error can't find the container with id 36bce4afcb1d2dca9f351bb03f3c2228ab6caa2fdf19dfbdbe0b5f7c74699ac7
Jul 29 01:19:28.224112 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:28.224080    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4" event={"ID":"74e456f2-cb84-46ff-b42f-463538e6fedd","Type":"ContainerStarted","Data":"36bce4afcb1d2dca9f351bb03f3c2228ab6caa2fdf19dfbdbe0b5f7c74699ac7"}
Jul 29 01:19:28.225700 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:28.225673    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pkbv4" event={"ID":"2978bb74-da9e-4a5c-86d2-70650fe5400e","Type":"ContainerStarted","Data":"1ba3278f86a7a3600a4c8c9a2c5581cb989622304c6ece55441e52d4a2e73e15"}
Jul 29 01:19:28.226060 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:28.226040    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pkbv4"
Jul 29 01:19:28.262375 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:28.262333    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pkbv4" podStartSLOduration=2.617881713 podStartE2EDuration="4.262319252s" totalImagesPullingTime="1.644437539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:28.25976604 +0000 UTC m=+597.760201486" watchObservedRunningTime="2026-07-29 01:19:28.262319252 +0000 UTC m=+597.762754700"
Jul 29 01:19:29.000041 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.000000    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:29.103766 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.103728    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:29.261105 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.261081    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m"]
Jul 29 01:19:29.264351 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.264332    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m"
Jul 29 01:19:29.266760 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.266732    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 29 01:19:29.266866 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.266796    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l69wn\""
Jul 29 01:19:29.266866 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.266834    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 29 01:19:29.270793 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.270767    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:29.275969 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.275948    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m"]
Jul 29 01:19:29.346478 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.346443    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:29.371474 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.371440    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/accbb87b-5d95-45e2-9deb-108bb6718de4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8pr2m\" (UID: \"accbb87b-5d95-45e2-9deb-108bb6718de4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m"
Jul 29 01:19:29.371620 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.371483    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/accbb87b-5d95-45e2-9deb-108bb6718de4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8pr2m\" (UID: \"accbb87b-5d95-45e2-9deb-108bb6718de4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m"
Jul 29 01:19:29.371620 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.371522    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvz6t\" (UniqueName: \"kubernetes.io/projected/accbb87b-5d95-45e2-9deb-108bb6718de4-kube-api-access-rvz6t\") pod \"kuadrant-console-plugin-66b5774985-8pr2m\" (UID: \"accbb87b-5d95-45e2-9deb-108bb6718de4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m"
Jul 29 01:19:29.472454 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.472416    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvz6t\" (UniqueName: \"kubernetes.io/projected/accbb87b-5d95-45e2-9deb-108bb6718de4-kube-api-access-rvz6t\") pod \"kuadrant-console-plugin-66b5774985-8pr2m\" (UID: \"accbb87b-5d95-45e2-9deb-108bb6718de4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m"
Jul 29 01:19:29.472623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.472474    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/accbb87b-5d95-45e2-9deb-108bb6718de4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8pr2m\" (UID: \"accbb87b-5d95-45e2-9deb-108bb6718de4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m"
Jul 29 01:19:29.472623 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.472516    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/accbb87b-5d95-45e2-9deb-108bb6718de4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8pr2m\" (UID: \"accbb87b-5d95-45e2-9deb-108bb6718de4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m"
Jul 29 01:19:29.473133 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.473109    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/accbb87b-5d95-45e2-9deb-108bb6718de4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8pr2m\" (UID: \"accbb87b-5d95-45e2-9deb-108bb6718de4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m"
Jul 29 01:19:29.475080 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.475051    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/accbb87b-5d95-45e2-9deb-108bb6718de4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8pr2m\" (UID: \"accbb87b-5d95-45e2-9deb-108bb6718de4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m"
Jul 29 01:19:29.486011 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.485981    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvz6t\" (UniqueName: \"kubernetes.io/projected/accbb87b-5d95-45e2-9deb-108bb6718de4-kube-api-access-rvz6t\") pod \"kuadrant-console-plugin-66b5774985-8pr2m\" (UID: \"accbb87b-5d95-45e2-9deb-108bb6718de4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m"
Jul 29 01:19:29.573618 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.573591    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m"
Jul 29 01:19:29.700895 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.700871    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m"]
Jul 29 01:19:29.702782 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:19:29.702748    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaccbb87b_5d95_45e2_9deb_108bb6718de4.slice/crio-d9f52216bb86567f66e639cb6df51b7431636ba08c04cdf6f9ae1999732b22af WatchSource:0}: Error finding container d9f52216bb86567f66e639cb6df51b7431636ba08c04cdf6f9ae1999732b22af: Status 404 returned error can't find the container with id d9f52216bb86567f66e639cb6df51b7431636ba08c04cdf6f9ae1999732b22af
Jul 29 01:19:29.712506 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.712484    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-769c674c8f-m7lgz"]
Jul 29 01:19:29.716954 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.716934    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.733466 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.733444    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-769c674c8f-m7lgz"]
Jul 29 01:19:29.775969 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.775944    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbeedc96-6544-4836-8442-da1b510a25ae-service-ca\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.776089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.775987    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bbeedc96-6544-4836-8442-da1b510a25ae-console-config\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.776089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.776016    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bbeedc96-6544-4836-8442-da1b510a25ae-console-oauth-config\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.776089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.776040    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bbeedc96-6544-4836-8442-da1b510a25ae-oauth-serving-cert\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.776089 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.776073    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbeedc96-6544-4836-8442-da1b510a25ae-trusted-ca-bundle\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.776289 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.776091    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bbeedc96-6544-4836-8442-da1b510a25ae-console-serving-cert\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.776289 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.776138    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzrwr\" (UniqueName: \"kubernetes.io/projected/bbeedc96-6544-4836-8442-da1b510a25ae-kube-api-access-mzrwr\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.777213 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.777167    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:29.876564 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.876482    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bbeedc96-6544-4836-8442-da1b510a25ae-console-serving-cert\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.876564 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.876532    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzrwr\" (UniqueName: \"kubernetes.io/projected/bbeedc96-6544-4836-8442-da1b510a25ae-kube-api-access-mzrwr\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.876754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.876574    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbeedc96-6544-4836-8442-da1b510a25ae-service-ca\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.876754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.876617    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bbeedc96-6544-4836-8442-da1b510a25ae-console-config\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.876754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.876645    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bbeedc96-6544-4836-8442-da1b510a25ae-console-oauth-config\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.876754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.876669    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bbeedc96-6544-4836-8442-da1b510a25ae-oauth-serving-cert\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.876754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.876698    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbeedc96-6544-4836-8442-da1b510a25ae-trusted-ca-bundle\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.877247 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.877221    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:29.877626 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.877604    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bbeedc96-6544-4836-8442-da1b510a25ae-console-config\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.877710 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.877604    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbeedc96-6544-4836-8442-da1b510a25ae-service-ca\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.877710 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.877653    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bbeedc96-6544-4836-8442-da1b510a25ae-oauth-serving-cert\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.877962 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.877943    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbeedc96-6544-4836-8442-da1b510a25ae-trusted-ca-bundle\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.879031 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.879013    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bbeedc96-6544-4836-8442-da1b510a25ae-console-serving-cert\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.879244 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.879226    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bbeedc96-6544-4836-8442-da1b510a25ae-console-oauth-config\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.885610 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.885591    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzrwr\" (UniqueName: \"kubernetes.io/projected/bbeedc96-6544-4836-8442-da1b510a25ae-kube-api-access-mzrwr\") pod \"console-769c674c8f-m7lgz\" (UID: \"bbeedc96-6544-4836-8442-da1b510a25ae\") " pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:29.976350 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:29.976293    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:30.026903 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:30.026877    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:30.155436 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:30.155404    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-769c674c8f-m7lgz"]
Jul 29 01:19:30.156838 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:19:30.156817    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbeedc96_6544_4836_8442_da1b510a25ae.slice/crio-fec2ba49533caaccf80dca765f4bd3d0641a3e08b1e49985e9c3fa84f0fce3bc WatchSource:0}: Error finding container fec2ba49533caaccf80dca765f4bd3d0641a3e08b1e49985e9c3fa84f0fce3bc: Status 404 returned error can't find the container with id fec2ba49533caaccf80dca765f4bd3d0641a3e08b1e49985e9c3fa84f0fce3bc
Jul 29 01:19:30.237029 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:30.236998    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769c674c8f-m7lgz" event={"ID":"bbeedc96-6544-4836-8442-da1b510a25ae","Type":"ContainerStarted","Data":"2726596eb0269c6338c2729b062a7f45849465aee8b55de13a55f663d5e4f6c4"}
Jul 29 01:19:30.237144 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:30.237049    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769c674c8f-m7lgz" event={"ID":"bbeedc96-6544-4836-8442-da1b510a25ae","Type":"ContainerStarted","Data":"fec2ba49533caaccf80dca765f4bd3d0641a3e08b1e49985e9c3fa84f0fce3bc"}
Jul 29 01:19:30.238756 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:30.238730    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4" event={"ID":"74e456f2-cb84-46ff-b42f-463538e6fedd","Type":"ContainerStarted","Data":"fd7fe5ec0c618a5ac2f8c43f1f1bafde69c68698bb55cece6d092532a72cddb6"}
Jul 29 01:19:30.238889 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:30.238873    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"
Jul 29 01:19:30.240011 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:30.239980    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m" event={"ID":"accbb87b-5d95-45e2-9deb-108bb6718de4","Type":"ContainerStarted","Data":"d9f52216bb86567f66e639cb6df51b7431636ba08c04cdf6f9ae1999732b22af"}
Jul 29 01:19:30.256211 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:30.256139    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-769c674c8f-m7lgz" podStartSLOduration=1.256120605 podStartE2EDuration="1.256120605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:30.255311436 +0000 UTC m=+599.755746887" watchObservedRunningTime="2026-07-29 01:19:30.256120605 +0000 UTC m=+599.756556054"
Jul 29 01:19:30.272370 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:30.272317    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4" podStartSLOduration=2.111509805 podStartE2EDuration="3.272298733s" totalImagesPullingTime="1.160788928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:30.270533845 +0000 UTC m=+599.770969296" watchObservedRunningTime="2026-07-29 01:19:30.272298733 +0000 UTC m=+599.772734186"
Jul 29 01:19:30.344105 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:30.344045    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:30.444604 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:30.444514    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:30.545893 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:30.545856    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:30.646159 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:30.646079    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:38.228302 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:38.228270    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:38.228777 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:38.228353    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v5h4f"
Jul 29 01:19:38.405474 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:38.405437    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:38.502365 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:38.502254    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:40.027878 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.027841    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:40.028365 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.027958    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:40.034378 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.034348    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:40.242469 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.242436    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pkbv4"
Jul 29 01:19:40.305908 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.305832    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-769c674c8f-m7lgz"
Jul 29 01:19:40.360348 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.360315    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6b9584dc-7k6ld"]
Jul 29 01:19:40.386234 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.386152    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"]
Jul 29 01:19:40.386427 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.386376    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf" podUID="6841abc6-b5ca-4132-a10a-9e5655cde723" containerName="manager" containerID="cri-o://acff88c5ef5befae547ff3c7ab483bee9976932bd0f7da550249474daf24fbd2" gracePeriod=2
Jul 29 01:19:40.397552 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.397468    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"]
Jul 29 01:19:40.397809 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:19:40.397704    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9pcjf\" is forbidden: User \"system:node:ip-10-0-130-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-167.ec2.internal' and this object" podUID="6841abc6-b5ca-4132-a10a-9e5655cde723" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:40.408232 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.408203    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"]
Jul 29 01:19:40.408495 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.408465    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4" podUID="74e456f2-cb84-46ff-b42f-463538e6fedd" containerName="manager" containerID="cri-o://fd7fe5ec0c618a5ac2f8c43f1f1bafde69c68698bb55cece6d092532a72cddb6" gracePeriod=2
Jul 29 01:19:40.411126 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:19:40.411091    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9pcjf\" is forbidden: User \"system:node:ip-10-0-130-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-167.ec2.internal' and this object" podUID="6841abc6-b5ca-4132-a10a-9e5655cde723" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:40.411303 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.411207    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"
Jul 29 01:19:40.413685 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.413657    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"]
Jul 29 01:19:40.414079 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.414060    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6841abc6-b5ca-4132-a10a-9e5655cde723" containerName="manager"
Jul 29 01:19:40.414166 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.414081    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6841abc6-b5ca-4132-a10a-9e5655cde723" containerName="manager"
Jul 29 01:19:40.414252 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.414212    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6841abc6-b5ca-4132-a10a-9e5655cde723" containerName="manager"
Jul 29 01:19:40.424413 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:19:40.424374    2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"74e456f2-cb84-46ff-b42f-463538e6fedd\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-sg6t4\": pods \"limitador-operator-controller-manager-859d7b78bd-sg6t4\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"
Jul 29 01:19:40.426919 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:19:40.426884    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9pcjf\" is forbidden: User \"system:node:ip-10-0-130-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-167.ec2.internal' and this object" podUID="6841abc6-b5ca-4132-a10a-9e5655cde723" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:40.432075 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:19:40.432041    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sg6t4\" is forbidden: User \"system:node:ip-10-0-130-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-167.ec2.internal' and this object" podUID="74e456f2-cb84-46ff-b42f-463538e6fedd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"
Jul 29 01:19:40.458513 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.458465    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"]
Jul 29 01:19:40.458513 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.458504    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"
Jul 29 01:19:40.459152 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.458754    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"]
Jul 29 01:19:40.459152 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.458810    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drcbd"]
Jul 29 01:19:40.459384 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.459363    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e456f2-cb84-46ff-b42f-463538e6fedd" containerName="manager"
Jul 29 01:19:40.459497 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.459387    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e456f2-cb84-46ff-b42f-463538e6fedd" containerName="manager"
Jul 29 01:19:40.459573 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.459511    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e456f2-cb84-46ff-b42f-463538e6fedd" containerName="manager"
Jul 29 01:19:40.463958 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.463910    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drcbd"]
Jul 29 01:19:40.464109 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.464089    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drcbd"
Jul 29 01:19:40.487154 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:19:40.487119    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9pcjf\" is forbidden: User \"system:node:ip-10-0-130-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-167.ec2.internal' and this object" podUID="6841abc6-b5ca-4132-a10a-9e5655cde723" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:40.489145 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:19:40.489116    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sg6t4\" is forbidden: User \"system:node:ip-10-0-130-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-167.ec2.internal' and this object" podUID="74e456f2-cb84-46ff-b42f-463538e6fedd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"
Jul 29 01:19:40.510377 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:19:40.510346    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9pcjf\" is forbidden: User \"system:node:ip-10-0-130-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-167.ec2.internal' and this object" podUID="6841abc6-b5ca-4132-a10a-9e5655cde723" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:40.512302 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:19:40.512276    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sg6t4\" is forbidden: User \"system:node:ip-10-0-130-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-167.ec2.internal' and this object" podUID="74e456f2-cb84-46ff-b42f-463538e6fedd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"
Jul 29 01:19:40.528402 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.528376    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:40.571685 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.571615    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qclfn\" (UniqueName: \"kubernetes.io/projected/1af02fda-8b00-4627-a4db-16a0189c9cb0-kube-api-access-qclfn\") pod \"limitador-operator-controller-manager-859d7b78bd-drcbd\" (UID: \"1af02fda-8b00-4627-a4db-16a0189c9cb0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drcbd"
Jul 29 01:19:40.571685 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.571651    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42e97a8b-b6b1-41db-9be2-1650390a92cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vnphv\" (UID: \"42e97a8b-b6b1-41db-9be2-1650390a92cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"
Jul 29 01:19:40.571865 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.571801    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrzrw\" (UniqueName: \"kubernetes.io/projected/42e97a8b-b6b1-41db-9be2-1650390a92cb-kube-api-access-wrzrw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vnphv\" (UID: \"42e97a8b-b6b1-41db-9be2-1650390a92cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"
Jul 29 01:19:40.672498 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.672460    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrzrw\" (UniqueName: \"kubernetes.io/projected/42e97a8b-b6b1-41db-9be2-1650390a92cb-kube-api-access-wrzrw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vnphv\" (UID: \"42e97a8b-b6b1-41db-9be2-1650390a92cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"
Jul 29 01:19:40.672684 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.672501    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qclfn\" (UniqueName: \"kubernetes.io/projected/1af02fda-8b00-4627-a4db-16a0189c9cb0-kube-api-access-qclfn\") pod \"limitador-operator-controller-manager-859d7b78bd-drcbd\" (UID: \"1af02fda-8b00-4627-a4db-16a0189c9cb0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drcbd"
Jul 29 01:19:40.672684 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.672535    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42e97a8b-b6b1-41db-9be2-1650390a92cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vnphv\" (UID: \"42e97a8b-b6b1-41db-9be2-1650390a92cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"
Jul 29 01:19:40.672925 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.672902    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42e97a8b-b6b1-41db-9be2-1650390a92cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vnphv\" (UID: \"42e97a8b-b6b1-41db-9be2-1650390a92cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"
Jul 29 01:19:40.715388 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.715142    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrzrw\" (UniqueName: \"kubernetes.io/projected/42e97a8b-b6b1-41db-9be2-1650390a92cb-kube-api-access-wrzrw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vnphv\" (UID: \"42e97a8b-b6b1-41db-9be2-1650390a92cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"
Jul 29 01:19:40.716557 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.716532    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qclfn\" (UniqueName: \"kubernetes.io/projected/1af02fda-8b00-4627-a4db-16a0189c9cb0-kube-api-access-qclfn\") pod \"limitador-operator-controller-manager-859d7b78bd-drcbd\" (UID: \"1af02fda-8b00-4627-a4db-16a0189c9cb0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drcbd"
Jul 29 01:19:40.783554 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.783520    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:40.887099 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.887013    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"
Jul 29 01:19:40.894121 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.894095    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drcbd"
Jul 29 01:19:40.899496 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.899467    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:40.997669 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:40.997614    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:41.038592 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:19:41.038558    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9pcjf\" is forbidden: User \"system:node:ip-10-0-130-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-167.ec2.internal' and this object" podUID="6841abc6-b5ca-4132-a10a-9e5655cde723" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:41.040742 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:19:41.040707    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sg6t4\" is forbidden: User \"system:node:ip-10-0-130-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-167.ec2.internal' and this object" podUID="74e456f2-cb84-46ff-b42f-463538e6fedd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"
Jul 29 01:19:41.546244 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:41.546204    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"]
Jul 29 01:19:41.572057 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:41.572025    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"
Jul 29 01:19:41.575083 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:41.575040    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"]
Jul 29 01:19:41.680622 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:41.680583    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab2bf098-cea8-481b-ac4f-75177af7f1da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-frnwd\" (UID: \"ab2bf098-cea8-481b-ac4f-75177af7f1da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"
Jul 29 01:19:41.680787 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:41.680636    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xzx6\" (UniqueName: \"kubernetes.io/projected/ab2bf098-cea8-481b-ac4f-75177af7f1da-kube-api-access-7xzx6\") pod \"kuadrant-operator-controller-manager-86878c769f-frnwd\" (UID: \"ab2bf098-cea8-481b-ac4f-75177af7f1da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"
Jul 29 01:19:41.781824 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:41.781785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab2bf098-cea8-481b-ac4f-75177af7f1da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-frnwd\" (UID: \"ab2bf098-cea8-481b-ac4f-75177af7f1da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"
Jul 29 01:19:41.781824 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:41.781827    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xzx6\" (UniqueName: \"kubernetes.io/projected/ab2bf098-cea8-481b-ac4f-75177af7f1da-kube-api-access-7xzx6\") pod \"kuadrant-operator-controller-manager-86878c769f-frnwd\" (UID: \"ab2bf098-cea8-481b-ac4f-75177af7f1da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"
Jul 29 01:19:41.782204 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:41.782164    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab2bf098-cea8-481b-ac4f-75177af7f1da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-frnwd\" (UID: \"ab2bf098-cea8-481b-ac4f-75177af7f1da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"
Jul 29 01:19:41.791014 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:41.790984    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xzx6\" (UniqueName: \"kubernetes.io/projected/ab2bf098-cea8-481b-ac4f-75177af7f1da-kube-api-access-7xzx6\") pod \"kuadrant-operator-controller-manager-86878c769f-frnwd\" (UID: \"ab2bf098-cea8-481b-ac4f-75177af7f1da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"
Jul 29 01:19:41.885366 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:41.885294    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"
Jul 29 01:19:45.573582 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:45.573525    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:45.676704 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:45.676671    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:49.360781 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:49.360714    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:49.433775 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:49.433721    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:50.701037 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:50.701013    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"]
Jul 29 01:19:50.705901 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:19:50.705860    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab2bf098_cea8_481b_ac4f_75177af7f1da.slice/crio-3bf3c3f09061ff8ee5eff87306163a083785db401111df2832696f7dc3fa520a WatchSource:0}: Error finding container 3bf3c3f09061ff8ee5eff87306163a083785db401111df2832696f7dc3fa520a: Status 404 returned error can't find the container with id 3bf3c3f09061ff8ee5eff87306163a083785db401111df2832696f7dc3fa520a
Jul 29 01:19:50.715147 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:50.715128    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"
Jul 29 01:19:50.717329 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:50.717309    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:50.860759 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:50.860723    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jx4pm\" (UniqueName: \"kubernetes.io/projected/6841abc6-b5ca-4132-a10a-9e5655cde723-kube-api-access-jx4pm\") pod \"6841abc6-b5ca-4132-a10a-9e5655cde723\" (UID: \"6841abc6-b5ca-4132-a10a-9e5655cde723\") "
Jul 29 01:19:50.860759 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:50.860769    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxdxx\" (UniqueName: \"kubernetes.io/projected/74e456f2-cb84-46ff-b42f-463538e6fedd-kube-api-access-hxdxx\") pod \"74e456f2-cb84-46ff-b42f-463538e6fedd\" (UID: \"74e456f2-cb84-46ff-b42f-463538e6fedd\") "
Jul 29 01:19:50.860969 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:50.860847    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6841abc6-b5ca-4132-a10a-9e5655cde723-extensions-socket-volume\") pod \"6841abc6-b5ca-4132-a10a-9e5655cde723\" (UID: \"6841abc6-b5ca-4132-a10a-9e5655cde723\") "
Jul 29 01:19:50.861293 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:50.861267    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6841abc6-b5ca-4132-a10a-9e5655cde723-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6841abc6-b5ca-4132-a10a-9e5655cde723" (UID: "6841abc6-b5ca-4132-a10a-9e5655cde723"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:19:50.862851 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:50.862824    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e456f2-cb84-46ff-b42f-463538e6fedd-kube-api-access-hxdxx" (OuterVolumeSpecName: "kube-api-access-hxdxx") pod "74e456f2-cb84-46ff-b42f-463538e6fedd" (UID: "74e456f2-cb84-46ff-b42f-463538e6fedd"). InnerVolumeSpecName "kube-api-access-hxdxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:19:50.862954 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:50.862855    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6841abc6-b5ca-4132-a10a-9e5655cde723-kube-api-access-jx4pm" (OuterVolumeSpecName: "kube-api-access-jx4pm") pod "6841abc6-b5ca-4132-a10a-9e5655cde723" (UID: "6841abc6-b5ca-4132-a10a-9e5655cde723"). InnerVolumeSpecName "kube-api-access-jx4pm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:19:50.934079 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:50.934031    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drcbd"]
Jul 29 01:19:50.936536 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:50.936514    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"]
Jul 29 01:19:50.937242 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:19:50.937217    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af02fda_8b00_4627_a4db_16a0189c9cb0.slice/crio-1ee926c34abb621b682e72196b2f6a6cc3e9f531ff6a1202286d4dcababe16d5 WatchSource:0}: Error finding container 1ee926c34abb621b682e72196b2f6a6cc3e9f531ff6a1202286d4dcababe16d5: Status 404 returned error can't find the container with id 1ee926c34abb621b682e72196b2f6a6cc3e9f531ff6a1202286d4dcababe16d5
Jul 29 01:19:50.938511 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:19:50.938493    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e97a8b_b6b1_41db_9be2_1650390a92cb.slice/crio-8be7e50c25bc09d773de04c6e446b3267d9bc6880767bb5e33a992ce26a56ded WatchSource:0}: Error finding container 8be7e50c25bc09d773de04c6e446b3267d9bc6880767bb5e33a992ce26a56ded: Status 404 returned error can't find the container with id 8be7e50c25bc09d773de04c6e446b3267d9bc6880767bb5e33a992ce26a56ded
Jul 29 01:19:50.961656 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:50.961634    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6841abc6-b5ca-4132-a10a-9e5655cde723-extensions-socket-volume\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:50.961778 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:50.961661    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jx4pm\" (UniqueName: \"kubernetes.io/projected/6841abc6-b5ca-4132-a10a-9e5655cde723-kube-api-access-jx4pm\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:50.961778 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:50.961676    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxdxx\" (UniqueName: \"kubernetes.io/projected/74e456f2-cb84-46ff-b42f-463538e6fedd-kube-api-access-hxdxx\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:19:51.038856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.038798    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6841abc6-b5ca-4132-a10a-9e5655cde723" path="/var/lib/kubelet/pods/6841abc6-b5ca-4132-a10a-9e5655cde723/volumes"
Jul 29 01:19:51.039116 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.039104    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74e456f2-cb84-46ff-b42f-463538e6fedd" path="/var/lib/kubelet/pods/74e456f2-cb84-46ff-b42f-463538e6fedd/volumes"
Jul 29 01:19:51.367595 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.367500    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drcbd" event={"ID":"1af02fda-8b00-4627-a4db-16a0189c9cb0","Type":"ContainerStarted","Data":"19cc4413feaac598ac9d23034912e2b6317a843dca6e06f433eac983a208a33a"}
Jul 29 01:19:51.367595 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.367558    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drcbd" event={"ID":"1af02fda-8b00-4627-a4db-16a0189c9cb0","Type":"ContainerStarted","Data":"1ee926c34abb621b682e72196b2f6a6cc3e9f531ff6a1202286d4dcababe16d5"}
Jul 29 01:19:51.367595 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.367590    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drcbd"
Jul 29 01:19:51.369235 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.369209    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd" event={"ID":"ab2bf098-cea8-481b-ac4f-75177af7f1da","Type":"ContainerStarted","Data":"4e344fac8c2429ccc6ab60d6309f98880781e6927d4c23d5e28a1324c4cc988e"}
Jul 29 01:19:51.369374 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.369252    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd" event={"ID":"ab2bf098-cea8-481b-ac4f-75177af7f1da","Type":"ContainerStarted","Data":"3bf3c3f09061ff8ee5eff87306163a083785db401111df2832696f7dc3fa520a"}
Jul 29 01:19:51.369374 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.369283    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"
Jul 29 01:19:51.370589 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.370561    2558 generic.go:356] "Generic (PLEG): container finished" podID="6841abc6-b5ca-4132-a10a-9e5655cde723" containerID="acff88c5ef5befae547ff3c7ab483bee9976932bd0f7da550249474daf24fbd2" exitCode=0
Jul 29 01:19:51.370728 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.370601    2558 scope.go:117] "RemoveContainer" containerID="acff88c5ef5befae547ff3c7ab483bee9976932bd0f7da550249474daf24fbd2"
Jul 29 01:19:51.370728 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.370612    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9pcjf"
Jul 29 01:19:51.371933 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.371912    2558 generic.go:356] "Generic (PLEG): container finished" podID="74e456f2-cb84-46ff-b42f-463538e6fedd" containerID="fd7fe5ec0c618a5ac2f8c43f1f1bafde69c68698bb55cece6d092532a72cddb6" exitCode=0
Jul 29 01:19:51.372023 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.371949    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sg6t4"
Jul 29 01:19:51.373790 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.373769    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv" event={"ID":"42e97a8b-b6b1-41db-9be2-1650390a92cb","Type":"ContainerStarted","Data":"c5144877f87795172e583e151d46004fe72accc961bbbf95739bb9e19226feae"}
Jul 29 01:19:51.373904 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.373838    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"
Jul 29 01:19:51.373904 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.373870    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv" event={"ID":"42e97a8b-b6b1-41db-9be2-1650390a92cb","Type":"ContainerStarted","Data":"8be7e50c25bc09d773de04c6e446b3267d9bc6880767bb5e33a992ce26a56ded"}
Jul 29 01:19:51.375719 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.375702    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m" event={"ID":"accbb87b-5d95-45e2-9deb-108bb6718de4","Type":"ContainerStarted","Data":"d911cbeb29bb82510261a1af2457e18d6dc29dba1fc836b264a3a5437bda529f"}
Jul 29 01:19:51.379958 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.379938    2558 scope.go:117] "RemoveContainer" containerID="acff88c5ef5befae547ff3c7ab483bee9976932bd0f7da550249474daf24fbd2"
Jul 29 01:19:51.380214 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:19:51.380193    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acff88c5ef5befae547ff3c7ab483bee9976932bd0f7da550249474daf24fbd2\": container with ID starting with acff88c5ef5befae547ff3c7ab483bee9976932bd0f7da550249474daf24fbd2 not found: ID does not exist" containerID="acff88c5ef5befae547ff3c7ab483bee9976932bd0f7da550249474daf24fbd2"
Jul 29 01:19:51.380274 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.380225    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acff88c5ef5befae547ff3c7ab483bee9976932bd0f7da550249474daf24fbd2"} err="failed to get container status \"acff88c5ef5befae547ff3c7ab483bee9976932bd0f7da550249474daf24fbd2\": rpc error: code = NotFound desc = could not find container \"acff88c5ef5befae547ff3c7ab483bee9976932bd0f7da550249474daf24fbd2\": container with ID starting with acff88c5ef5befae547ff3c7ab483bee9976932bd0f7da550249474daf24fbd2 not found: ID does not exist"
Jul 29 01:19:51.380274 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.380245    2558 scope.go:117] "RemoveContainer" containerID="fd7fe5ec0c618a5ac2f8c43f1f1bafde69c68698bb55cece6d092532a72cddb6"
Jul 29 01:19:51.385050 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.385014    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drcbd" podStartSLOduration=11.385001664 podStartE2EDuration="11.385001664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:51.384144657 +0000 UTC m=+620.884580112" watchObservedRunningTime="2026-07-29 01:19:51.385001664 +0000 UTC m=+620.885437116"
Jul 29 01:19:51.388150 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.388135    2558 scope.go:117] "RemoveContainer" containerID="fd7fe5ec0c618a5ac2f8c43f1f1bafde69c68698bb55cece6d092532a72cddb6"
Jul 29 01:19:51.388411 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:19:51.388394    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd7fe5ec0c618a5ac2f8c43f1f1bafde69c68698bb55cece6d092532a72cddb6\": container with ID starting with fd7fe5ec0c618a5ac2f8c43f1f1bafde69c68698bb55cece6d092532a72cddb6 not found: ID does not exist" containerID="fd7fe5ec0c618a5ac2f8c43f1f1bafde69c68698bb55cece6d092532a72cddb6"
Jul 29 01:19:51.388473 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.388417    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd7fe5ec0c618a5ac2f8c43f1f1bafde69c68698bb55cece6d092532a72cddb6"} err="failed to get container status \"fd7fe5ec0c618a5ac2f8c43f1f1bafde69c68698bb55cece6d092532a72cddb6\": rpc error: code = NotFound desc = could not find container \"fd7fe5ec0c618a5ac2f8c43f1f1bafde69c68698bb55cece6d092532a72cddb6\": container with ID starting with fd7fe5ec0c618a5ac2f8c43f1f1bafde69c68698bb55cece6d092532a72cddb6 not found: ID does not exist"
Jul 29 01:19:51.403041 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.403003    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv" podStartSLOduration=11.402990229 podStartE2EDuration="11.402990229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:51.401312655 +0000 UTC m=+620.901748131" watchObservedRunningTime="2026-07-29 01:19:51.402990229 +0000 UTC m=+620.903425681"
Jul 29 01:19:51.418336 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.418297    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd" podStartSLOduration=10.418282337 podStartE2EDuration="10.418282337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:51.417686142 +0000 UTC m=+620.918121605" watchObservedRunningTime="2026-07-29 01:19:51.418282337 +0000 UTC m=+620.918717790"
Jul 29 01:19:51.434374 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:51.434331    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8pr2m" podStartSLOduration=1.505966028 podStartE2EDuration="22.434318691s" totalImagesPullingTime="20.928352663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:51.43286019 +0000 UTC m=+620.933295643" watchObservedRunningTime="2026-07-29 01:19:51.434318691 +0000 UTC m=+620.934754142"
Jul 29 01:19:56.869734 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:56.869651    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:57.989401 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:57.989369    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:19:58.090183 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:19:58.090146    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:00.463265 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:00.463231    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:00.560217 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:00.560167    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:02.385598 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:02.385566    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"
Jul 29 01:20:02.386000 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:02.385641    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-drcbd"
Jul 29 01:20:02.386000 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:02.385790    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"
Jul 29 01:20:02.443856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:02.443825    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"]
Jul 29 01:20:02.444017 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:02.443997    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv" podUID="42e97a8b-b6b1-41db-9be2-1650390a92cb" containerName="manager" containerID="cri-o://c5144877f87795172e583e151d46004fe72accc961bbbf95739bb9e19226feae" gracePeriod=10
Jul 29 01:20:03.290266 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.290235    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"
Jul 29 01:20:03.439668 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.439593    2558 generic.go:356] "Generic (PLEG): container finished" podID="42e97a8b-b6b1-41db-9be2-1650390a92cb" containerID="c5144877f87795172e583e151d46004fe72accc961bbbf95739bb9e19226feae" exitCode=0
Jul 29 01:20:03.439668 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.439633    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"
Jul 29 01:20:03.440050 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.439684    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv" event={"ID":"42e97a8b-b6b1-41db-9be2-1650390a92cb","Type":"ContainerDied","Data":"c5144877f87795172e583e151d46004fe72accc961bbbf95739bb9e19226feae"}
Jul 29 01:20:03.440050 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.439734    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv" event={"ID":"42e97a8b-b6b1-41db-9be2-1650390a92cb","Type":"ContainerDied","Data":"8be7e50c25bc09d773de04c6e446b3267d9bc6880767bb5e33a992ce26a56ded"}
Jul 29 01:20:03.440050 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.439757    2558 scope.go:117] "RemoveContainer" containerID="c5144877f87795172e583e151d46004fe72accc961bbbf95739bb9e19226feae"
Jul 29 01:20:03.448533 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.448358    2558 scope.go:117] "RemoveContainer" containerID="c5144877f87795172e583e151d46004fe72accc961bbbf95739bb9e19226feae"
Jul 29 01:20:03.448644 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:20:03.448627    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5144877f87795172e583e151d46004fe72accc961bbbf95739bb9e19226feae\": container with ID starting with c5144877f87795172e583e151d46004fe72accc961bbbf95739bb9e19226feae not found: ID does not exist" containerID="c5144877f87795172e583e151d46004fe72accc961bbbf95739bb9e19226feae"
Jul 29 01:20:03.448691 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.448653    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5144877f87795172e583e151d46004fe72accc961bbbf95739bb9e19226feae"} err="failed to get container status \"c5144877f87795172e583e151d46004fe72accc961bbbf95739bb9e19226feae\": rpc error: code = NotFound desc = could not find container \"c5144877f87795172e583e151d46004fe72accc961bbbf95739bb9e19226feae\": container with ID starting with c5144877f87795172e583e151d46004fe72accc961bbbf95739bb9e19226feae not found: ID does not exist"
Jul 29 01:20:03.469430 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.469410    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42e97a8b-b6b1-41db-9be2-1650390a92cb-extensions-socket-volume\") pod \"42e97a8b-b6b1-41db-9be2-1650390a92cb\" (UID: \"42e97a8b-b6b1-41db-9be2-1650390a92cb\") "
Jul 29 01:20:03.469552 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.469453    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrzrw\" (UniqueName: \"kubernetes.io/projected/42e97a8b-b6b1-41db-9be2-1650390a92cb-kube-api-access-wrzrw\") pod \"42e97a8b-b6b1-41db-9be2-1650390a92cb\" (UID: \"42e97a8b-b6b1-41db-9be2-1650390a92cb\") "
Jul 29 01:20:03.469777 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.469745    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e97a8b-b6b1-41db-9be2-1650390a92cb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "42e97a8b-b6b1-41db-9be2-1650390a92cb" (UID: "42e97a8b-b6b1-41db-9be2-1650390a92cb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:20:03.471252 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.471233    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e97a8b-b6b1-41db-9be2-1650390a92cb-kube-api-access-wrzrw" (OuterVolumeSpecName: "kube-api-access-wrzrw") pod "42e97a8b-b6b1-41db-9be2-1650390a92cb" (UID: "42e97a8b-b6b1-41db-9be2-1650390a92cb"). InnerVolumeSpecName "kube-api-access-wrzrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:20:03.570779 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.570747    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42e97a8b-b6b1-41db-9be2-1650390a92cb-extensions-socket-volume\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:20:03.570779 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.570776    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrzrw\" (UniqueName: \"kubernetes.io/projected/42e97a8b-b6b1-41db-9be2-1650390a92cb-kube-api-access-wrzrw\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:20:03.763383 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.763345    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"]
Jul 29 01:20:03.766893 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:03.766867    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vnphv"]
Jul 29 01:20:05.037947 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:05.037914    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42e97a8b-b6b1-41db-9be2-1650390a92cb" path="/var/lib/kubelet/pods/42e97a8b-b6b1-41db-9be2-1650390a92cb/volumes"
Jul 29 01:20:05.269742 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:05.269706    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:05.367955 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:05.367880    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:05.383343 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:05.383314    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c6b9584dc-7k6ld" podUID="7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89" containerName="console" containerID="cri-o://9985e415fd563402d9fe840ce8022ef514fe40539c878be54bf394ba5ecaa22b" gracePeriod=15
Jul 29 01:20:06.211572 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.211547    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:20:06.394150 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.394072    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-oauth-serving-cert\") pod \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") "
Jul 29 01:20:06.394150 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.394116    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgcl9\" (UniqueName: \"kubernetes.io/projected/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-kube-api-access-bgcl9\") pod \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") "
Jul 29 01:20:06.394385 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.394156    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-trusted-ca-bundle\") pod \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") "
Jul 29 01:20:06.394385 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.394207    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-serving-cert\") pod \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") "
Jul 29 01:20:06.394385 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.394248    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-config\") pod \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") "
Jul 29 01:20:06.394385 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.394271    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-oauth-config\") pod \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") "
Jul 29 01:20:06.394385 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.394340    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-service-ca\") pod \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\" (UID: \"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89\") "
Jul 29 01:20:06.394613 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.394489    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89" (UID: "7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:20:06.394613 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.394590    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-config" (OuterVolumeSpecName: "console-config") pod "7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89" (UID: "7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:20:06.394613 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.394604    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-oauth-serving-cert\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:20:06.394970 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.394931    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89" (UID: "7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:20:06.394970 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.394958    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-service-ca" (OuterVolumeSpecName: "service-ca") pod "7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89" (UID: "7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:20:06.396564 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.396531    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89" (UID: "7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:20:06.396564 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.396545    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89" (UID: "7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:20:06.396699 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.396590    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-kube-api-access-bgcl9" (OuterVolumeSpecName: "kube-api-access-bgcl9") pod "7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89" (UID: "7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89"). InnerVolumeSpecName "kube-api-access-bgcl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:20:06.458293 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.458269    2558 generic.go:356] "Generic (PLEG): container finished" podID="7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89" containerID="9985e415fd563402d9fe840ce8022ef514fe40539c878be54bf394ba5ecaa22b" exitCode=0
Jul 29 01:20:06.458395 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.458301    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6b9584dc-7k6ld" event={"ID":"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89","Type":"ContainerDied","Data":"9985e415fd563402d9fe840ce8022ef514fe40539c878be54bf394ba5ecaa22b"}
Jul 29 01:20:06.458395 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.458318    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6b9584dc-7k6ld"
Jul 29 01:20:06.458395 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.458356    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6b9584dc-7k6ld" event={"ID":"7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89","Type":"ContainerDied","Data":"715e9ad5241e6265c9b8ff4225420da16d94af40ffe239da03cfe3133797457b"}
Jul 29 01:20:06.458395 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.458381    2558 scope.go:117] "RemoveContainer" containerID="9985e415fd563402d9fe840ce8022ef514fe40539c878be54bf394ba5ecaa22b"
Jul 29 01:20:06.466967 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.466951    2558 scope.go:117] "RemoveContainer" containerID="9985e415fd563402d9fe840ce8022ef514fe40539c878be54bf394ba5ecaa22b"
Jul 29 01:20:06.467220 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:20:06.467204    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9985e415fd563402d9fe840ce8022ef514fe40539c878be54bf394ba5ecaa22b\": container with ID starting with 9985e415fd563402d9fe840ce8022ef514fe40539c878be54bf394ba5ecaa22b not found: ID does not exist" containerID="9985e415fd563402d9fe840ce8022ef514fe40539c878be54bf394ba5ecaa22b"
Jul 29 01:20:06.467277 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.467227    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9985e415fd563402d9fe840ce8022ef514fe40539c878be54bf394ba5ecaa22b"} err="failed to get container status \"9985e415fd563402d9fe840ce8022ef514fe40539c878be54bf394ba5ecaa22b\": rpc error: code = NotFound desc = could not find container \"9985e415fd563402d9fe840ce8022ef514fe40539c878be54bf394ba5ecaa22b\": container with ID starting with 9985e415fd563402d9fe840ce8022ef514fe40539c878be54bf394ba5ecaa22b not found: ID does not exist"
Jul 29 01:20:06.481288 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.481265    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6b9584dc-7k6ld"]
Jul 29 01:20:06.484437 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.484418    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c6b9584dc-7k6ld"]
Jul 29 01:20:06.495752 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.495732    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgcl9\" (UniqueName: \"kubernetes.io/projected/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-kube-api-access-bgcl9\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:20:06.495843 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.495755    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-trusted-ca-bundle\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:20:06.495843 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.495770    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-serving-cert\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:20:06.495843 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.495782    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-config\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:20:06.495843 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.495795    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-console-oauth-config\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:20:06.495843 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:06.495807    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89-service-ca\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:20:07.037975 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:07.037945    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89" path="/var/lib/kubelet/pods/7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89/volumes"
Jul 29 01:20:09.464565 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:09.464534    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:09.563890 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:09.563860    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:18.406730 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:18.406693    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:18.506404 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:18.506373    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:19.004580 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:19.004544    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:19.213437 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:19.213405    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:20.862407 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:20.862367    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:20.924930 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:20.924902    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:21.515273 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.515234    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:21.633664 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.633629    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:21.693068 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.693022    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:21.845025 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.844945    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:20:21.845287 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.845275    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e97a8b-b6b1-41db-9be2-1650390a92cb" containerName="manager"
Jul 29 01:20:21.845335 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.845288    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e97a8b-b6b1-41db-9be2-1650390a92cb" containerName="manager"
Jul 29 01:20:21.845335 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.845301    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89" containerName="console"
Jul 29 01:20:21.845335 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.845307    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89" containerName="console"
Jul 29 01:20:21.845436 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.845356    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c3f2f6c-9e00-4df8-aa0f-bb81d31cff89" containerName="console"
Jul 29 01:20:21.845436 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.845364    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="42e97a8b-b6b1-41db-9be2-1650390a92cb" containerName="manager"
Jul 29 01:20:21.883394 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.883366    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:20:21.883394 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.883402    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:20:21.883818 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.883478    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"
Jul 29 01:20:21.886327 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.886303    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 01:20:21.914349 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.914324    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn54d\" (UniqueName: \"kubernetes.io/projected/3ca4c979-9db0-4cb6-945d-b35927636e1d-kube-api-access-dn54d\") pod \"limitador-limitador-54d6d988d5-5wz2t\" (UID: \"3ca4c979-9db0-4cb6-945d-b35927636e1d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"
Jul 29 01:20:21.914475 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:21.914379    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3ca4c979-9db0-4cb6-945d-b35927636e1d-config-file\") pod \"limitador-limitador-54d6d988d5-5wz2t\" (UID: \"3ca4c979-9db0-4cb6-945d-b35927636e1d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"
Jul 29 01:20:22.014922 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.014879    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn54d\" (UniqueName: \"kubernetes.io/projected/3ca4c979-9db0-4cb6-945d-b35927636e1d-kube-api-access-dn54d\") pod \"limitador-limitador-54d6d988d5-5wz2t\" (UID: \"3ca4c979-9db0-4cb6-945d-b35927636e1d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"
Jul 29 01:20:22.015097 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.014963    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3ca4c979-9db0-4cb6-945d-b35927636e1d-config-file\") pod \"limitador-limitador-54d6d988d5-5wz2t\" (UID: \"3ca4c979-9db0-4cb6-945d-b35927636e1d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"
Jul 29 01:20:22.015661 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.015641    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3ca4c979-9db0-4cb6-945d-b35927636e1d-config-file\") pod \"limitador-limitador-54d6d988d5-5wz2t\" (UID: \"3ca4c979-9db0-4cb6-945d-b35927636e1d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"
Jul 29 01:20:22.023270 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.023249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn54d\" (UniqueName: \"kubernetes.io/projected/3ca4c979-9db0-4cb6-945d-b35927636e1d-kube-api-access-dn54d\") pod \"limitador-limitador-54d6d988d5-5wz2t\" (UID: \"3ca4c979-9db0-4cb6-945d-b35927636e1d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"
Jul 29 01:20:22.194527 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.194448    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"
Jul 29 01:20:22.321074 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.321043    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-26r9m"]
Jul 29 01:20:22.324145 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.324114    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-26r9m"
Jul 29 01:20:22.324512 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.324495    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:20:22.326661 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.326641    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j4dcq\""
Jul 29 01:20:22.326867 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:20:22.326845    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca4c979_9db0_4cb6_945d_b35927636e1d.slice/crio-241b8711d43b0d5397c7f526d4b0326f8a67d6145da23ae8612bb6cb50f89bb3 WatchSource:0}: Error finding container 241b8711d43b0d5397c7f526d4b0326f8a67d6145da23ae8612bb6cb50f89bb3: Status 404 returned error can't find the container with id 241b8711d43b0d5397c7f526d4b0326f8a67d6145da23ae8612bb6cb50f89bb3
Jul 29 01:20:22.337090 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.335874    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-26r9m"]
Jul 29 01:20:22.354337 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.354309    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:22.417926 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.417898    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdvxb\" (UniqueName: \"kubernetes.io/projected/cb26cd12-4da5-4a28-8fca-c2b48659748e-kube-api-access-qdvxb\") pod \"authorino-58cd955675-26r9m\" (UID: \"cb26cd12-4da5-4a28-8fca-c2b48659748e\") " pod="kuadrant-system/authorino-58cd955675-26r9m"
Jul 29 01:20:22.425090 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.425065    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:22.518891 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.518866    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdvxb\" (UniqueName: \"kubernetes.io/projected/cb26cd12-4da5-4a28-8fca-c2b48659748e-kube-api-access-qdvxb\") pod \"authorino-58cd955675-26r9m\" (UID: \"cb26cd12-4da5-4a28-8fca-c2b48659748e\") " pod="kuadrant-system/authorino-58cd955675-26r9m"
Jul 29 01:20:22.530125 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.530104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdvxb\" (UniqueName: \"kubernetes.io/projected/cb26cd12-4da5-4a28-8fca-c2b48659748e-kube-api-access-qdvxb\") pod \"authorino-58cd955675-26r9m\" (UID: \"cb26cd12-4da5-4a28-8fca-c2b48659748e\") " pod="kuadrant-system/authorino-58cd955675-26r9m"
Jul 29 01:20:22.545070 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.545046    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5wz2t" event={"ID":"3ca4c979-9db0-4cb6-945d-b35927636e1d","Type":"ContainerStarted","Data":"241b8711d43b0d5397c7f526d4b0326f8a67d6145da23ae8612bb6cb50f89bb3"}
Jul 29 01:20:22.647381 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.647353    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-26r9m"
Jul 29 01:20:22.781077 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:22.781049    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-26r9m"]
Jul 29 01:20:22.782625 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:20:22.782593    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb26cd12_4da5_4a28_8fca_c2b48659748e.slice/crio-d627dc99fbd0e67d81c245420e221d16f1ac31a00b53f4aa57c16d73e328a5da WatchSource:0}: Error finding container d627dc99fbd0e67d81c245420e221d16f1ac31a00b53f4aa57c16d73e328a5da: Status 404 returned error can't find the container with id d627dc99fbd0e67d81c245420e221d16f1ac31a00b53f4aa57c16d73e328a5da
Jul 29 01:20:23.555567 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:23.555516    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-26r9m" event={"ID":"cb26cd12-4da5-4a28-8fca-c2b48659748e","Type":"ContainerStarted","Data":"d627dc99fbd0e67d81c245420e221d16f1ac31a00b53f4aa57c16d73e328a5da"}
Jul 29 01:20:25.630892 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:25.630848    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:25.749836 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:25.749729    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:27.221401 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:27.221369    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-26r9m"]
Jul 29 01:20:27.583720 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:27.583676    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5wz2t" event={"ID":"3ca4c979-9db0-4cb6-945d-b35927636e1d","Type":"ContainerStarted","Data":"980bbccb379dd62b3a3f6dcbb8dc8688a4eebd931e0148da8bc47a1160a4175f"}
Jul 29 01:20:27.583915 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:27.583865    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"
Jul 29 01:20:27.585215 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:27.585191    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-26r9m" event={"ID":"cb26cd12-4da5-4a28-8fca-c2b48659748e","Type":"ContainerStarted","Data":"1b699bbe4daf556e8780f62d741f2e74bb3a92aed8cb3a7765006d36f69e9e66"}
Jul 29 01:20:27.601850 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:27.601807    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5wz2t" podStartSLOduration=2.295059225 podStartE2EDuration="6.601794733s" totalImagesPullingTime="4.306735508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:27.600025562 +0000 UTC m=+657.100461015" watchObservedRunningTime="2026-07-29 01:20:27.601794733 +0000 UTC m=+657.102230185"
Jul 29 01:20:27.614118 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:27.614076    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-26r9m" podStartSLOduration=1.759206484 podStartE2EDuration="5.614064604s" totalImagesPullingTime="3.85485812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:27.613605856 +0000 UTC m=+657.114041311" watchObservedRunningTime="2026-07-29 01:20:27.614064604 +0000 UTC m=+657.114500056"
Jul 29 01:20:28.590577 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:28.590530    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-26r9m" podUID="cb26cd12-4da5-4a28-8fca-c2b48659748e" containerName="authorino" containerID="cri-o://1b699bbe4daf556e8780f62d741f2e74bb3a92aed8cb3a7765006d36f69e9e66" gracePeriod=30
Jul 29 01:20:28.834531 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:28.834508    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-26r9m"
Jul 29 01:20:28.875971 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:28.875892    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdvxb\" (UniqueName: \"kubernetes.io/projected/cb26cd12-4da5-4a28-8fca-c2b48659748e-kube-api-access-qdvxb\") pod \"cb26cd12-4da5-4a28-8fca-c2b48659748e\" (UID: \"cb26cd12-4da5-4a28-8fca-c2b48659748e\") "
Jul 29 01:20:28.877897 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:28.877870    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb26cd12-4da5-4a28-8fca-c2b48659748e-kube-api-access-qdvxb" (OuterVolumeSpecName: "kube-api-access-qdvxb") pod "cb26cd12-4da5-4a28-8fca-c2b48659748e" (UID: "cb26cd12-4da5-4a28-8fca-c2b48659748e"). InnerVolumeSpecName "kube-api-access-qdvxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:20:28.976849 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:28.976811    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdvxb\" (UniqueName: \"kubernetes.io/projected/cb26cd12-4da5-4a28-8fca-c2b48659748e-kube-api-access-qdvxb\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:20:29.597116 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:29.597082    2558 generic.go:356] "Generic (PLEG): container finished" podID="cb26cd12-4da5-4a28-8fca-c2b48659748e" containerID="1b699bbe4daf556e8780f62d741f2e74bb3a92aed8cb3a7765006d36f69e9e66" exitCode=0
Jul 29 01:20:29.597588 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:29.597126    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-26r9m"
Jul 29 01:20:29.597588 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:29.597170    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-26r9m" event={"ID":"cb26cd12-4da5-4a28-8fca-c2b48659748e","Type":"ContainerDied","Data":"1b699bbe4daf556e8780f62d741f2e74bb3a92aed8cb3a7765006d36f69e9e66"}
Jul 29 01:20:29.597588 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:29.597238    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-26r9m" event={"ID":"cb26cd12-4da5-4a28-8fca-c2b48659748e","Type":"ContainerDied","Data":"d627dc99fbd0e67d81c245420e221d16f1ac31a00b53f4aa57c16d73e328a5da"}
Jul 29 01:20:29.597588 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:29.597259    2558 scope.go:117] "RemoveContainer" containerID="1b699bbe4daf556e8780f62d741f2e74bb3a92aed8cb3a7765006d36f69e9e66"
Jul 29 01:20:29.606093 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:29.606068    2558 scope.go:117] "RemoveContainer" containerID="1b699bbe4daf556e8780f62d741f2e74bb3a92aed8cb3a7765006d36f69e9e66"
Jul 29 01:20:29.606399 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:20:29.606378    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b699bbe4daf556e8780f62d741f2e74bb3a92aed8cb3a7765006d36f69e9e66\": container with ID starting with 1b699bbe4daf556e8780f62d741f2e74bb3a92aed8cb3a7765006d36f69e9e66 not found: ID does not exist" containerID="1b699bbe4daf556e8780f62d741f2e74bb3a92aed8cb3a7765006d36f69e9e66"
Jul 29 01:20:29.606479 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:29.606406    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b699bbe4daf556e8780f62d741f2e74bb3a92aed8cb3a7765006d36f69e9e66"} err="failed to get container status \"1b699bbe4daf556e8780f62d741f2e74bb3a92aed8cb3a7765006d36f69e9e66\": rpc error: code = NotFound desc = could not find container \"1b699bbe4daf556e8780f62d741f2e74bb3a92aed8cb3a7765006d36f69e9e66\": container with ID starting with 1b699bbe4daf556e8780f62d741f2e74bb3a92aed8cb3a7765006d36f69e9e66 not found: ID does not exist"
Jul 29 01:20:29.625773 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:29.625743    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-26r9m"]
Jul 29 01:20:29.632810 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:29.632789    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-26r9m"]
Jul 29 01:20:31.039314 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:31.039282    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb26cd12-4da5-4a28-8fca-c2b48659748e" path="/var/lib/kubelet/pods/cb26cd12-4da5-4a28-8fca-c2b48659748e/volumes"
Jul 29 01:20:38.591853 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:38.591822    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"
Jul 29 01:20:42.773200 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:42.773155    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:42.896038 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:42.895994    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:43.446511 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:43.446474    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:55.628081 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:55.628037    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:55.848521 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:55.848489    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dhw8s"]
Jul 29 01:20:55.848854 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:55.848840    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb26cd12-4da5-4a28-8fca-c2b48659748e" containerName="authorino"
Jul 29 01:20:55.848900 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:55.848856    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb26cd12-4da5-4a28-8fca-c2b48659748e" containerName="authorino"
Jul 29 01:20:55.848936 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:55.848911    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb26cd12-4da5-4a28-8fca-c2b48659748e" containerName="authorino"
Jul 29 01:20:55.850862 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:55.850845    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dhw8s"
Jul 29 01:20:55.853605 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:55.853584    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j4dcq\""
Jul 29 01:20:55.860443 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:55.860417    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dhw8s"]
Jul 29 01:20:55.912705 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:55.912634    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:20:55.989061 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:55.989032    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5wbd\" (UniqueName: \"kubernetes.io/projected/00bf753f-1597-44e4-85da-ba74a645da9a-kube-api-access-k5wbd\") pod \"authorino-5d4b67c446-dhw8s\" (UID: \"00bf753f-1597-44e4-85da-ba74a645da9a\") " pod="kuadrant-system/authorino-5d4b67c446-dhw8s"
Jul 29 01:20:56.033742 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.033710    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dhw8s"]
Jul 29 01:20:56.033961 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:20:56.033943    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-k5wbd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-dhw8s" podUID="00bf753f-1597-44e4-85da-ba74a645da9a"
Jul 29 01:20:56.055127 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.055090    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-z4jcq"]
Jul 29 01:20:56.057613 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.057597    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-z4jcq"
Jul 29 01:20:56.061487 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.061465    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 29 01:20:56.066343 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.066323    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-z4jcq"]
Jul 29 01:20:56.089505 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.089476    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5wbd\" (UniqueName: \"kubernetes.io/projected/00bf753f-1597-44e4-85da-ba74a645da9a-kube-api-access-k5wbd\") pod \"authorino-5d4b67c446-dhw8s\" (UID: \"00bf753f-1597-44e4-85da-ba74a645da9a\") " pod="kuadrant-system/authorino-5d4b67c446-dhw8s"
Jul 29 01:20:56.100967 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.100946    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5wbd\" (UniqueName: \"kubernetes.io/projected/00bf753f-1597-44e4-85da-ba74a645da9a-kube-api-access-k5wbd\") pod \"authorino-5d4b67c446-dhw8s\" (UID: \"00bf753f-1597-44e4-85da-ba74a645da9a\") " pod="kuadrant-system/authorino-5d4b67c446-dhw8s"
Jul 29 01:20:56.114879 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.114855    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-z4jcq"]
Jul 29 01:20:56.115078 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:20:56.115060    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-x7qm4 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-x7qm4 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-z4jcq" podUID="2d90ad58-b67d-4352-89fc-567e51420a02"
Jul 29 01:20:56.190102 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.190025    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d90ad58-b67d-4352-89fc-567e51420a02-tls-cert\") pod \"authorino-76877994-z4jcq\" (UID: \"2d90ad58-b67d-4352-89fc-567e51420a02\") " pod="kuadrant-system/authorino-76877994-z4jcq"
Jul 29 01:20:56.190102 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.190089    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7qm4\" (UniqueName: \"kubernetes.io/projected/2d90ad58-b67d-4352-89fc-567e51420a02-kube-api-access-x7qm4\") pod \"authorino-76877994-z4jcq\" (UID: \"2d90ad58-b67d-4352-89fc-567e51420a02\") " pod="kuadrant-system/authorino-76877994-z4jcq"
Jul 29 01:20:56.291387 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.291347    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7qm4\" (UniqueName: \"kubernetes.io/projected/2d90ad58-b67d-4352-89fc-567e51420a02-kube-api-access-x7qm4\") pod \"authorino-76877994-z4jcq\" (UID: \"2d90ad58-b67d-4352-89fc-567e51420a02\") " pod="kuadrant-system/authorino-76877994-z4jcq"
Jul 29 01:20:56.291387 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.291393    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d90ad58-b67d-4352-89fc-567e51420a02-tls-cert\") pod \"authorino-76877994-z4jcq\" (UID: \"2d90ad58-b67d-4352-89fc-567e51420a02\") " pod="kuadrant-system/authorino-76877994-z4jcq"
Jul 29 01:20:56.293871 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.293844    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d90ad58-b67d-4352-89fc-567e51420a02-tls-cert\") pod \"authorino-76877994-z4jcq\" (UID: \"2d90ad58-b67d-4352-89fc-567e51420a02\") " pod="kuadrant-system/authorino-76877994-z4jcq"
Jul 29 01:20:56.300675 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.300647    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7qm4\" (UniqueName: \"kubernetes.io/projected/2d90ad58-b67d-4352-89fc-567e51420a02-kube-api-access-x7qm4\") pod \"authorino-76877994-z4jcq\" (UID: \"2d90ad58-b67d-4352-89fc-567e51420a02\") " pod="kuadrant-system/authorino-76877994-z4jcq"
Jul 29 01:20:56.724046 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.724013    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-z4jcq"
Jul 29 01:20:56.724486 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.724013    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dhw8s"
Jul 29 01:20:56.736446 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.736420    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dhw8s"
Jul 29 01:20:56.737591 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.737573    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-z4jcq"
Jul 29 01:20:56.897347 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.897316    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7qm4\" (UniqueName: \"kubernetes.io/projected/2d90ad58-b67d-4352-89fc-567e51420a02-kube-api-access-x7qm4\") pod \"2d90ad58-b67d-4352-89fc-567e51420a02\" (UID: \"2d90ad58-b67d-4352-89fc-567e51420a02\") "
Jul 29 01:20:56.897521 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.897389    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d90ad58-b67d-4352-89fc-567e51420a02-tls-cert\") pod \"2d90ad58-b67d-4352-89fc-567e51420a02\" (UID: \"2d90ad58-b67d-4352-89fc-567e51420a02\") "
Jul 29 01:20:56.897521 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.897446    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5wbd\" (UniqueName: \"kubernetes.io/projected/00bf753f-1597-44e4-85da-ba74a645da9a-kube-api-access-k5wbd\") pod \"00bf753f-1597-44e4-85da-ba74a645da9a\" (UID: \"00bf753f-1597-44e4-85da-ba74a645da9a\") "
Jul 29 01:20:56.899502 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.899466    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d90ad58-b67d-4352-89fc-567e51420a02-kube-api-access-x7qm4" (OuterVolumeSpecName: "kube-api-access-x7qm4") pod "2d90ad58-b67d-4352-89fc-567e51420a02" (UID: "2d90ad58-b67d-4352-89fc-567e51420a02"). InnerVolumeSpecName "kube-api-access-x7qm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:20:56.899628 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.899474    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d90ad58-b67d-4352-89fc-567e51420a02-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2d90ad58-b67d-4352-89fc-567e51420a02" (UID: "2d90ad58-b67d-4352-89fc-567e51420a02"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:20:56.899628 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.899534    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00bf753f-1597-44e4-85da-ba74a645da9a-kube-api-access-k5wbd" (OuterVolumeSpecName: "kube-api-access-k5wbd") pod "00bf753f-1597-44e4-85da-ba74a645da9a" (UID: "00bf753f-1597-44e4-85da-ba74a645da9a"). InnerVolumeSpecName "kube-api-access-k5wbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:20:56.998704 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.998625    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7qm4\" (UniqueName: \"kubernetes.io/projected/2d90ad58-b67d-4352-89fc-567e51420a02-kube-api-access-x7qm4\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:20:56.998704 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.998663    2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d90ad58-b67d-4352-89fc-567e51420a02-tls-cert\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:20:56.998704 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:56.998674    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5wbd\" (UniqueName: \"kubernetes.io/projected/00bf753f-1597-44e4-85da-ba74a645da9a-kube-api-access-k5wbd\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:20:57.728600 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:57.728564    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-z4jcq"
Jul 29 01:20:57.729062 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:57.728564    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dhw8s"
Jul 29 01:20:57.760481 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:57.760445    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dhw8s"]
Jul 29 01:20:57.762595 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:57.762572    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dhw8s"]
Jul 29 01:20:57.785632 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:57.785605    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-z4jcq"]
Jul 29 01:20:57.789507 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:57.789480    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-z4jcq"]
Jul 29 01:20:59.037642 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:59.037600    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00bf753f-1597-44e4-85da-ba74a645da9a" path="/var/lib/kubelet/pods/00bf753f-1597-44e4-85da-ba74a645da9a/volumes"
Jul 29 01:20:59.038139 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:20:59.037961    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d90ad58-b67d-4352-89fc-567e51420a02" path="/var/lib/kubelet/pods/2d90ad58-b67d-4352-89fc-567e51420a02/volumes"
Jul 29 01:21:02.104492 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.104459    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:02.207523 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.207487    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:02.330207 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.330161    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d447d7688-46vrq"]
Jul 29 01:21:02.337371 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.337349    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d447d7688-46vrq"
Jul 29 01:21:02.340973 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.340949    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 01:21:02.341118 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.341024    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pqq85\""
Jul 29 01:21:02.341118 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.340954    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 01:21:02.342633 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.342614    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d447d7688-46vrq"]
Jul 29 01:21:02.444974 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.444899    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxgf6\" (UniqueName: \"kubernetes.io/projected/e67f9848-9f91-495e-9020-b9d2342e0563-kube-api-access-kxgf6\") pod \"maas-controller-d447d7688-46vrq\" (UID: \"e67f9848-9f91-495e-9020-b9d2342e0563\") " pod="opendatahub/maas-controller-d447d7688-46vrq"
Jul 29 01:21:02.444974 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.444934    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e67f9848-9f91-495e-9020-b9d2342e0563-webhook-cert\") pod \"maas-controller-d447d7688-46vrq\" (UID: \"e67f9848-9f91-495e-9020-b9d2342e0563\") " pod="opendatahub/maas-controller-d447d7688-46vrq"
Jul 29 01:21:02.513692 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.513657    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:02.545960 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.545930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxgf6\" (UniqueName: \"kubernetes.io/projected/e67f9848-9f91-495e-9020-b9d2342e0563-kube-api-access-kxgf6\") pod \"maas-controller-d447d7688-46vrq\" (UID: \"e67f9848-9f91-495e-9020-b9d2342e0563\") " pod="opendatahub/maas-controller-d447d7688-46vrq"
Jul 29 01:21:02.546077 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.545961    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e67f9848-9f91-495e-9020-b9d2342e0563-webhook-cert\") pod \"maas-controller-d447d7688-46vrq\" (UID: \"e67f9848-9f91-495e-9020-b9d2342e0563\") " pod="opendatahub/maas-controller-d447d7688-46vrq"
Jul 29 01:21:02.548373 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.548347    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e67f9848-9f91-495e-9020-b9d2342e0563-webhook-cert\") pod \"maas-controller-d447d7688-46vrq\" (UID: \"e67f9848-9f91-495e-9020-b9d2342e0563\") " pod="opendatahub/maas-controller-d447d7688-46vrq"
Jul 29 01:21:02.555513 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.555483    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxgf6\" (UniqueName: \"kubernetes.io/projected/e67f9848-9f91-495e-9020-b9d2342e0563-kube-api-access-kxgf6\") pod \"maas-controller-d447d7688-46vrq\" (UID: \"e67f9848-9f91-495e-9020-b9d2342e0563\") " pod="opendatahub/maas-controller-d447d7688-46vrq"
Jul 29 01:21:02.648904 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.648878    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d447d7688-46vrq"
Jul 29 01:21:02.785514 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:02.785487    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d447d7688-46vrq"]
Jul 29 01:21:02.787461 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:21:02.787435    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67f9848_9f91_495e_9020_b9d2342e0563.slice/crio-bfda112733344018b7f3fe9ef94334af11a3a26d5070198a34d7e4e68ed28d29 WatchSource:0}: Error finding container bfda112733344018b7f3fe9ef94334af11a3a26d5070198a34d7e4e68ed28d29: Status 404 returned error can't find the container with id bfda112733344018b7f3fe9ef94334af11a3a26d5070198a34d7e4e68ed28d29
Jul 29 01:21:03.761536 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:03.761485    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d447d7688-46vrq" event={"ID":"e67f9848-9f91-495e-9020-b9d2342e0563","Type":"ContainerStarted","Data":"bfda112733344018b7f3fe9ef94334af11a3a26d5070198a34d7e4e68ed28d29"}
Jul 29 01:21:05.107006 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:05.106965    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:05.205347 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:05.205318    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:05.309083 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:05.309048    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:05.775550 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:05.775515    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d447d7688-46vrq" event={"ID":"e67f9848-9f91-495e-9020-b9d2342e0563","Type":"ContainerStarted","Data":"fea3b54561dda66b7fba127f36b0a3bd70cac80e1c313cb99137b2dd94137339"}
Jul 29 01:21:05.775717 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:05.775620    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d447d7688-46vrq"
Jul 29 01:21:05.795185 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:05.795135    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d447d7688-46vrq" podStartSLOduration=1.574511267 podStartE2EDuration="3.795121021s" totalImagesPullingTime="2.220609754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:21:05.792363442 +0000 UTC m=+695.292798897" watchObservedRunningTime="2026-07-29 01:21:05.795121021 +0000 UTC m=+695.295556527"
Jul 29 01:21:16.783329 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:16.783301    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d447d7688-46vrq"
Jul 29 01:21:37.669684 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:37.669642    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:37.767722 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:37.767680    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:38.336683 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:38.336649    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:38.599391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:38.599300    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:38.794287 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:38.794246    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:38.864551 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:38.864474    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:38.953744 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:38.953703    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:21:49.886460 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:49.886406    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:21:50.006159 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:21:50.006116    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:07.721608 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:07.721573    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:08.105462 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:08.105433    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:22:15.905523 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:15.905491    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"]
Jul 29 01:22:15.909315 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:15.909294    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:15.915426 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:15.915405    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s5586\""
Jul 29 01:22:15.915717 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:15.915623    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 29 01:22:15.915884 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:15.915670    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 01:22:15.916749 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:15.916731    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 01:22:15.936365 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:15.936339    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95b155b9-dd1e-4f93-aa50-93c6e91a931f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:15.936472 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:15.936369    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95b155b9-dd1e-4f93-aa50-93c6e91a931f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:15.936472 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:15.936388    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95b155b9-dd1e-4f93-aa50-93c6e91a931f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:15.936472 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:15.936440    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5r5z\" (UniqueName: \"kubernetes.io/projected/95b155b9-dd1e-4f93-aa50-93c6e91a931f-kube-api-access-t5r5z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:15.936635 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:15.936485    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95b155b9-dd1e-4f93-aa50-93c6e91a931f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:15.936635 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:15.936520    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95b155b9-dd1e-4f93-aa50-93c6e91a931f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:15.938875 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:15.938853    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"]
Jul 29 01:22:16.037600 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.037570    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95b155b9-dd1e-4f93-aa50-93c6e91a931f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:16.037772 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.037607    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95b155b9-dd1e-4f93-aa50-93c6e91a931f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:16.037772 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.037643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95b155b9-dd1e-4f93-aa50-93c6e91a931f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:16.037772 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.037683    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5r5z\" (UniqueName: \"kubernetes.io/projected/95b155b9-dd1e-4f93-aa50-93c6e91a931f-kube-api-access-t5r5z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:16.037772 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.037710    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95b155b9-dd1e-4f93-aa50-93c6e91a931f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:16.038009 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.037888    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95b155b9-dd1e-4f93-aa50-93c6e91a931f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:16.038009 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.037979    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95b155b9-dd1e-4f93-aa50-93c6e91a931f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:16.038126 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.038037    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95b155b9-dd1e-4f93-aa50-93c6e91a931f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:16.038276 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.038252    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95b155b9-dd1e-4f93-aa50-93c6e91a931f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:16.039809 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.039785    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95b155b9-dd1e-4f93-aa50-93c6e91a931f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:16.040259 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.040239    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95b155b9-dd1e-4f93-aa50-93c6e91a931f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:16.058533 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.058503    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:16.061559 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.061541    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5r5z\" (UniqueName: \"kubernetes.io/projected/95b155b9-dd1e-4f93-aa50-93c6e91a931f-kube-api-access-t5r5z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kz48j\" (UID: \"95b155b9-dd1e-4f93-aa50-93c6e91a931f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:16.219694 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.219614    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:16.349679 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.349656    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"]
Jul 29 01:22:16.351757 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:22:16.351733    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b155b9_dd1e_4f93_aa50_93c6e91a931f.slice/crio-07dffebf8432db7b44f18bc0701fe482b7e1d393c87672eaad3c3d58c2db0304 WatchSource:0}: Error finding container 07dffebf8432db7b44f18bc0701fe482b7e1d393c87672eaad3c3d58c2db0304: Status 404 returned error can't find the container with id 07dffebf8432db7b44f18bc0701fe482b7e1d393c87672eaad3c3d58c2db0304
Jul 29 01:22:16.353027 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.353011    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:22:16.901739 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:16.901701    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:22:17.146554 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:17.146519    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j" event={"ID":"95b155b9-dd1e-4f93-aa50-93c6e91a931f","Type":"ContainerStarted","Data":"07dffebf8432db7b44f18bc0701fe482b7e1d393c87672eaad3c3d58c2db0304"}
Jul 29 01:22:18.152427 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:18.152385    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j" event={"ID":"95b155b9-dd1e-4f93-aa50-93c6e91a931f","Type":"ContainerStarted","Data":"8d12e609abc9b6d75ffbd9dd3036cb68e3a220a882dc670e41bf48c7e6295794"}
Jul 29 01:22:18.171894 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:18.171845    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j" podStartSLOduration=2.136037351 podStartE2EDuration="3.171831018s" totalImagesPullingTime="1.035793667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:18.169433262 +0000 UTC m=+767.669868715" watchObservedRunningTime="2026-07-29 01:22:18.171831018 +0000 UTC m=+767.672266447"
Jul 29 01:22:21.301989 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:21.301949    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:22.406772 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:22.406735    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:22:25.402636 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.402603    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"]
Jul 29 01:22:25.405150 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.405120    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.407801 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.407774    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 29 01:22:25.420024 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.419999    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"]
Jul 29 01:22:25.430047 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.430018    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:25.511961 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.511926    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlbqm\" (UniqueName: \"kubernetes.io/projected/8e495693-7773-42ce-aa71-14de86385cdb-kube-api-access-wlbqm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.512144 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.512005    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e495693-7773-42ce-aa71-14de86385cdb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.512144 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.512034    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e495693-7773-42ce-aa71-14de86385cdb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.512144 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.512066    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e495693-7773-42ce-aa71-14de86385cdb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.512144 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.512121    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e495693-7773-42ce-aa71-14de86385cdb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.512347 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.512151    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e495693-7773-42ce-aa71-14de86385cdb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.613304 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.613270    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e495693-7773-42ce-aa71-14de86385cdb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.613304 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.613305    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e495693-7773-42ce-aa71-14de86385cdb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.613530 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.613330    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e495693-7773-42ce-aa71-14de86385cdb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.613530 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.613349    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e495693-7773-42ce-aa71-14de86385cdb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.613530 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.613488    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e495693-7773-42ce-aa71-14de86385cdb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.613692 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.613564    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlbqm\" (UniqueName: \"kubernetes.io/projected/8e495693-7773-42ce-aa71-14de86385cdb-kube-api-access-wlbqm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.613757 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.613712    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e495693-7773-42ce-aa71-14de86385cdb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.613827 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.613800    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e495693-7773-42ce-aa71-14de86385cdb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.613889 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.613872    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e495693-7773-42ce-aa71-14de86385cdb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.615570 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.615545    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e495693-7773-42ce-aa71-14de86385cdb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.615807 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.615790    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e495693-7773-42ce-aa71-14de86385cdb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.622753 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.622724    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlbqm\" (UniqueName: \"kubernetes.io/projected/8e495693-7773-42ce-aa71-14de86385cdb-kube-api-access-wlbqm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd\" (UID: \"8e495693-7773-42ce-aa71-14de86385cdb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.715200 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.715123    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:25.866228 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:25.866202    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"]
Jul 29 01:22:25.868253 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:22:25.868223    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e495693_7773_42ce_aa71_14de86385cdb.slice/crio-04d6c3f0d35c29058956f2ab3417007d15a14b4fe67c2d3e0a06839b743177d4 WatchSource:0}: Error finding container 04d6c3f0d35c29058956f2ab3417007d15a14b4fe67c2d3e0a06839b743177d4: Status 404 returned error can't find the container with id 04d6c3f0d35c29058956f2ab3417007d15a14b4fe67c2d3e0a06839b743177d4
Jul 29 01:22:26.192616 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:26.192575    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd" event={"ID":"8e495693-7773-42ce-aa71-14de86385cdb","Type":"ContainerStarted","Data":"c3c8f0af2a4f7d3266c38d1836cc08f5c711a774caafd862cecb8cebd0bbed40"}
Jul 29 01:22:26.192795 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:26.192635    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd" event={"ID":"8e495693-7773-42ce-aa71-14de86385cdb","Type":"ContainerStarted","Data":"04d6c3f0d35c29058956f2ab3417007d15a14b4fe67c2d3e0a06839b743177d4"}
Jul 29 01:22:26.209428 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:26.209383    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd" podStartSLOduration=1.023968115 podStartE2EDuration="1.209367905s" totalImagesPullingTime="185.39979ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:26.20880023 +0000 UTC m=+775.709235683" watchObservedRunningTime="2026-07-29 01:22:26.209367905 +0000 UTC m=+775.709803357"
Jul 29 01:22:26.219742 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:26.219719    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:26.219854 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:26.219777    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:26.231824 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:26.231800    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:27.208610 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:27.208580    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kz48j"
Jul 29 01:22:27.706624 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:27.706583    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:22:35.715996 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:35.715911    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:35.715996 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:35.715972    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:35.728357 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:35.728333    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:36.255843 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:36.255813    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd"
Jul 29 01:22:42.486729 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:42.486694    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:45.304450 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:45.304420    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:22:50.403596 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.403565    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"]
Jul 29 01:22:50.409606 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.409559    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.412287 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.412265    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 29 01:22:50.419061 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.419037    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"]
Jul 29 01:22:50.452391 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.452354    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:22:50.513467 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.513440    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2612412e-2da3-4382-bb37-21350e9ef8a9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.513621 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.513483    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwg2c\" (UniqueName: \"kubernetes.io/projected/2612412e-2da3-4382-bb37-21350e9ef8a9-kube-api-access-wwg2c\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.513621 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.513532    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2612412e-2da3-4382-bb37-21350e9ef8a9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.513621 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.513572    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2612412e-2da3-4382-bb37-21350e9ef8a9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.513621 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.513604    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2612412e-2da3-4382-bb37-21350e9ef8a9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.513758 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.513623    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2612412e-2da3-4382-bb37-21350e9ef8a9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.614812 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.614768    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2612412e-2da3-4382-bb37-21350e9ef8a9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.614812 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.614814    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2612412e-2da3-4382-bb37-21350e9ef8a9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.615058 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.614866    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2612412e-2da3-4382-bb37-21350e9ef8a9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.615058 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.614913    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwg2c\" (UniqueName: \"kubernetes.io/projected/2612412e-2da3-4382-bb37-21350e9ef8a9-kube-api-access-wwg2c\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.615058 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.614951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2612412e-2da3-4382-bb37-21350e9ef8a9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.615058 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.614998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2612412e-2da3-4382-bb37-21350e9ef8a9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.615313 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.615293    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2612412e-2da3-4382-bb37-21350e9ef8a9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.615370 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.615351    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2612412e-2da3-4382-bb37-21350e9ef8a9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.615443 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.615418    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2612412e-2da3-4382-bb37-21350e9ef8a9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.617314 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.617288    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2612412e-2da3-4382-bb37-21350e9ef8a9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.617533 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.617518    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2612412e-2da3-4382-bb37-21350e9ef8a9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.623918 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.623891    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwg2c\" (UniqueName: \"kubernetes.io/projected/2612412e-2da3-4382-bb37-21350e9ef8a9-kube-api-access-wwg2c\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f\" (UID: \"2612412e-2da3-4382-bb37-21350e9ef8a9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.719284 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.719166    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:22:50.851741 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:50.851714    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"]
Jul 29 01:22:50.854193 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:22:50.854146    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2612412e_2da3_4382_bb37_21350e9ef8a9.slice/crio-18024c6f0fa394451d522df3cfc8d6541c09aea5e88195dce3d36af7f26e5300 WatchSource:0}: Error finding container 18024c6f0fa394451d522df3cfc8d6541c09aea5e88195dce3d36af7f26e5300: Status 404 returned error can't find the container with id 18024c6f0fa394451d522df3cfc8d6541c09aea5e88195dce3d36af7f26e5300
Jul 29 01:22:51.321410 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:51.321314    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f" event={"ID":"2612412e-2da3-4382-bb37-21350e9ef8a9","Type":"ContainerStarted","Data":"a1f0f0ce2757bd7cac7a3c71a964f2f68d3b2ce4a00bdefaf22fe39088d56ad4"}
Jul 29 01:22:51.321410 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:51.321360    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f" event={"ID":"2612412e-2da3-4382-bb37-21350e9ef8a9","Type":"ContainerStarted","Data":"18024c6f0fa394451d522df3cfc8d6541c09aea5e88195dce3d36af7f26e5300"}
Jul 29 01:22:51.346195 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:22:51.342904    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f" podStartSLOduration=1.163431557 podStartE2EDuration="1.342884074s" totalImagesPullingTime="179.452517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:51.340273202 +0000 UTC m=+800.840708648" watchObservedRunningTime="2026-07-29 01:22:51.342884074 +0000 UTC m=+800.843319526"
Jul 29 01:23:00.310513 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:23:00.310435    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:23:00.585343 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:23:00.585254    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:00.719853 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:23:00.719825    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:23:00.720006 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:23:00.719872    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:23:00.731910 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:23:00.731884    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:23:01.388032 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:23:01.388006    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f"
Jul 29 01:23:27.552673 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:23:27.552638    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:27.607500 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:23:27.607469    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:23:52.757331 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:23:52.757293    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:00.217389 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:00.217353    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:00.317914 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:00.317877    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:01.403336 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:01.403294    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:01.498123 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:01.498082    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:17.860878 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:17.860839    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:17.916078 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:17.916047    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:31.308355 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:31.308321    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:24:31.960983 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:31.960943    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:40.397732 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:40.397693    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:24:47.464062 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:47.464025    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:24:48.514879 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.514838    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d447d7688-46vrq"]
Jul 29 01:24:48.515385 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.515073    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d447d7688-46vrq" podUID="e67f9848-9f91-495e-9020-b9d2342e0563" containerName="manager" containerID="cri-o://fea3b54561dda66b7fba127f36b0a3bd70cac80e1c313cb99137b2dd94137339" gracePeriod=30
Jul 29 01:24:48.763488 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.763464    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d447d7688-46vrq"
Jul 29 01:24:48.775110 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.775064    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e67f9848-9f91-495e-9020-b9d2342e0563-webhook-cert\") pod \"e67f9848-9f91-495e-9020-b9d2342e0563\" (UID: \"e67f9848-9f91-495e-9020-b9d2342e0563\") "
Jul 29 01:24:48.775229 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.775107    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxgf6\" (UniqueName: \"kubernetes.io/projected/e67f9848-9f91-495e-9020-b9d2342e0563-kube-api-access-kxgf6\") pod \"e67f9848-9f91-495e-9020-b9d2342e0563\" (UID: \"e67f9848-9f91-495e-9020-b9d2342e0563\") "
Jul 29 01:24:48.777201 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.777165    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67f9848-9f91-495e-9020-b9d2342e0563-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e67f9848-9f91-495e-9020-b9d2342e0563" (UID: "e67f9848-9f91-495e-9020-b9d2342e0563"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:24:48.777280 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.777244    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e67f9848-9f91-495e-9020-b9d2342e0563-kube-api-access-kxgf6" (OuterVolumeSpecName: "kube-api-access-kxgf6") pod "e67f9848-9f91-495e-9020-b9d2342e0563" (UID: "e67f9848-9f91-495e-9020-b9d2342e0563"). InnerVolumeSpecName "kube-api-access-kxgf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:24:48.876279 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.876245    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e67f9848-9f91-495e-9020-b9d2342e0563-webhook-cert\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:24:48.876279 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.876273    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxgf6\" (UniqueName: \"kubernetes.io/projected/e67f9848-9f91-495e-9020-b9d2342e0563-kube-api-access-kxgf6\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:24:48.929743 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.929707    2558 generic.go:356] "Generic (PLEG): container finished" podID="e67f9848-9f91-495e-9020-b9d2342e0563" containerID="fea3b54561dda66b7fba127f36b0a3bd70cac80e1c313cb99137b2dd94137339" exitCode=0
Jul 29 01:24:48.929888 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.929749    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d447d7688-46vrq"
Jul 29 01:24:48.929888 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.929796    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d447d7688-46vrq" event={"ID":"e67f9848-9f91-495e-9020-b9d2342e0563","Type":"ContainerDied","Data":"fea3b54561dda66b7fba127f36b0a3bd70cac80e1c313cb99137b2dd94137339"}
Jul 29 01:24:48.929888 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.929849    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d447d7688-46vrq" event={"ID":"e67f9848-9f91-495e-9020-b9d2342e0563","Type":"ContainerDied","Data":"bfda112733344018b7f3fe9ef94334af11a3a26d5070198a34d7e4e68ed28d29"}
Jul 29 01:24:48.929888 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.929872    2558 scope.go:117] "RemoveContainer" containerID="fea3b54561dda66b7fba127f36b0a3bd70cac80e1c313cb99137b2dd94137339"
Jul 29 01:24:48.940120 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.940102    2558 scope.go:117] "RemoveContainer" containerID="fea3b54561dda66b7fba127f36b0a3bd70cac80e1c313cb99137b2dd94137339"
Jul 29 01:24:48.940458 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:24:48.940435    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fea3b54561dda66b7fba127f36b0a3bd70cac80e1c313cb99137b2dd94137339\": container with ID starting with fea3b54561dda66b7fba127f36b0a3bd70cac80e1c313cb99137b2dd94137339 not found: ID does not exist" containerID="fea3b54561dda66b7fba127f36b0a3bd70cac80e1c313cb99137b2dd94137339"
Jul 29 01:24:48.940513 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.940470    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fea3b54561dda66b7fba127f36b0a3bd70cac80e1c313cb99137b2dd94137339"} err="failed to get container status \"fea3b54561dda66b7fba127f36b0a3bd70cac80e1c313cb99137b2dd94137339\": rpc error: code = NotFound desc = could not find container \"fea3b54561dda66b7fba127f36b0a3bd70cac80e1c313cb99137b2dd94137339\": container with ID starting with fea3b54561dda66b7fba127f36b0a3bd70cac80e1c313cb99137b2dd94137339 not found: ID does not exist"
Jul 29 01:24:48.953099 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.953071    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d447d7688-46vrq"]
Jul 29 01:24:48.956976 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:48.956946    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d447d7688-46vrq"]
Jul 29 01:24:49.038044 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:49.037969    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e67f9848-9f91-495e-9020-b9d2342e0563" path="/var/lib/kubelet/pods/e67f9848-9f91-495e-9020-b9d2342e0563/volumes"
Jul 29 01:24:50.802118 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:24:50.802083    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:25:49.776444 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.776404    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d447d7688-4mb5z"]
Jul 29 01:25:49.777064 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.776752    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67f9848-9f91-495e-9020-b9d2342e0563" containerName="manager"
Jul 29 01:25:49.777064 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.776763    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67f9848-9f91-495e-9020-b9d2342e0563" containerName="manager"
Jul 29 01:25:49.777064 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.776815    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e67f9848-9f91-495e-9020-b9d2342e0563" containerName="manager"
Jul 29 01:25:49.780722 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.780704    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d447d7688-4mb5z"
Jul 29 01:25:49.784478 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.784450    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 01:25:49.784630 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.784481    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 01:25:49.784630 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.784529    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pqq85\""
Jul 29 01:25:49.790153 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.790132    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d447d7688-4mb5z"]
Jul 29 01:25:49.876237 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.876202    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p5qx\" (UniqueName: \"kubernetes.io/projected/ee834ac0-b17e-47aa-8f7d-be1f2b3055cc-kube-api-access-2p5qx\") pod \"maas-controller-d447d7688-4mb5z\" (UID: \"ee834ac0-b17e-47aa-8f7d-be1f2b3055cc\") " pod="opendatahub/maas-controller-d447d7688-4mb5z"
Jul 29 01:25:49.876410 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.876250    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee834ac0-b17e-47aa-8f7d-be1f2b3055cc-webhook-cert\") pod \"maas-controller-d447d7688-4mb5z\" (UID: \"ee834ac0-b17e-47aa-8f7d-be1f2b3055cc\") " pod="opendatahub/maas-controller-d447d7688-4mb5z"
Jul 29 01:25:49.977224 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.977163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p5qx\" (UniqueName: \"kubernetes.io/projected/ee834ac0-b17e-47aa-8f7d-be1f2b3055cc-kube-api-access-2p5qx\") pod \"maas-controller-d447d7688-4mb5z\" (UID: \"ee834ac0-b17e-47aa-8f7d-be1f2b3055cc\") " pod="opendatahub/maas-controller-d447d7688-4mb5z"
Jul 29 01:25:49.977411 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.977238    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee834ac0-b17e-47aa-8f7d-be1f2b3055cc-webhook-cert\") pod \"maas-controller-d447d7688-4mb5z\" (UID: \"ee834ac0-b17e-47aa-8f7d-be1f2b3055cc\") " pod="opendatahub/maas-controller-d447d7688-4mb5z"
Jul 29 01:25:49.979601 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.979574    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee834ac0-b17e-47aa-8f7d-be1f2b3055cc-webhook-cert\") pod \"maas-controller-d447d7688-4mb5z\" (UID: \"ee834ac0-b17e-47aa-8f7d-be1f2b3055cc\") " pod="opendatahub/maas-controller-d447d7688-4mb5z"
Jul 29 01:25:49.986835 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:49.986813    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p5qx\" (UniqueName: \"kubernetes.io/projected/ee834ac0-b17e-47aa-8f7d-be1f2b3055cc-kube-api-access-2p5qx\") pod \"maas-controller-d447d7688-4mb5z\" (UID: \"ee834ac0-b17e-47aa-8f7d-be1f2b3055cc\") " pod="opendatahub/maas-controller-d447d7688-4mb5z"
Jul 29 01:25:50.092038 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:50.091941    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d447d7688-4mb5z"
Jul 29 01:25:50.224885 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:50.224861    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d447d7688-4mb5z"]
Jul 29 01:25:50.229305 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:25:50.226743    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee834ac0_b17e_47aa_8f7d_be1f2b3055cc.slice/crio-56ab4fbb963f5ec9e19d493fc5378a3497cccd1986c64f51dbc2e5fd914a1adf WatchSource:0}: Error finding container 56ab4fbb963f5ec9e19d493fc5378a3497cccd1986c64f51dbc2e5fd914a1adf: Status 404 returned error can't find the container with id 56ab4fbb963f5ec9e19d493fc5378a3497cccd1986c64f51dbc2e5fd914a1adf
Jul 29 01:25:50.250813 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:50.250782    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d447d7688-4mb5z" event={"ID":"ee834ac0-b17e-47aa-8f7d-be1f2b3055cc","Type":"ContainerStarted","Data":"56ab4fbb963f5ec9e19d493fc5378a3497cccd1986c64f51dbc2e5fd914a1adf"}
Jul 29 01:25:51.257432 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:51.257399    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d447d7688-4mb5z" event={"ID":"ee834ac0-b17e-47aa-8f7d-be1f2b3055cc","Type":"ContainerStarted","Data":"79d7b8343eda70c9d12ca6535623139ae11cf3f19e6c8093bf65670dca5fd224"}
Jul 29 01:25:51.257842 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:51.257513    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d447d7688-4mb5z"
Jul 29 01:25:51.274577 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:25:51.274533    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d447d7688-4mb5z" podStartSLOduration=1.852698416 podStartE2EDuration="2.274517744s" totalImagesPullingTime="421.819328ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:25:51.272849348 +0000 UTC m=+980.773284800" watchObservedRunningTime="2026-07-29 01:25:51.274517744 +0000 UTC m=+980.774953231"
Jul 29 01:26:02.265137 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:02.265064    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d447d7688-4mb5z"
Jul 29 01:26:06.875944 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:06.875895    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:06.953693 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:06.953655    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d447d7688-4mb5z"]
Jul 29 01:26:06.953955 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:06.953927    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d447d7688-4mb5z" podUID="ee834ac0-b17e-47aa-8f7d-be1f2b3055cc" containerName="manager" containerID="cri-o://79d7b8343eda70c9d12ca6535623139ae11cf3f19e6c8093bf65670dca5fd224" gracePeriod=30
Jul 29 01:26:07.193778 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.193750    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d447d7688-4mb5z"
Jul 29 01:26:07.323302 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.323269    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p5qx\" (UniqueName: \"kubernetes.io/projected/ee834ac0-b17e-47aa-8f7d-be1f2b3055cc-kube-api-access-2p5qx\") pod \"ee834ac0-b17e-47aa-8f7d-be1f2b3055cc\" (UID: \"ee834ac0-b17e-47aa-8f7d-be1f2b3055cc\") "
Jul 29 01:26:07.323471 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.323321    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee834ac0-b17e-47aa-8f7d-be1f2b3055cc-webhook-cert\") pod \"ee834ac0-b17e-47aa-8f7d-be1f2b3055cc\" (UID: \"ee834ac0-b17e-47aa-8f7d-be1f2b3055cc\") "
Jul 29 01:26:07.325404 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.325378    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee834ac0-b17e-47aa-8f7d-be1f2b3055cc-kube-api-access-2p5qx" (OuterVolumeSpecName: "kube-api-access-2p5qx") pod "ee834ac0-b17e-47aa-8f7d-be1f2b3055cc" (UID: "ee834ac0-b17e-47aa-8f7d-be1f2b3055cc"). InnerVolumeSpecName "kube-api-access-2p5qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:26:07.325487 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.325463    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee834ac0-b17e-47aa-8f7d-be1f2b3055cc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ee834ac0-b17e-47aa-8f7d-be1f2b3055cc" (UID: "ee834ac0-b17e-47aa-8f7d-be1f2b3055cc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:26:07.340225 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.340200    2558 generic.go:356] "Generic (PLEG): container finished" podID="ee834ac0-b17e-47aa-8f7d-be1f2b3055cc" containerID="79d7b8343eda70c9d12ca6535623139ae11cf3f19e6c8093bf65670dca5fd224" exitCode=0
Jul 29 01:26:07.340357 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.340259    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d447d7688-4mb5z"
Jul 29 01:26:07.340357 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.340290    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d447d7688-4mb5z" event={"ID":"ee834ac0-b17e-47aa-8f7d-be1f2b3055cc","Type":"ContainerDied","Data":"79d7b8343eda70c9d12ca6535623139ae11cf3f19e6c8093bf65670dca5fd224"}
Jul 29 01:26:07.340479 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.340357    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d447d7688-4mb5z" event={"ID":"ee834ac0-b17e-47aa-8f7d-be1f2b3055cc","Type":"ContainerDied","Data":"56ab4fbb963f5ec9e19d493fc5378a3497cccd1986c64f51dbc2e5fd914a1adf"}
Jul 29 01:26:07.340479 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.340388    2558 scope.go:117] "RemoveContainer" containerID="79d7b8343eda70c9d12ca6535623139ae11cf3f19e6c8093bf65670dca5fd224"
Jul 29 01:26:07.348704 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.348687    2558 scope.go:117] "RemoveContainer" containerID="79d7b8343eda70c9d12ca6535623139ae11cf3f19e6c8093bf65670dca5fd224"
Jul 29 01:26:07.348963 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:26:07.348945    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79d7b8343eda70c9d12ca6535623139ae11cf3f19e6c8093bf65670dca5fd224\": container with ID starting with 79d7b8343eda70c9d12ca6535623139ae11cf3f19e6c8093bf65670dca5fd224 not found: ID does not exist" containerID="79d7b8343eda70c9d12ca6535623139ae11cf3f19e6c8093bf65670dca5fd224"
Jul 29 01:26:07.349040 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.348969    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79d7b8343eda70c9d12ca6535623139ae11cf3f19e6c8093bf65670dca5fd224"} err="failed to get container status \"79d7b8343eda70c9d12ca6535623139ae11cf3f19e6c8093bf65670dca5fd224\": rpc error: code = NotFound desc = could not find container \"79d7b8343eda70c9d12ca6535623139ae11cf3f19e6c8093bf65670dca5fd224\": container with ID starting with 79d7b8343eda70c9d12ca6535623139ae11cf3f19e6c8093bf65670dca5fd224 not found: ID does not exist"
Jul 29 01:26:07.364818 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.364790    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d447d7688-4mb5z"]
Jul 29 01:26:07.368702 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.368677    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d447d7688-4mb5z"]
Jul 29 01:26:07.424640 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.424610    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p5qx\" (UniqueName: \"kubernetes.io/projected/ee834ac0-b17e-47aa-8f7d-be1f2b3055cc-kube-api-access-2p5qx\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:26:07.424640 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:07.424634    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee834ac0-b17e-47aa-8f7d-be1f2b3055cc-webhook-cert\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:26:08.094595 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.094562    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:08.218756 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.218729    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d447d7688-qcfjv"]
Jul 29 01:26:08.219068 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.219056    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee834ac0-b17e-47aa-8f7d-be1f2b3055cc" containerName="manager"
Jul 29 01:26:08.219127 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.219069    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee834ac0-b17e-47aa-8f7d-be1f2b3055cc" containerName="manager"
Jul 29 01:26:08.219169 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.219146    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee834ac0-b17e-47aa-8f7d-be1f2b3055cc" containerName="manager"
Jul 29 01:26:08.223208 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.223193    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d447d7688-qcfjv"
Jul 29 01:26:08.226996 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.226964    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 01:26:08.227140 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.227004    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 01:26:08.227140 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.227031    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pqq85\""
Jul 29 01:26:08.231123 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.231100    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d447d7688-qcfjv"]
Jul 29 01:26:08.333865 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.333827    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlvnm\" (UniqueName: \"kubernetes.io/projected/e9d97647-bda4-40c7-a996-e814c17590f4-kube-api-access-wlvnm\") pod \"maas-controller-d447d7688-qcfjv\" (UID: \"e9d97647-bda4-40c7-a996-e814c17590f4\") " pod="opendatahub/maas-controller-d447d7688-qcfjv"
Jul 29 01:26:08.334036 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.333884    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9d97647-bda4-40c7-a996-e814c17590f4-webhook-cert\") pod \"maas-controller-d447d7688-qcfjv\" (UID: \"e9d97647-bda4-40c7-a996-e814c17590f4\") " pod="opendatahub/maas-controller-d447d7688-qcfjv"
Jul 29 01:26:08.435256 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.435140    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9d97647-bda4-40c7-a996-e814c17590f4-webhook-cert\") pod \"maas-controller-d447d7688-qcfjv\" (UID: \"e9d97647-bda4-40c7-a996-e814c17590f4\") " pod="opendatahub/maas-controller-d447d7688-qcfjv"
Jul 29 01:26:08.435435 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.435274    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlvnm\" (UniqueName: \"kubernetes.io/projected/e9d97647-bda4-40c7-a996-e814c17590f4-kube-api-access-wlvnm\") pod \"maas-controller-d447d7688-qcfjv\" (UID: \"e9d97647-bda4-40c7-a996-e814c17590f4\") " pod="opendatahub/maas-controller-d447d7688-qcfjv"
Jul 29 01:26:08.437655 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.437622    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9d97647-bda4-40c7-a996-e814c17590f4-webhook-cert\") pod \"maas-controller-d447d7688-qcfjv\" (UID: \"e9d97647-bda4-40c7-a996-e814c17590f4\") " pod="opendatahub/maas-controller-d447d7688-qcfjv"
Jul 29 01:26:08.444984 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.444950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlvnm\" (UniqueName: \"kubernetes.io/projected/e9d97647-bda4-40c7-a996-e814c17590f4-kube-api-access-wlvnm\") pod \"maas-controller-d447d7688-qcfjv\" (UID: \"e9d97647-bda4-40c7-a996-e814c17590f4\") " pod="opendatahub/maas-controller-d447d7688-qcfjv"
Jul 29 01:26:08.534393 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.534372    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d447d7688-qcfjv"
Jul 29 01:26:08.670694 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:08.670663    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d447d7688-qcfjv"]
Jul 29 01:26:08.672202 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:26:08.672158    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d97647_bda4_40c7_a996_e814c17590f4.slice/crio-156062972ceed1a814c6383337a2b9e9279da83bd8e2fbc9bdd2431193b5a6b0 WatchSource:0}: Error finding container 156062972ceed1a814c6383337a2b9e9279da83bd8e2fbc9bdd2431193b5a6b0: Status 404 returned error can't find the container with id 156062972ceed1a814c6383337a2b9e9279da83bd8e2fbc9bdd2431193b5a6b0
Jul 29 01:26:09.038645 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:09.038600    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee834ac0-b17e-47aa-8f7d-be1f2b3055cc" path="/var/lib/kubelet/pods/ee834ac0-b17e-47aa-8f7d-be1f2b3055cc/volumes"
Jul 29 01:26:09.356320 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:09.356228    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d447d7688-qcfjv" event={"ID":"e9d97647-bda4-40c7-a996-e814c17590f4","Type":"ContainerStarted","Data":"c88dd79c812b068020dadbbccad17e525bfc6e1f3ae3acab49130e1dd84d1772"}
Jul 29 01:26:09.356320 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:09.356282    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d447d7688-qcfjv" event={"ID":"e9d97647-bda4-40c7-a996-e814c17590f4","Type":"ContainerStarted","Data":"156062972ceed1a814c6383337a2b9e9279da83bd8e2fbc9bdd2431193b5a6b0"}
Jul 29 01:26:09.356320 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:09.356305    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d447d7688-qcfjv"
Jul 29 01:26:09.373438 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:09.373383    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d447d7688-qcfjv" podStartSLOduration=0.974343612 podStartE2EDuration="1.373363382s" totalImagesPullingTime="399.01977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:26:09.371800391 +0000 UTC m=+998.872235842" watchObservedRunningTime="2026-07-29 01:26:09.373363382 +0000 UTC m=+998.873798835"
Jul 29 01:26:20.363009 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:20.362976    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d447d7688-qcfjv"
Jul 29 01:26:31.702048 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:31.702010    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:26:43.300786 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:43.300750    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:26:49.849384 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:49.849343    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:49.939580 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:49.939543    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:50.098932 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:50.098898    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:55.767586 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:55.767553    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:55.874495 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:55.874460    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:55.968307 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:55.968269    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:26:56.121987 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:26:56.121877    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:27:01.931575 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:27:01.931544    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:27:02.113126 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:27:02.113091    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:27:18.595739 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:27:18.595699    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:27:28.398588 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:27:28.398543    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:27:37.102849 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:27:37.102814    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:27:37.555983 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:27:37.555945    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:27:46.195157 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:27:46.195125    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:27:56.204918 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:27:56.204884    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:28:06.710032 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:28:06.709997    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:28:17.907889 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:28:17.907848    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:28:28.095546 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:28:28.095505    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:28:50.004469 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:28:50.004433    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:29:02.709541 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:29:02.709457    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:29:25.303808 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:29:25.303773    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:29:30.975127 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:29:30.975086    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:29:35.204642 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:29:35.204608    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:29:45.693340 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:29:45.693303    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:30:01.913444 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:30:01.913410    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:30:11.609065 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:30:11.609033    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:30:20.911778 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:30:20.911743    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:30:30.102263 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:30:30.102226    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:30:39.592582 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:30:39.592550    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:31:14.371477 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:14.371434    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"]
Jul 29 01:31:14.372076 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:14.371719    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd" podUID="ab2bf098-cea8-481b-ac4f-75177af7f1da" containerName="manager" containerID="cri-o://4e344fac8c2429ccc6ab60d6309f98880781e6927d4c23d5e28a1324c4cc988e" gracePeriod=10
Jul 29 01:31:16.945143 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:16.945051    2558 generic.go:356] "Generic (PLEG): container finished" podID="ab2bf098-cea8-481b-ac4f-75177af7f1da" containerID="4e344fac8c2429ccc6ab60d6309f98880781e6927d4c23d5e28a1324c4cc988e" exitCode=0
Jul 29 01:31:16.945506 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:16.945129    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd" event={"ID":"ab2bf098-cea8-481b-ac4f-75177af7f1da","Type":"ContainerDied","Data":"4e344fac8c2429ccc6ab60d6309f98880781e6927d4c23d5e28a1324c4cc988e"}
Jul 29 01:31:17.220938 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:17.220917    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"
Jul 29 01:31:17.242123 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:17.242097    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab2bf098-cea8-481b-ac4f-75177af7f1da-extensions-socket-volume\") pod \"ab2bf098-cea8-481b-ac4f-75177af7f1da\" (UID: \"ab2bf098-cea8-481b-ac4f-75177af7f1da\") "
Jul 29 01:31:17.242250 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:17.242139    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xzx6\" (UniqueName: \"kubernetes.io/projected/ab2bf098-cea8-481b-ac4f-75177af7f1da-kube-api-access-7xzx6\") pod \"ab2bf098-cea8-481b-ac4f-75177af7f1da\" (UID: \"ab2bf098-cea8-481b-ac4f-75177af7f1da\") "
Jul 29 01:31:17.242486 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:17.242462    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab2bf098-cea8-481b-ac4f-75177af7f1da-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ab2bf098-cea8-481b-ac4f-75177af7f1da" (UID: "ab2bf098-cea8-481b-ac4f-75177af7f1da"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:31:17.244223 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:17.244199    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab2bf098-cea8-481b-ac4f-75177af7f1da-kube-api-access-7xzx6" (OuterVolumeSpecName: "kube-api-access-7xzx6") pod "ab2bf098-cea8-481b-ac4f-75177af7f1da" (UID: "ab2bf098-cea8-481b-ac4f-75177af7f1da"). InnerVolumeSpecName "kube-api-access-7xzx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:31:17.343614 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:17.343581    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab2bf098-cea8-481b-ac4f-75177af7f1da-extensions-socket-volume\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:31:17.343614 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:17.343610    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xzx6\" (UniqueName: \"kubernetes.io/projected/ab2bf098-cea8-481b-ac4f-75177af7f1da-kube-api-access-7xzx6\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:31:17.951862 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:17.951834    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"
Jul 29 01:31:17.952278 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:17.951876    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd" event={"ID":"ab2bf098-cea8-481b-ac4f-75177af7f1da","Type":"ContainerDied","Data":"3bf3c3f09061ff8ee5eff87306163a083785db401111df2832696f7dc3fa520a"}
Jul 29 01:31:17.952278 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:17.951933    2558 scope.go:117] "RemoveContainer" containerID="4e344fac8c2429ccc6ab60d6309f98880781e6927d4c23d5e28a1324c4cc988e"
Jul 29 01:31:17.975259 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:17.975235    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"]
Jul 29 01:31:17.978773 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:17.978751    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frnwd"]
Jul 29 01:31:19.037811 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:31:19.037771    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab2bf098-cea8-481b-ac4f-75177af7f1da" path="/var/lib/kubelet/pods/ab2bf098-cea8-481b-ac4f-75177af7f1da/volumes"
Jul 29 01:32:06.955383 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:06.955305    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:32:08.507145 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:08.507113    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:32:15.552946 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:15.552911    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx"]
Jul 29 01:32:15.553398 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:15.553247    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab2bf098-cea8-481b-ac4f-75177af7f1da" containerName="manager"
Jul 29 01:32:15.553398 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:15.553259    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab2bf098-cea8-481b-ac4f-75177af7f1da" containerName="manager"
Jul 29 01:32:15.553398 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:15.553328    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab2bf098-cea8-481b-ac4f-75177af7f1da" containerName="manager"
Jul 29 01:32:15.556207 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:15.556191    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx"
Jul 29 01:32:15.560549 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:15.560527    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xmxjt\""
Jul 29 01:32:15.570885 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:15.570864    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx"]
Jul 29 01:32:15.606608 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:15.606582    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1c485ba-dfc8-46b8-a58e-1404accc398f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lrglx\" (UID: \"b1c485ba-dfc8-46b8-a58e-1404accc398f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx"
Jul 29 01:32:15.606737 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:15.606641    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7s5z\" (UniqueName: \"kubernetes.io/projected/b1c485ba-dfc8-46b8-a58e-1404accc398f-kube-api-access-r7s5z\") pod \"kuadrant-operator-controller-manager-86878c769f-lrglx\" (UID: \"b1c485ba-dfc8-46b8-a58e-1404accc398f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx"
Jul 29 01:32:15.707167 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:15.707141    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1c485ba-dfc8-46b8-a58e-1404accc398f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lrglx\" (UID: \"b1c485ba-dfc8-46b8-a58e-1404accc398f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx"
Jul 29 01:32:15.707290 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:15.707197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7s5z\" (UniqueName: \"kubernetes.io/projected/b1c485ba-dfc8-46b8-a58e-1404accc398f-kube-api-access-r7s5z\") pod \"kuadrant-operator-controller-manager-86878c769f-lrglx\" (UID: \"b1c485ba-dfc8-46b8-a58e-1404accc398f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx"
Jul 29 01:32:15.707477 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:15.707461    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1c485ba-dfc8-46b8-a58e-1404accc398f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lrglx\" (UID: \"b1c485ba-dfc8-46b8-a58e-1404accc398f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx"
Jul 29 01:32:15.715688 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:15.715662    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7s5z\" (UniqueName: \"kubernetes.io/projected/b1c485ba-dfc8-46b8-a58e-1404accc398f-kube-api-access-r7s5z\") pod \"kuadrant-operator-controller-manager-86878c769f-lrglx\" (UID: \"b1c485ba-dfc8-46b8-a58e-1404accc398f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx"
Jul 29 01:32:15.865459 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:15.865432    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx"
Jul 29 01:32:16.015488 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:16.015463    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx"]
Jul 29 01:32:16.017645 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:32:16.017617    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c485ba_dfc8_46b8_a58e_1404accc398f.slice/crio-5077317a0f6de63e65513eb00d05304b3f8b0e3bee00a7f748d27070186923d9 WatchSource:0}: Error finding container 5077317a0f6de63e65513eb00d05304b3f8b0e3bee00a7f748d27070186923d9: Status 404 returned error can't find the container with id 5077317a0f6de63e65513eb00d05304b3f8b0e3bee00a7f748d27070186923d9
Jul 29 01:32:16.255012 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:16.254973    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx" event={"ID":"b1c485ba-dfc8-46b8-a58e-1404accc398f","Type":"ContainerStarted","Data":"bad7a80b7e1f688569c52d1274fd2287b8ffe8ccd6fe5fd3ed8957849242a30e"}
Jul 29 01:32:16.255199 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:16.255031    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx" event={"ID":"b1c485ba-dfc8-46b8-a58e-1404accc398f","Type":"ContainerStarted","Data":"5077317a0f6de63e65513eb00d05304b3f8b0e3bee00a7f748d27070186923d9"}
Jul 29 01:32:16.255199 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:16.255056    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx"
Jul 29 01:32:16.277630 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:16.277586    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx" podStartSLOduration=1.277570385 podStartE2EDuration="1.277570385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:32:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:32:16.275765845 +0000 UTC m=+1365.776201298" watchObservedRunningTime="2026-07-29 01:32:16.277570385 +0000 UTC m=+1365.778005836"
Jul 29 01:32:27.263039 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:27.263008    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lrglx"
Jul 29 01:32:35.896046 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:35.896011    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:32:44.069690 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:44.069657    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:32:44.126835 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:44.126800    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:32:46.193984 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:32:46.193951    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:33:00.798020 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:33:00.797984    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:33:14.309925 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:33:14.309883    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:33:15.505066 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:33:15.505031    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:33:26.094530 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:33:26.094493    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:33:36.199604 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:33:36.199554    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:33:46.703039 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:33:46.702993    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:33:57.109413 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:33:57.109376    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:34:06.801399 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:34:06.801364    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:34:17.107964 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:34:17.107929    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:34:28.897153 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:34:28.897118    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:34:36.402058 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:34:36.402021    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:34:54.402775 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:34:54.402693    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:35:03.915353 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:03.915311    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:35:05.887306 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:05.887271    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:35:16.643225 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:16.643170    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:35:19.892803 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:19.892770    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:35:20.594595 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.594565    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"]
Jul 29 01:35:20.598232 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.598211    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.600742 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.600723    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-ae9e05f4-kserve-self-signed-certs\""
Jul 29 01:35:20.606478 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.605991    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"]
Jul 29 01:35:20.628853 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.628828    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:35:20.661971 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.661944    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-dshm\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.662086 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.661979    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-tmp-dir\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.662086 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.662007    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-tls-certs\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.662157 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.662077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgrc4\" (UniqueName: \"kubernetes.io/projected/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-kube-api-access-fgrc4\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.662157 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.662136    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-home\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.662259 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.662156    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-model-cache\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.763227 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.763195    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-home\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.763371 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.763235    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-model-cache\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.763371 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.763280    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-dshm\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.763371 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.763312    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-tmp-dir\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.763371 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.763366    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-tls-certs\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.763590 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.763403    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgrc4\" (UniqueName: \"kubernetes.io/projected/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-kube-api-access-fgrc4\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.763590 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.763508    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-home\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.763590 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.763568    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-model-cache\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.763754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.763711    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-tmp-dir\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.765683 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.765659    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-dshm\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.765861 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.765842    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-tls-certs\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.770745 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.770728    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgrc4\" (UniqueName: \"kubernetes.io/projected/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-kube-api-access-fgrc4\") pod \"e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") " pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:20.909908 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:20.909834    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:21.043817 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:21.043793    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"]
Jul 29 01:35:21.045618 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:35:21.045592    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaecdf4e2_00e9_4eb1_8f24_913bdf2a3ee9.slice/crio-effd0b0a99435f59c35d5a3b6813e5bb760f9667172ab0a149d7f0454ebd318c WatchSource:0}: Error finding container effd0b0a99435f59c35d5a3b6813e5bb760f9667172ab0a149d7f0454ebd318c: Status 404 returned error can't find the container with id effd0b0a99435f59c35d5a3b6813e5bb760f9667172ab0a149d7f0454ebd318c
Jul 29 01:35:21.218192 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:21.218081    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms" event={"ID":"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9","Type":"ContainerStarted","Data":"f63ba0b16aed3c6a0b49213c7ec6bf4f414b45f7d985a8e41fc7714d8ce7a271"}
Jul 29 01:35:21.218192 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:21.218123    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms" event={"ID":"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9","Type":"ContainerStarted","Data":"effd0b0a99435f59c35d5a3b6813e5bb760f9667172ab0a149d7f0454ebd318c"}
Jul 29 01:35:21.236456 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:21.236412    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms" podStartSLOduration=1.236398199 podStartE2EDuration="1.236398199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:35:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:35:21.235417623 +0000 UTC m=+1550.735853075" watchObservedRunningTime="2026-07-29 01:35:21.236398199 +0000 UTC m=+1550.736833651"
Jul 29 01:35:30.910423 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:30.910391    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:30.910885 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:30.910435    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:30.925836 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:30.925809    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:31.281741 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:31.281716    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:35:35.913851 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:35.913814    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:35:52.062755 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:52.062716    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:35:52.863189 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:52.863151    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"]
Jul 29 01:35:52.876082 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:52.876055    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:35:56.097900 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:35:56.097864    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:36:07.882245 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:07.882169    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms" podUID="aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9" containerName="main" containerID="cri-o://f63ba0b16aed3c6a0b49213c7ec6bf4f414b45f7d985a8e41fc7714d8ce7a271" gracePeriod=45
Jul 29 01:36:08.137611 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.137550    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:36:08.144007 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.143981    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-home\") pod \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") "
Jul 29 01:36:08.144142 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.144036    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-dshm\") pod \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") "
Jul 29 01:36:08.144142 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.144072    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-tmp-dir\") pod \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") "
Jul 29 01:36:08.144142 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.144101    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgrc4\" (UniqueName: \"kubernetes.io/projected/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-kube-api-access-fgrc4\") pod \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") "
Jul 29 01:36:08.144142 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.144126    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-tls-certs\") pod \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") "
Jul 29 01:36:08.144142 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.144143    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-model-cache\") pod \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\" (UID: \"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9\") "
Jul 29 01:36:08.144446 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.144266    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-home" (OuterVolumeSpecName: "home") pod "aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9" (UID: "aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:08.144516 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.144464    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-home\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:36:08.144595 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.144554    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-model-cache" (OuterVolumeSpecName: "model-cache") pod "aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9" (UID: "aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:08.144655 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.144617    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9" (UID: "aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:08.146653 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.146630    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-dshm" (OuterVolumeSpecName: "dshm") pod "aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9" (UID: "aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:08.146777 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.146727    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9" (UID: "aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:36:08.146777 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.146741    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-kube-api-access-fgrc4" (OuterVolumeSpecName: "kube-api-access-fgrc4") pod "aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9" (UID: "aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9"). InnerVolumeSpecName "kube-api-access-fgrc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:36:08.245200 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.245160    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-dshm\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:36:08.245200 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.245195    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-tmp-dir\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:36:08.245200 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.245206    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgrc4\" (UniqueName: \"kubernetes.io/projected/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-kube-api-access-fgrc4\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:36:08.245437 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.245215    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-tls-certs\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:36:08.245437 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.245223    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9-model-cache\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:36:08.475837 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.475756    2558 generic.go:356] "Generic (PLEG): container finished" podID="aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9" containerID="f63ba0b16aed3c6a0b49213c7ec6bf4f414b45f7d985a8e41fc7714d8ce7a271" exitCode=0
Jul 29 01:36:08.475837 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.475830    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"
Jul 29 01:36:08.476013 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.475844    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms" event={"ID":"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9","Type":"ContainerDied","Data":"f63ba0b16aed3c6a0b49213c7ec6bf4f414b45f7d985a8e41fc7714d8ce7a271"}
Jul 29 01:36:08.476013 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.475889    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms" event={"ID":"aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9","Type":"ContainerDied","Data":"effd0b0a99435f59c35d5a3b6813e5bb760f9667172ab0a149d7f0454ebd318c"}
Jul 29 01:36:08.476013 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.475908    2558 scope.go:117] "RemoveContainer" containerID="f63ba0b16aed3c6a0b49213c7ec6bf4f414b45f7d985a8e41fc7714d8ce7a271"
Jul 29 01:36:08.485141 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.485126    2558 scope.go:117] "RemoveContainer" containerID="f63ba0b16aed3c6a0b49213c7ec6bf4f414b45f7d985a8e41fc7714d8ce7a271"
Jul 29 01:36:08.485397 ip-10-0-130-167 kubenswrapper[2558]: E0729 01:36:08.485378    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f63ba0b16aed3c6a0b49213c7ec6bf4f414b45f7d985a8e41fc7714d8ce7a271\": container with ID starting with f63ba0b16aed3c6a0b49213c7ec6bf4f414b45f7d985a8e41fc7714d8ce7a271 not found: ID does not exist" containerID="f63ba0b16aed3c6a0b49213c7ec6bf4f414b45f7d985a8e41fc7714d8ce7a271"
Jul 29 01:36:08.485445 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.485405    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63ba0b16aed3c6a0b49213c7ec6bf4f414b45f7d985a8e41fc7714d8ce7a271"} err="failed to get container status \"f63ba0b16aed3c6a0b49213c7ec6bf4f414b45f7d985a8e41fc7714d8ce7a271\": rpc error: code = NotFound desc = could not find container \"f63ba0b16aed3c6a0b49213c7ec6bf4f414b45f7d985a8e41fc7714d8ce7a271\": container with ID starting with f63ba0b16aed3c6a0b49213c7ec6bf4f414b45f7d985a8e41fc7714d8ce7a271 not found: ID does not exist"
Jul 29 01:36:08.499054 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.499032    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"]
Jul 29 01:36:08.503342 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:08.503320    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-ae9e05f4-kserve-fdfdd97cf-fjmms"]
Jul 29 01:36:09.038942 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:09.038912    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9" path="/var/lib/kubelet/pods/aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9/volumes"
Jul 29 01:36:10.118309 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:10.118276    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:36:17.065688 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:17.065654    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:36:33.203604 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:33.203569    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:36:42.411430 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:42.411392    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:36:51.994162 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:36:51.994127    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:37:00.600767 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:37:00.600726    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:37:11.012782 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:37:11.012745    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:37:20.593739 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:37:20.593701    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:37:33.598778 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:37:33.598740    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:37:42.404774 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:37:42.404735    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:37:51.801929 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:37:51.801895    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:38:04.054583 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:38:04.054486    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:38:12.894743 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:38:12.894708    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:38:19.903117 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:38:19.903081    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:38:35.001076 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:38:35.001041    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:38:37.721986 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:38:37.721931    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:38:45.398000 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:38:45.397964    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:38:49.139942 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:38:49.139904    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:38:57.896471 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:38:57.896434    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:38:59.477069 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:38:59.477035    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:11.503030 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:11.502995    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:39:20.995461 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:20.995424    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:39:21.300292 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:21.300264    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:24.786015 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:24.785900    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:24.884926 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:24.884888    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:25.245418 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:25.245329    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:30.307116 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:30.307085    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:39:31.371247 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:31.371209    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:31.440501 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:31.440469    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:31.630355 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:31.630274    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:31.948355 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:31.948268    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:32.105986 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:32.105953    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:33.283380 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:33.283332    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:33.347747 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:33.347704    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:34.460676 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:34.460615    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:34.559533 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:34.559494    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:34.629423 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:34.629385    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:34.821975 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:34.821944    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:35.215487 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:35.215401    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:35.385080 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:35.385050    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:39:38.752413 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:39:38.752382    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:42:46.747408 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:46.747375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:48.876799 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:48.876764    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:48.976487 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:48.976453    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:49.078786 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:49.078731    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:49.272078 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:49.272046    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:49.346267 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:49.346236    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:49.633125 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:49.633025    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:49.867094 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:49.867061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:49.983130 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:49.983039    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:50.132609 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:50.132579    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:50.500059 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:50.500017    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:50.904318 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:50.904285    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:52.646000 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:52.645964    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:52.766356 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:52.766317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:52.808259 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:52.808226    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:42:52.864638 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:52.864610    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:53.284378 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:53.284351    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:42:53.383782 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:42:53.383743    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:43:03.197455 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:43:03.197418    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:45:00.144241 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:00.144209    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754825-kxwpj"]
Jul 29 01:45:00.144717 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:00.144571    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9" containerName="main"
Jul 29 01:45:00.144717 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:00.144583    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9" containerName="main"
Jul 29 01:45:00.144717 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:00.144658    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="aecdf4e2-00e9-4eb1-8f24-913bdf2a3ee9" containerName="main"
Jul 29 01:45:00.147574 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:00.147557    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-kxwpj"
Jul 29 01:45:00.150488 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:00.150465    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmrfs\""
Jul 29 01:45:00.156582 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:00.156565    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-kxwpj"
Jul 29 01:45:00.167873 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:00.167847    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754825-kxwpj"]
Jul 29 01:45:00.502756 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:00.502691    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754825-kxwpj"]
Jul 29 01:45:00.505484 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:45:00.505447    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b754243_3df1_4eb9_b63d_bc842cce43a6.slice/crio-3f04f6d4755b721a0e82639d68a6e19ee56ff36ed48899cca488469a7b5a6ff6 WatchSource:0}: Error finding container 3f04f6d4755b721a0e82639d68a6e19ee56ff36ed48899cca488469a7b5a6ff6: Status 404 returned error can't find the container with id 3f04f6d4755b721a0e82639d68a6e19ee56ff36ed48899cca488469a7b5a6ff6
Jul 29 01:45:00.507496 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:00.507475    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:45:01.226035 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:01.226006    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-kxwpj" event={"ID":"2b754243-3df1-4eb9-b63d-bc842cce43a6","Type":"ContainerStarted","Data":"3f04f6d4755b721a0e82639d68a6e19ee56ff36ed48899cca488469a7b5a6ff6"}
Jul 29 01:45:04.245078 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:04.244992    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-kxwpj" event={"ID":"2b754243-3df1-4eb9-b63d-bc842cce43a6","Type":"ContainerStarted","Data":"727ddbb7f33af780731c078686db9a58a5bea16f5849241a16578c4af2964479"}
Jul 29 01:45:04.263605 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:04.263554    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-kxwpj" podStartSLOduration=1.00666549 podStartE2EDuration="4.26353738s" totalImagesPullingTime="3.25687189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:45:04.262799378 +0000 UTC m=+2133.763234851" watchObservedRunningTime="2026-07-29 01:45:04.26353738 +0000 UTC m=+2133.763972832"
Jul 29 01:45:05.252153 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:05.252120    2558 generic.go:356] "Generic (PLEG): container finished" podID="2b754243-3df1-4eb9-b63d-bc842cce43a6" containerID="727ddbb7f33af780731c078686db9a58a5bea16f5849241a16578c4af2964479" exitCode=0
Jul 29 01:45:05.252554 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:05.252211    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-kxwpj" event={"ID":"2b754243-3df1-4eb9-b63d-bc842cce43a6","Type":"ContainerDied","Data":"727ddbb7f33af780731c078686db9a58a5bea16f5849241a16578c4af2964479"}
Jul 29 01:45:06.388677 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:06.388654    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-kxwpj"
Jul 29 01:45:07.264405 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:07.264375    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-kxwpj"
Jul 29 01:45:07.264583 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:07.264377    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-kxwpj" event={"ID":"2b754243-3df1-4eb9-b63d-bc842cce43a6","Type":"ContainerDied","Data":"3f04f6d4755b721a0e82639d68a6e19ee56ff36ed48899cca488469a7b5a6ff6"}
Jul 29 01:45:07.264583 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:45:07.264508    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f04f6d4755b721a0e82639d68a6e19ee56ff36ed48899cca488469a7b5a6ff6"
Jul 29 01:46:45.691441 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:45.691403    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:47.061992 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:47.061955    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:46:52.917621 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:52.917539    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2"]
Jul 29 01:46:52.917982 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:52.917932    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b754243-3df1-4eb9-b63d-bc842cce43a6" containerName="cleanup"
Jul 29 01:46:52.917982 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:52.917945    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b754243-3df1-4eb9-b63d-bc842cce43a6" containerName="cleanup"
Jul 29 01:46:52.918056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:52.918013    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b754243-3df1-4eb9-b63d-bc842cce43a6" containerName="cleanup"
Jul 29 01:46:52.920885 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:52.920869    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2"
Jul 29 01:46:52.923405 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:52.923381    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmrfs\""
Jul 29 01:46:52.923672 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:52.923655    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:46:52.938637 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:52.938616    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2"]
Jul 29 01:46:52.999072 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:52.999048    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e2fce1-b95e-420c-9539-92c9f4b11237-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3a585460-b74n2\" (UID: \"d6e2fce1-b95e-420c-9539-92c9f4b11237\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2"
Jul 29 01:46:53.099652 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:53.099617    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e2fce1-b95e-420c-9539-92c9f4b11237-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3a585460-b74n2\" (UID: \"d6e2fce1-b95e-420c-9539-92c9f4b11237\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2"
Jul 29 01:46:53.100464 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:53.100445    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e2fce1-b95e-420c-9539-92c9f4b11237-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3a585460-b74n2\" (UID: \"d6e2fce1-b95e-420c-9539-92c9f4b11237\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2"
Jul 29 01:46:53.231222 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:53.231132    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2"
Jul 29 01:46:53.366499 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:53.366476    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2"]
Jul 29 01:46:53.368794 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:46:53.368766    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e2fce1_b95e_420c_9539_92c9f4b11237.slice/crio-511a58675ef40eb871f2c4f22a1d643f30e91391b2d39ce26a412b4881b21154 WatchSource:0}: Error finding container 511a58675ef40eb871f2c4f22a1d643f30e91391b2d39ce26a412b4881b21154: Status 404 returned error can't find the container with id 511a58675ef40eb871f2c4f22a1d643f30e91391b2d39ce26a412b4881b21154
Jul 29 01:46:53.821037 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:53.820955    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2" event={"ID":"d6e2fce1-b95e-420c-9539-92c9f4b11237","Type":"ContainerStarted","Data":"db118898bfd6aae15faa8358820c86b13e3cbb2bd8195d2d25fca9e55e5722ad"}
Jul 29 01:46:53.821037 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:53.821010    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2" event={"ID":"d6e2fce1-b95e-420c-9539-92c9f4b11237","Type":"ContainerStarted","Data":"511a58675ef40eb871f2c4f22a1d643f30e91391b2d39ce26a412b4881b21154"}
Jul 29 01:46:53.839748 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:53.839696    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2" podStartSLOduration=1.839680189 podStartE2EDuration="1.839680189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:46:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:46:53.838292684 +0000 UTC m=+2243.338728139" watchObservedRunningTime="2026-07-29 01:46:53.839680189 +0000 UTC m=+2243.340115640"
Jul 29 01:46:54.827698 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:54.827667    2558 generic.go:356] "Generic (PLEG): container finished" podID="d6e2fce1-b95e-420c-9539-92c9f4b11237" containerID="db118898bfd6aae15faa8358820c86b13e3cbb2bd8195d2d25fca9e55e5722ad" exitCode=0
Jul 29 01:46:54.828076 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:54.827723    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2" event={"ID":"d6e2fce1-b95e-420c-9539-92c9f4b11237","Type":"ContainerDied","Data":"db118898bfd6aae15faa8358820c86b13e3cbb2bd8195d2d25fca9e55e5722ad"}
Jul 29 01:46:55.965592 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:55.965569    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2"
Jul 29 01:46:56.025153 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:56.025123    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e2fce1-b95e-420c-9539-92c9f4b11237-maas-api-service-ca\") pod \"d6e2fce1-b95e-420c-9539-92c9f4b11237\" (UID: \"d6e2fce1-b95e-420c-9539-92c9f4b11237\") "
Jul 29 01:46:56.025497 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:56.025477    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6e2fce1-b95e-420c-9539-92c9f4b11237-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d6e2fce1-b95e-420c-9539-92c9f4b11237" (UID: "d6e2fce1-b95e-420c-9539-92c9f4b11237"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:46:56.126471 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:56.126385    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e2fce1-b95e-420c-9539-92c9f4b11237-maas-api-service-ca\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:46:56.839734 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:56.839696    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2" event={"ID":"d6e2fce1-b95e-420c-9539-92c9f4b11237","Type":"ContainerDied","Data":"511a58675ef40eb871f2c4f22a1d643f30e91391b2d39ce26a412b4881b21154"}
Jul 29 01:46:56.839734 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:56.839722    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2"
Jul 29 01:46:56.839996 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:46:56.839745    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="511a58675ef40eb871f2c4f22a1d643f30e91391b2d39ce26a412b4881b21154"
Jul 29 01:47:01.406846 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:01.406805    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:01.511917 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:01.511856    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:01.591782 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:01.591749    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2"]
Jul 29 01:47:01.593925 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:01.593901    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3a585460-b74n2"]
Jul 29 01:47:01.594260 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:01.594227    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:01.778144 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:01.778105    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:02.030345 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:02.030256    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:02.270409 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:02.270372    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:02.633053 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:02.633022    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:03.037798 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:03.037768    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6e2fce1-b95e-420c-9539-92c9f4b11237" path="/var/lib/kubelet/pods/d6e2fce1-b95e-420c-9539-92c9f4b11237/volumes"
Jul 29 01:47:03.303332 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:03.303258    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:47:03.309436 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:03.309411    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:04.986014 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:04.985964    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:05.088720 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:05.088684    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:05.183660 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:05.183626    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:05.290490 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:05.290454    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:05.754638 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:05.754551    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:05.861526 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:05.861490    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:47:15.193842 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:47:15.193808    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:48:33.246795 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:48:33.246758    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:08.749886 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:08.749807    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n"]
Jul 29 01:50:08.750369 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:08.750153    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6e2fce1-b95e-420c-9539-92c9f4b11237" containerName="revoke-keys"
Jul 29 01:50:08.750369 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:08.750165    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6e2fce1-b95e-420c-9539-92c9f4b11237" containerName="revoke-keys"
Jul 29 01:50:08.750369 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:08.750230    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6e2fce1-b95e-420c-9539-92c9f4b11237" containerName="revoke-keys"
Jul 29 01:50:08.753195 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:08.753165    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n"
Jul 29 01:50:08.756057 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:08.756027    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:50:08.756239 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:08.756027    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmrfs\""
Jul 29 01:50:08.768470 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:08.768445    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n"]
Jul 29 01:50:08.865776 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:08.865736    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/361920e4-16d1-4dc4-929c-b29e002fc762-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n\" (UID: \"361920e4-16d1-4dc4-929c-b29e002fc762\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n"
Jul 29 01:50:08.966994 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:08.966959    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/361920e4-16d1-4dc4-929c-b29e002fc762-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n\" (UID: \"361920e4-16d1-4dc4-929c-b29e002fc762\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n"
Jul 29 01:50:08.967637 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:08.967617    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/361920e4-16d1-4dc4-929c-b29e002fc762-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n\" (UID: \"361920e4-16d1-4dc4-929c-b29e002fc762\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n"
Jul 29 01:50:09.063295 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:09.063271    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n"
Jul 29 01:50:09.194306 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:09.194277    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n"]
Jul 29 01:50:09.195652 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:50:09.195626    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361920e4_16d1_4dc4_929c_b29e002fc762.slice/crio-3ce4e9e5d873041e8b1a9d77d21a0c2f37ee391e137a71a28f1f85f756961523 WatchSource:0}: Error finding container 3ce4e9e5d873041e8b1a9d77d21a0c2f37ee391e137a71a28f1f85f756961523: Status 404 returned error can't find the container with id 3ce4e9e5d873041e8b1a9d77d21a0c2f37ee391e137a71a28f1f85f756961523
Jul 29 01:50:09.851624 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:09.851593    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n" event={"ID":"361920e4-16d1-4dc4-929c-b29e002fc762","Type":"ContainerStarted","Data":"df48940cfa5168d7cc5f0f69170c13db885ee5af359bf82af58070ddc1a86579"}
Jul 29 01:50:09.851925 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:09.851652    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n" event={"ID":"361920e4-16d1-4dc4-929c-b29e002fc762","Type":"ContainerStarted","Data":"3ce4e9e5d873041e8b1a9d77d21a0c2f37ee391e137a71a28f1f85f756961523"}
Jul 29 01:50:10.858948 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:10.858915    2558 generic.go:356] "Generic (PLEG): container finished" podID="361920e4-16d1-4dc4-929c-b29e002fc762" containerID="df48940cfa5168d7cc5f0f69170c13db885ee5af359bf82af58070ddc1a86579" exitCode=0
Jul 29 01:50:10.859376 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:10.858956    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n" event={"ID":"361920e4-16d1-4dc4-929c-b29e002fc762","Type":"ContainerDied","Data":"df48940cfa5168d7cc5f0f69170c13db885ee5af359bf82af58070ddc1a86579"}
Jul 29 01:50:10.995789 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:10.995768    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n"
Jul 29 01:50:11.086027 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:11.085996    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/361920e4-16d1-4dc4-929c-b29e002fc762-maas-api-service-ca\") pod \"361920e4-16d1-4dc4-929c-b29e002fc762\" (UID: \"361920e4-16d1-4dc4-929c-b29e002fc762\") "
Jul 29 01:50:11.086392 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:11.086366    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/361920e4-16d1-4dc4-929c-b29e002fc762-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "361920e4-16d1-4dc4-929c-b29e002fc762" (UID: "361920e4-16d1-4dc4-929c-b29e002fc762"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:50:11.186749 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:11.186676    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/361920e4-16d1-4dc4-929c-b29e002fc762-maas-api-service-ca\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:50:11.865830 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:11.865798    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n"
Jul 29 01:50:11.865830 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:11.865820    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n" event={"ID":"361920e4-16d1-4dc4-929c-b29e002fc762","Type":"ContainerDied","Data":"3ce4e9e5d873041e8b1a9d77d21a0c2f37ee391e137a71a28f1f85f756961523"}
Jul 29 01:50:11.866271 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:11.865896    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ce4e9e5d873041e8b1a9d77d21a0c2f37ee391e137a71a28f1f85f756961523"
Jul 29 01:50:19.398520 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:19.398454    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:19.482863 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:19.482830    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:19.542136 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:19.542099    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n"]
Jul 29 01:50:19.546545 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:19.546518    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-000a4d6e-b4q8n"]
Jul 29 01:50:20.090140 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:20.090101    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:20.154346 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:20.154316    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:20.275345 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:20.275307    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:20.601146 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:20.601109    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:20.958203 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:20.958105    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:21.038357 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:21.038329    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="361920e4-16d1-4dc4-929c-b29e002fc762" path="/var/lib/kubelet/pods/361920e4-16d1-4dc4-929c-b29e002fc762/volumes"
Jul 29 01:50:23.106446 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:23.106412    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:23.240831 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:23.240788    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:23.395607 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:23.395516    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:23.408764 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:23.408723    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:50:23.570340 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:23.570306    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:23.893054 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:23.893003    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:23.989319 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:23.989286    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:50:33.304908 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:33.304866    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:50:38.019573 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:50:38.019531    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:25.216544 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:25.216505    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq"]
Jul 29 01:52:25.217170 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:25.216846    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="361920e4-16d1-4dc4-929c-b29e002fc762" containerName="revoke-keys"
Jul 29 01:52:25.217170 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:25.216857    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="361920e4-16d1-4dc4-929c-b29e002fc762" containerName="revoke-keys"
Jul 29 01:52:25.217170 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:25.216927    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="361920e4-16d1-4dc4-929c-b29e002fc762" containerName="revoke-keys"
Jul 29 01:52:25.219713 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:25.219692    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq"
Jul 29 01:52:25.222425 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:25.222404    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:52:25.222561 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:25.222400    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmrfs\""
Jul 29 01:52:25.236387 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:25.236361    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq"]
Jul 29 01:52:25.268852 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:25.268822    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa02df37-d235-475f-ae26-bdf7f44568cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-74571164-7pxxq\" (UID: \"aa02df37-d235-475f-ae26-bdf7f44568cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq"
Jul 29 01:52:25.369517 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:25.369478    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa02df37-d235-475f-ae26-bdf7f44568cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-74571164-7pxxq\" (UID: \"aa02df37-d235-475f-ae26-bdf7f44568cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq"
Jul 29 01:52:25.370115 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:25.370096    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa02df37-d235-475f-ae26-bdf7f44568cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-74571164-7pxxq\" (UID: \"aa02df37-d235-475f-ae26-bdf7f44568cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq"
Jul 29 01:52:25.529816 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:25.529787    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq"
Jul 29 01:52:25.661673 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:25.661648    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq"]
Jul 29 01:52:25.664385 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:52:25.664349    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa02df37_d235_475f_ae26_bdf7f44568cf.slice/crio-5f86fd06487f24d807d601e16fe61949543743c3f23c72ac5e6ad978e321c989 WatchSource:0}: Error finding container 5f86fd06487f24d807d601e16fe61949543743c3f23c72ac5e6ad978e321c989: Status 404 returned error can't find the container with id 5f86fd06487f24d807d601e16fe61949543743c3f23c72ac5e6ad978e321c989
Jul 29 01:52:26.590470 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:26.590384    2558 generic.go:356] "Generic (PLEG): container finished" podID="aa02df37-d235-475f-ae26-bdf7f44568cf" containerID="d588ee796f4289ec62805d4346d7a83d9a0213db2267798700f00c7bc227d3ce" exitCode=0
Jul 29 01:52:26.590470 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:26.590440    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq" event={"ID":"aa02df37-d235-475f-ae26-bdf7f44568cf","Type":"ContainerDied","Data":"d588ee796f4289ec62805d4346d7a83d9a0213db2267798700f00c7bc227d3ce"}
Jul 29 01:52:26.590846 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:26.590477    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq" event={"ID":"aa02df37-d235-475f-ae26-bdf7f44568cf","Type":"ContainerStarted","Data":"5f86fd06487f24d807d601e16fe61949543743c3f23c72ac5e6ad978e321c989"}
Jul 29 01:52:27.729682 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:27.729654    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq"
Jul 29 01:52:27.789234 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:27.789204    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa02df37-d235-475f-ae26-bdf7f44568cf-maas-api-service-ca\") pod \"aa02df37-d235-475f-ae26-bdf7f44568cf\" (UID: \"aa02df37-d235-475f-ae26-bdf7f44568cf\") "
Jul 29 01:52:27.789537 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:27.789515    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa02df37-d235-475f-ae26-bdf7f44568cf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aa02df37-d235-475f-ae26-bdf7f44568cf" (UID: "aa02df37-d235-475f-ae26-bdf7f44568cf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:52:27.890837 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:27.890764    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa02df37-d235-475f-ae26-bdf7f44568cf-maas-api-service-ca\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:52:28.601609 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:28.601581    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq"
Jul 29 01:52:28.601791 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:28.601619    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq" event={"ID":"aa02df37-d235-475f-ae26-bdf7f44568cf","Type":"ContainerDied","Data":"5f86fd06487f24d807d601e16fe61949543743c3f23c72ac5e6ad978e321c989"}
Jul 29 01:52:28.601791 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:28.601669    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f86fd06487f24d807d601e16fe61949543743c3f23c72ac5e6ad978e321c989"
Jul 29 01:52:35.745995 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:35.745949    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:35.934108 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:35.934075    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq"]
Jul 29 01:52:35.939576 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:35.939542    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-74571164-7pxxq"]
Jul 29 01:52:36.973030 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:36.972999    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:37.038514 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:37.038482    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa02df37-d235-475f-ae26-bdf7f44568cf" path="/var/lib/kubelet/pods/aa02df37-d235-475f-ae26-bdf7f44568cf/volumes"
Jul 29 01:52:37.076863 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:37.076828    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:38.697070 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:38.697033    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:39.401186 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:39.401140    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:52:46.224587 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:46.224551    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:46.377338 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:46.377292    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:46.559215 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:46.559161    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:46.663950 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:46.663913    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:47.009150 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:47.009070    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:52:49.805307 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:52:49.805274    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:53:13.047025 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:53:13.046922    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:19.600409 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:53:19.600375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:19.717019 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:53:19.716984    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:19.821754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:53:19.821712    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:31.235688 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:53:31.235655    2558 scope.go:117] "RemoveContainer" containerID="db118898bfd6aae15faa8358820c86b13e3cbb2bd8195d2d25fca9e55e5722ad"
Jul 29 01:53:35.770039 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:53:35.770001    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:41.660241 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:53:41.660200    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:41.718096 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:53:41.718063    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:41.805671 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:53:41.805599    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:41.909754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:53:41.909714    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:52.442740 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:53:52.442699    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:53:53.287241 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:53:53.287196    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:00.038841 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:00.038808    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:00.140304 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:00.140253    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:00.239331 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:00.239293    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:00.338635 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:00.338537    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:03.297355 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:03.297319    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:54:03.838306 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:03.838271    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:03.938967 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:03.938923    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:11.975536 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:11.975497    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:12.084704 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:12.084664    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:12.184126 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:12.184088    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:14.124109 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:14.124066    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:15.508698 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:15.508663    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:54:20.739932 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:20.739897    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:20.849688 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:20.849657    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:21.441347 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:21.441305    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:25.904773 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:25.904691    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:54:27.363601 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:27.363563    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:27.437287 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:27.437254    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:27.627619 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:27.627539    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:27.974150 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:27.974056    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:28.222318 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:28.222286    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:31.017202 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:31.017155    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:31.113110 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:31.113029    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:31.205598 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:31.205562    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:31.309706 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:31.309636    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:31.695750 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:31.695667    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:31.796134 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:31.796101    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:54:36.091882 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:54:36.091849    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:55:05.267471 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:55:05.267432    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:55:20.136429 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:55:20.136383    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:24.124056 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:56:24.124011    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:56:31.270086 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:56:31.270057    2558 scope.go:117] "RemoveContainer" containerID="df48940cfa5168d7cc5f0f69170c13db885ee5af359bf82af58070ddc1a86579"
Jul 29 01:57:35.030505 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:35.030472    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6"]
Jul 29 01:57:35.030980 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:35.030903    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa02df37-d235-475f-ae26-bdf7f44568cf" containerName="revoke-keys"
Jul 29 01:57:35.030980 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:35.030922    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa02df37-d235-475f-ae26-bdf7f44568cf" containerName="revoke-keys"
Jul 29 01:57:35.031058 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:35.031018    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa02df37-d235-475f-ae26-bdf7f44568cf" containerName="revoke-keys"
Jul 29 01:57:35.034207 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:35.034168    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6"
Jul 29 01:57:35.037190 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:35.037157    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:57:35.037354 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:35.037237    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmrfs\""
Jul 29 01:57:35.050649 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:35.050625    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6"]
Jul 29 01:57:35.126146 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:35.126116    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b878afe-007a-4afd-96ee-c1a8c613295d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6\" (UID: \"9b878afe-007a-4afd-96ee-c1a8c613295d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6"
Jul 29 01:57:35.226489 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:35.226466    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b878afe-007a-4afd-96ee-c1a8c613295d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6\" (UID: \"9b878afe-007a-4afd-96ee-c1a8c613295d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6"
Jul 29 01:57:35.227139 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:35.227118    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b878afe-007a-4afd-96ee-c1a8c613295d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6\" (UID: \"9b878afe-007a-4afd-96ee-c1a8c613295d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6"
Jul 29 01:57:35.344725 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:35.344668    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6"
Jul 29 01:57:35.476465 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:35.476437    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6"]
Jul 29 01:57:35.478241 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:57:35.478213    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b878afe_007a_4afd_96ee_c1a8c613295d.slice/crio-19d74eca43ed47d17b01db24170cb8d26870933c015423611ed7014fc046f375 WatchSource:0}: Error finding container 19d74eca43ed47d17b01db24170cb8d26870933c015423611ed7014fc046f375: Status 404 returned error can't find the container with id 19d74eca43ed47d17b01db24170cb8d26870933c015423611ed7014fc046f375
Jul 29 01:57:36.199161 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:36.199120    2558 generic.go:356] "Generic (PLEG): container finished" podID="9b878afe-007a-4afd-96ee-c1a8c613295d" containerID="fa9d3ea42797e097bb9b96fca86a56f9ee70253ce63b817c2135c16da24f55c6" exitCode=0
Jul 29 01:57:36.199521 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:36.199193    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6" event={"ID":"9b878afe-007a-4afd-96ee-c1a8c613295d","Type":"ContainerDied","Data":"fa9d3ea42797e097bb9b96fca86a56f9ee70253ce63b817c2135c16da24f55c6"}
Jul 29 01:57:36.199521 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:36.199249    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6" event={"ID":"9b878afe-007a-4afd-96ee-c1a8c613295d","Type":"ContainerStarted","Data":"19d74eca43ed47d17b01db24170cb8d26870933c015423611ed7014fc046f375"}
Jul 29 01:57:37.335785 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:37.335760    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6"
Jul 29 01:57:37.446445 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:37.446414    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b878afe-007a-4afd-96ee-c1a8c613295d-maas-api-service-ca\") pod \"9b878afe-007a-4afd-96ee-c1a8c613295d\" (UID: \"9b878afe-007a-4afd-96ee-c1a8c613295d\") "
Jul 29 01:57:37.446745 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:37.446724    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b878afe-007a-4afd-96ee-c1a8c613295d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9b878afe-007a-4afd-96ee-c1a8c613295d" (UID: "9b878afe-007a-4afd-96ee-c1a8c613295d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:57:37.547605 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:37.547574    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b878afe-007a-4afd-96ee-c1a8c613295d-maas-api-service-ca\") on node \"ip-10-0-130-167.ec2.internal\" DevicePath \"\""
Jul 29 01:57:38.210595 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:38.210561    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6" event={"ID":"9b878afe-007a-4afd-96ee-c1a8c613295d","Type":"ContainerDied","Data":"19d74eca43ed47d17b01db24170cb8d26870933c015423611ed7014fc046f375"}
Jul 29 01:57:38.210763 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:38.210594    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6"
Jul 29 01:57:38.210763 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:38.210613    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19d74eca43ed47d17b01db24170cb8d26870933c015423611ed7014fc046f375"
Jul 29 01:57:45.535939 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:45.535901    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:57:45.753742 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:45.753707    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6"]
Jul 29 01:57:45.758284 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:45.758255    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b88849d5-k4zn6"]
Jul 29 01:57:47.038350 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:47.038314    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b878afe-007a-4afd-96ee-c1a8c613295d" path="/var/lib/kubelet/pods/9b878afe-007a-4afd-96ee-c1a8c613295d/volumes"
Jul 29 01:57:47.352603 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:47.352502    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:57:48.803886 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:48.803852    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5wz2t"]
Jul 29 01:57:52.083471 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:52.083433    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:57:52.197479 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:52.197442    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:57:52.460913 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:52.460818    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:57:52.696264 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:52.696235    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:57:59.114477 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:59.114443    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cjz6f_5cbbd24e-5945-4ef5-9b23-f95383e50e15/manager/0.log"
Jul 29 01:57:59.245697 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:59.245657    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-bp7qg_091d2f22-0009-46d4-8a04-cd4030ebd1f4/manager/0.log"
Jul 29 01:57:59.381648 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:59.381563    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d447d7688-qcfjv_e9d97647-bda4-40c7-a996-e814c17590f4/manager/0.log"
Jul 29 01:57:59.504784 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:59.504643    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gmv9g_4254dcdf-83bd-4e47-b327-dcb11e7279b6/server/0.log"
Jul 29 01:57:59.908483 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:59.908454    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5ff8d77b-cd9bc_b1ba119c-f20a-4c48-adf4-1c89156f8ec8/copy-manifests/0.log"
Jul 29 01:57:59.927792 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:57:59.927757    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5ff8d77b-cd9bc_b1ba119c-f20a-4c48-adf4-1c89156f8ec8/manager/0.log"
Jul 29 01:58:00.705108 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:00.705080    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754825-kxwpj_2b754243-3df1-4eb9-b63d-bc842cce43a6/cleanup/0.log"
Jul 29 01:58:01.713930 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:01.713899    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc_60bb9153-dac6-44bf-a94d-6ad2cc7df018/util/0.log"
Jul 29 01:58:01.723902 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:01.723874    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc_60bb9153-dac6-44bf-a94d-6ad2cc7df018/pull/0.log"
Jul 29 01:58:01.732565 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:01.732545    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc_60bb9153-dac6-44bf-a94d-6ad2cc7df018/extract/0.log"
Jul 29 01:58:01.853379 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:01.853343    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv_118d8147-efc8-45ce-a1d2-82018f862ac5/pull/0.log"
Jul 29 01:58:01.862907 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:01.862874    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv_118d8147-efc8-45ce-a1d2-82018f862ac5/extract/0.log"
Jul 29 01:58:01.870276 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:01.870251    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv_118d8147-efc8-45ce-a1d2-82018f862ac5/util/0.log"
Jul 29 01:58:01.994960 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:01.994896    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz_df35e547-f77b-4d99-b524-b81927058a29/util/0.log"
Jul 29 01:58:02.005410 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:02.005386    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz_df35e547-f77b-4d99-b524-b81927058a29/pull/0.log"
Jul 29 01:58:02.013061 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:02.013038    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz_df35e547-f77b-4d99-b524-b81927058a29/extract/0.log"
Jul 29 01:58:02.130696 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:02.130676    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2_8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5/util/0.log"
Jul 29 01:58:02.142287 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:02.142269    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2_8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5/pull/0.log"
Jul 29 01:58:02.153511 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:02.153484    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2_8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5/extract/0.log"
Jul 29 01:58:02.401773 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:02.401737    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-v5h4f_f71fa537-a9af-4353-b95e-61c99ca59ccf/manager/0.log"
Jul 29 01:58:02.527956 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:02.527931    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-pkbv4_2978bb74-da9e-4a5c-86d2-70650fe5400e/manager/0.log"
Jul 29 01:58:02.669307 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:02.669239    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8pr2m_accbb87b-5d95-45e2-9deb-108bb6718de4/kuadrant-console-plugin/0.log"
Jul 29 01:58:02.811390 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:02.811363    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-czcms_4b30dc6b-0333-4fad-beba-9e1afc342bd4/registry-server/0.log"
Jul 29 01:58:02.962155 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:02.962079    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lrglx_b1c485ba-dfc8-46b8-a58e-1404accc398f/manager/0.log"
Jul 29 01:58:03.110993 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:03.110951    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5wz2t_3ca4c979-9db0-4cb6-945d-b35927636e1d/limitador/0.log"
Jul 29 01:58:03.245134 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:03.245060    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-drcbd_1af02fda-8b00-4627-a4db-16a0189c9cb0/manager/0.log"
Jul 29 01:58:03.888139 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:03.888109    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f844789c7-m989p_a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0/kube-auth-proxy/0.log"
Jul 29 01:58:05.031903 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:05.031869    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-kz48j_95b155b9-dd1e-4f93-aa50-93c6e91a931f/main/0.log"
Jul 29 01:58:05.284030 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:05.283946    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f28bfd_8e495693-7773-42ce-aa71-14de86385cdb/main/0.log"
Jul 29 01:58:05.532001 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:05.531969    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-d4b4f_2612412e-2da3-4382-bb37-21350e9ef8a9/main/0.log"
Jul 29 01:58:11.706013 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.705974    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rr4h4/must-gather-mwz8j"]
Jul 29 01:58:11.706488 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.706325    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b878afe-007a-4afd-96ee-c1a8c613295d" containerName="revoke-keys"
Jul 29 01:58:11.706488 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.706338    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b878afe-007a-4afd-96ee-c1a8c613295d" containerName="revoke-keys"
Jul 29 01:58:11.706488 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.706403    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b878afe-007a-4afd-96ee-c1a8c613295d" containerName="revoke-keys"
Jul 29 01:58:11.709385 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.709369    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rr4h4/must-gather-mwz8j"
Jul 29 01:58:11.712488 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.712467    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rr4h4\"/\"openshift-service-ca.crt\""
Jul 29 01:58:11.712862 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.712844    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rr4h4\"/\"kube-root-ca.crt\""
Jul 29 01:58:11.712941 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.712877    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rr4h4\"/\"default-dockercfg-vd84j\""
Jul 29 01:58:11.720102 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.720077    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rr4h4/must-gather-mwz8j"]
Jul 29 01:58:11.742300 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.742271    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:58:11.824330 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.824297    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log" limit=1024
Jul 29 01:58:11.826248 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.826225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f7538f3e-b1ce-4f6d-b26f-2f9f74dda922-must-gather-output\") pod \"must-gather-mwz8j\" (UID: \"f7538f3e-b1ce-4f6d-b26f-2f9f74dda922\") " pod="openshift-must-gather-rr4h4/must-gather-mwz8j"
Jul 29 01:58:11.826380 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.826290    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpzqm\" (UniqueName: \"kubernetes.io/projected/f7538f3e-b1ce-4f6d-b26f-2f9f74dda922-kube-api-access-gpzqm\") pod \"must-gather-mwz8j\" (UID: \"f7538f3e-b1ce-4f6d-b26f-2f9f74dda922\") " pod="openshift-must-gather-rr4h4/must-gather-mwz8j"
Jul 29 01:58:11.927707 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.927669    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f7538f3e-b1ce-4f6d-b26f-2f9f74dda922-must-gather-output\") pod \"must-gather-mwz8j\" (UID: \"f7538f3e-b1ce-4f6d-b26f-2f9f74dda922\") " pod="openshift-must-gather-rr4h4/must-gather-mwz8j"
Jul 29 01:58:11.927861 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.927723    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpzqm\" (UniqueName: \"kubernetes.io/projected/f7538f3e-b1ce-4f6d-b26f-2f9f74dda922-kube-api-access-gpzqm\") pod \"must-gather-mwz8j\" (UID: \"f7538f3e-b1ce-4f6d-b26f-2f9f74dda922\") " pod="openshift-must-gather-rr4h4/must-gather-mwz8j"
Jul 29 01:58:11.928049 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.928027    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f7538f3e-b1ce-4f6d-b26f-2f9f74dda922-must-gather-output\") pod \"must-gather-mwz8j\" (UID: \"f7538f3e-b1ce-4f6d-b26f-2f9f74dda922\") " pod="openshift-must-gather-rr4h4/must-gather-mwz8j"
Jul 29 01:58:11.936153 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:11.936131    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpzqm\" (UniqueName: \"kubernetes.io/projected/f7538f3e-b1ce-4f6d-b26f-2f9f74dda922-kube-api-access-gpzqm\") pod \"must-gather-mwz8j\" (UID: \"f7538f3e-b1ce-4f6d-b26f-2f9f74dda922\") " pod="openshift-must-gather-rr4h4/must-gather-mwz8j"
Jul 29 01:58:12.019164 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:12.019141    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rr4h4/must-gather-mwz8j"
Jul 29 01:58:12.159492 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:12.159467    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rr4h4/must-gather-mwz8j"]
Jul 29 01:58:12.161379 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:58:12.161352    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7538f3e_b1ce_4f6d_b26f_2f9f74dda922.slice/crio-4189f141f4331e15fef475d8560c9c318cbbe196106127660784875cf7f4eac3 WatchSource:0}: Error finding container 4189f141f4331e15fef475d8560c9c318cbbe196106127660784875cf7f4eac3: Status 404 returned error can't find the container with id 4189f141f4331e15fef475d8560c9c318cbbe196106127660784875cf7f4eac3
Jul 29 01:58:12.163299 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:12.163282    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:58:12.387266 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:12.387165    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rr4h4/must-gather-mwz8j" event={"ID":"f7538f3e-b1ce-4f6d-b26f-2f9f74dda922","Type":"ContainerStarted","Data":"4189f141f4331e15fef475d8560c9c318cbbe196106127660784875cf7f4eac3"}
Jul 29 01:58:13.400407 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:13.400369    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rr4h4/must-gather-mwz8j" event={"ID":"f7538f3e-b1ce-4f6d-b26f-2f9f74dda922","Type":"ContainerStarted","Data":"d6cc267cf6591c739f3e68e765df5e0d8a1024eaaf34b99ddcddf8b71b306013"}
Jul 29 01:58:13.400797 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:13.400419    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rr4h4/must-gather-mwz8j" event={"ID":"f7538f3e-b1ce-4f6d-b26f-2f9f74dda922","Type":"ContainerStarted","Data":"099b10d1dd481e98577329bee661f16209b80e7882bf1eaaaebec2a53a4535f3"}
Jul 29 01:58:13.427884 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:13.427832    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rr4h4/must-gather-mwz8j" podStartSLOduration=1.622842591 podStartE2EDuration="2.427814328s" totalImagesPullingTime="804.971737ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:58:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:58:13.427027192 +0000 UTC m=+2922.927462648" watchObservedRunningTime="2026-07-29 01:58:13.427814328 +0000 UTC m=+2922.928249779"
Jul 29 01:58:14.653457 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:14.653423    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zdjqz_8ad2537f-978e-4a54-9587-4593723b5394/global-pull-secret-syncer/0.log"
Jul 29 01:58:14.715159 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:14.715124    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dpkgf_3a38163b-fd85-49fa-92c3-bcc2f4e23ba5/konnectivity-agent/0.log"
Jul 29 01:58:14.810277 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:14.810212    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-167.ec2.internal_d3f38f3724504444c25ead0317dd3441/haproxy/0.log"
Jul 29 01:58:19.711097 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:19.711054    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc_60bb9153-dac6-44bf-a94d-6ad2cc7df018/extract/0.log"
Jul 29 01:58:19.751072 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:19.750969    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc_60bb9153-dac6-44bf-a94d-6ad2cc7df018/util/0.log"
Jul 29 01:58:19.785982 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:19.785946    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759whpwc_60bb9153-dac6-44bf-a94d-6ad2cc7df018/pull/0.log"
Jul 29 01:58:19.829136 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:19.829085    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv_118d8147-efc8-45ce-a1d2-82018f862ac5/extract/0.log"
Jul 29 01:58:19.853406 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:19.853332    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv_118d8147-efc8-45ce-a1d2-82018f862ac5/util/0.log"
Jul 29 01:58:19.881885 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:19.881860    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ljlpv_118d8147-efc8-45ce-a1d2-82018f862ac5/pull/0.log"
Jul 29 01:58:19.919033 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:19.918980    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz_df35e547-f77b-4d99-b524-b81927058a29/extract/0.log"
Jul 29 01:58:19.943628 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:19.943584    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz_df35e547-f77b-4d99-b524-b81927058a29/util/0.log"
Jul 29 01:58:19.968063 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:19.967989    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qlnrz_df35e547-f77b-4d99-b524-b81927058a29/pull/0.log"
Jul 29 01:58:20.001666 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:20.001637    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2_8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5/extract/0.log"
Jul 29 01:58:20.026265 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:20.026228    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2_8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5/util/0.log"
Jul 29 01:58:20.091438 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:20.091405    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tlvp2_8b3d49c7-6d36-4903-8313-6f4cd3b8dcc5/pull/0.log"
Jul 29 01:58:20.424514 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:20.424482    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-v5h4f_f71fa537-a9af-4353-b95e-61c99ca59ccf/manager/0.log"
Jul 29 01:58:20.460754 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:20.460714    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-pkbv4_2978bb74-da9e-4a5c-86d2-70650fe5400e/manager/0.log"
Jul 29 01:58:20.487268 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:20.487240    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8pr2m_accbb87b-5d95-45e2-9deb-108bb6718de4/kuadrant-console-plugin/0.log"
Jul 29 01:58:20.545856 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:20.545823    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-czcms_4b30dc6b-0333-4fad-beba-9e1afc342bd4/registry-server/0.log"
Jul 29 01:58:20.689255 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:20.689155    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lrglx_b1c485ba-dfc8-46b8-a58e-1404accc398f/manager/0.log"
Jul 29 01:58:20.726195 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:20.725795    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5wz2t_3ca4c979-9db0-4cb6-945d-b35927636e1d/limitador/0.log"
Jul 29 01:58:20.802194 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:20.802141    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-drcbd_1af02fda-8b00-4627-a4db-16a0189c9cb0/manager/0.log"
Jul 29 01:58:22.621527 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:22.621497    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-797fd_bf99a633-c088-4fbe-8834-a3df3f34abf9/monitoring-plugin/0.log"
Jul 29 01:58:22.821097 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:22.821044    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lh58k_a6df3c19-9050-493c-b294-cddae06f7dec/node-exporter/0.log"
Jul 29 01:58:22.843544 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:22.843500    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lh58k_a6df3c19-9050-493c-b294-cddae06f7dec/kube-rbac-proxy/0.log"
Jul 29 01:58:22.874241 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:22.874120    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lh58k_a6df3c19-9050-493c-b294-cddae06f7dec/init-textfile/0.log"
Jul 29 01:58:23.272250 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:23.272218    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-6ftl6_5f926c84-30af-42c7-b590-412c93b8f488/prometheus-operator-admission-webhook/0.log"
Jul 29 01:58:24.185319 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.185280    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"]
Jul 29 01:58:24.191235 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.191206    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.204351 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.204330    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"]
Jul 29 01:58:24.262737 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.262694    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f66bd146-7deb-46dc-bebe-73f2059c369e-proc\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.263029 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.263008    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c5tl\" (UniqueName: \"kubernetes.io/projected/f66bd146-7deb-46dc-bebe-73f2059c369e-kube-api-access-9c5tl\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.263212 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.263197    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f66bd146-7deb-46dc-bebe-73f2059c369e-lib-modules\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.263337 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.263322    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f66bd146-7deb-46dc-bebe-73f2059c369e-podres\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.263476 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.263464    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f66bd146-7deb-46dc-bebe-73f2059c369e-sys\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.364619 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.364581    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f66bd146-7deb-46dc-bebe-73f2059c369e-proc\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.364794 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.364626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c5tl\" (UniqueName: \"kubernetes.io/projected/f66bd146-7deb-46dc-bebe-73f2059c369e-kube-api-access-9c5tl\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.364794 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.364690    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f66bd146-7deb-46dc-bebe-73f2059c369e-lib-modules\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.364794 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.364708    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f66bd146-7deb-46dc-bebe-73f2059c369e-proc\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.364794 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.364715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f66bd146-7deb-46dc-bebe-73f2059c369e-podres\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.364794 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.364776    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f66bd146-7deb-46dc-bebe-73f2059c369e-sys\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.365037 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.364859    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f66bd146-7deb-46dc-bebe-73f2059c369e-sys\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.365037 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.364954    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f66bd146-7deb-46dc-bebe-73f2059c369e-podres\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.365037 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.364968    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f66bd146-7deb-46dc-bebe-73f2059c369e-lib-modules\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.374787 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.374756    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c5tl\" (UniqueName: \"kubernetes.io/projected/f66bd146-7deb-46dc-bebe-73f2059c369e-kube-api-access-9c5tl\") pod \"perf-node-gather-daemonset-v59jd\" (UID: \"f66bd146-7deb-46dc-bebe-73f2059c369e\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.507580 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.507498    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:24.698311 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:24.698109    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"]
Jul 29 01:58:24.703370 ip-10-0-130-167 kubenswrapper[2558]: W0729 01:58:24.703339    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf66bd146_7deb_46dc_bebe_73f2059c369e.slice/crio-7e175b4b46041fdc7d7067946b7149a78d26e8bb34100ea010434bef83302238 WatchSource:0}: Error finding container 7e175b4b46041fdc7d7067946b7149a78d26e8bb34100ea010434bef83302238: Status 404 returned error can't find the container with id 7e175b4b46041fdc7d7067946b7149a78d26e8bb34100ea010434bef83302238
Jul 29 01:58:25.495801 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:25.495752    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd" event={"ID":"f66bd146-7deb-46dc-bebe-73f2059c369e","Type":"ContainerStarted","Data":"99fe757e70074b94f559c687ca50bf4d65d05c9a7d349ab3e6ab39dcbebde4de"}
Jul 29 01:58:25.496409 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:25.495830    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd" event={"ID":"f66bd146-7deb-46dc-bebe-73f2059c369e","Type":"ContainerStarted","Data":"7e175b4b46041fdc7d7067946b7149a78d26e8bb34100ea010434bef83302238"}
Jul 29 01:58:25.496647 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:25.496621    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:25.534360 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:25.534310    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd" podStartSLOduration=1.53429429 podStartE2EDuration="1.53429429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:58:25.533159723 +0000 UTC m=+2935.033595176" watchObservedRunningTime="2026-07-29 01:58:25.53429429 +0000 UTC m=+2935.034729741"
Jul 29 01:58:25.964855 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:25.964808    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-769c674c8f-m7lgz_bbeedc96-6544-4836-8442-da1b510a25ae/console/0.log"
Jul 29 01:58:27.621558 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:27.621522    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hk6hx_e77ad1e5-bfb2-4c16-8895-0854b65959bb/dns/0.log"
Jul 29 01:58:27.642702 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:27.642668    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hk6hx_e77ad1e5-bfb2-4c16-8895-0854b65959bb/kube-rbac-proxy/0.log"
Jul 29 01:58:27.759825 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:27.759789    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vv6bd_af226ec5-cdaf-45c6-9007-fadb4ee20017/dns-node-resolver/0.log"
Jul 29 01:58:28.355521 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:28.355486    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dhscn_5a38cca6-c57a-4656-a991-e6832a2e8648/node-ca/0.log"
Jul 29 01:58:29.466599 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:29.466569    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f844789c7-m989p_a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0/kube-auth-proxy/0.log"
Jul 29 01:58:30.311505 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:30.311473    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4g22q_3ddc2c7b-ff7d-45fc-9971-8cd2a28b94c8/serve-healthcheck-canary/0.log"
Jul 29 01:58:30.906071 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:30.906041    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-htc8v_54cad648-ce34-4e4f-bb80-6800cc746170/kube-rbac-proxy/0.log"
Jul 29 01:58:30.928891 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:30.928866    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-htc8v_54cad648-ce34-4e4f-bb80-6800cc746170/exporter/0.log"
Jul 29 01:58:30.952699 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:30.952647    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-htc8v_54cad648-ce34-4e4f-bb80-6800cc746170/extractor/0.log"
Jul 29 01:58:31.298125 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:31.298092    2558 scope.go:117] "RemoveContainer" containerID="d588ee796f4289ec62805d4346d7a83d9a0213db2267798700f00c7bc227d3ce"
Jul 29 01:58:32.522289 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:32.522258    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-v59jd"
Jul 29 01:58:33.155098 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:33.155006    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cjz6f_5cbbd24e-5945-4ef5-9b23-f95383e50e15/manager/0.log"
Jul 29 01:58:33.361361 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:33.361324    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-bp7qg_091d2f22-0009-46d4-8a04-cd4030ebd1f4/manager/0.log"
Jul 29 01:58:33.540653 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:33.540618    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d447d7688-qcfjv_e9d97647-bda4-40c7-a996-e814c17590f4/manager/0.log"
Jul 29 01:58:33.564387 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:33.564364    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gmv9g_4254dcdf-83bd-4e47-b327-dcb11e7279b6/server/0.log"
Jul 29 01:58:33.813831 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:33.813754    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5ff8d77b-cd9bc_b1ba119c-f20a-4c48-adf4-1c89156f8ec8/manager/0.log"
Jul 29 01:58:33.832911 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:33.832889    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5ff8d77b-cd9bc_b1ba119c-f20a-4c48-adf4-1c89156f8ec8/copy-manifests/0.log"
Jul 29 01:58:34.413288 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:34.413246    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f844789c7-m989p_a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0/kube-auth-proxy/0.log"
Jul 29 01:58:35.984246 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:35.984214    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f844789c7-m989p_a9bf18c4-2ac1-464f-b8d0-5f4a3937b2f0/kube-auth-proxy/0.log"
Jul 29 01:58:41.296227 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:41.296167    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-96mqb_476267ab-64fa-4601-8b7e-0f9a48ef8148/kube-multus/0.log"
Jul 29 01:58:41.318865 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:41.318838    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xwc2_11845a94-87b0-486e-ab0b-545f54a711a3/kube-multus-additional-cni-plugins/0.log"
Jul 29 01:58:41.339434 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:41.339410    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xwc2_11845a94-87b0-486e-ab0b-545f54a711a3/egress-router-binary-copy/0.log"
Jul 29 01:58:41.362479 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:41.362459    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xwc2_11845a94-87b0-486e-ab0b-545f54a711a3/cni-plugins/0.log"
Jul 29 01:58:41.383361 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:41.383334    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xwc2_11845a94-87b0-486e-ab0b-545f54a711a3/bond-cni-plugin/0.log"
Jul 29 01:58:41.406273 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:41.406254    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xwc2_11845a94-87b0-486e-ab0b-545f54a711a3/routeoverride-cni/0.log"
Jul 29 01:58:41.426541 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:41.426520    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xwc2_11845a94-87b0-486e-ab0b-545f54a711a3/whereabouts-cni-bincopy/0.log"
Jul 29 01:58:41.448131 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:41.448110    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xwc2_11845a94-87b0-486e-ab0b-545f54a711a3/whereabouts-cni/0.log"
Jul 29 01:58:41.889460 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:41.889426    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dtlcz_af0f0bbd-a686-4738-97d9-a6faeb834ac7/network-metrics-daemon/0.log"
Jul 29 01:58:41.909129 ip-10-0-130-167 kubenswrapper[2558]: I0729 01:58:41.909107    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dtlcz_af0f0bbd-a686-4738-97d9-a6faeb834ac7/kube-rbac-proxy/0.log"