Jul 16 09:03:06.912859 ip-10-0-130-231 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 09:03:06.912873 ip-10-0-130-231 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 09:03:06.912883 ip-10-0-130-231 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 09:03:06.913204 ip-10-0-130-231 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 09:03:17.015866 ip-10-0-130-231 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 09:03:17.015884 ip-10-0-130-231 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e78d3d6c48b449a989dc0e51385d1e9e --
Jul 16 09:04:52.030610 ip-10-0-130-231 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 09:04:52.485709 ip-10-0-130-231 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 09:04:52.485709 ip-10-0-130-231 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 09:04:52.485709 ip-10-0-130-231 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 09:04:52.485709 ip-10-0-130-231 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 09:04:52.485709 ip-10-0-130-231 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 09:04:52.485709 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.482303    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487376    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487388    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487391    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487403    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487407    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487409    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487412    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487414    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487418    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487420    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487423    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487425    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487430    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487440    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487444    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487447    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487449    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487452    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 09:04:52.501623 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487455    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487457    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487461    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487465    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487468    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487470    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487473    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487476    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487479    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487482    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487485    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487487    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487490    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487498    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487501    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487504    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487507    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487509    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487512    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487520    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 09:04:52.515948 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487523    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487525    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487528    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487530    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487533    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487536    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487540    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487542    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487545    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487547    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487550    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487552    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487555    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487559    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487563    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487566    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487568    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487571    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487573    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487576    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 09:04:52.518301 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487579    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487582    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487584    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487587    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487589    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487592    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487595    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487598    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487600    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487603    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487605    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487608    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487618    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487621    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487624    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487626    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487630    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487632    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487635    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487637    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 09:04:52.520048 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487640    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487643    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487646    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487650    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487653    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487655    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487657    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487660    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487663    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487666    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487668    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487671    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487673    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487676    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487679    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487682    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487684    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487687    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487689    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487692    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 09:04:52.528321 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.487695    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488408    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488415    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488419    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488421    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488425    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488428    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488430    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488433    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488436    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488439    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488442    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488445    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488447    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488450    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488452    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488455    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488458    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488460    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 09:04:52.530080 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488462    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488465    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488468    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488470    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488473    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488475    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488478    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488482    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488487    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488491    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488494    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488496    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488499    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488502    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488504    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488506    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488509    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488512    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488514    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488518    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 09:04:52.532486 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488521    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488523    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488526    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488531    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488533    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488536    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488538    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488541    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488543    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488546    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488549    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488554    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488557    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488560    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488563    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488565    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488568    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488571    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488575    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 09:04:52.543969 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488578    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488583    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488585    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488588    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488591    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488593    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488597    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488601    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488604    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488606    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488609    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488612    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488615    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488619    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488621    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488624    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488626    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488628    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488631    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488634    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 09:04:52.546114 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488636    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488638    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488641    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488644    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488646    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488649    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488652    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488654    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488658    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488661    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488663    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488666    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488668    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488673    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488676    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488678    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488681    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488683    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488686    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488688    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 09:04:52.547850 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488691    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.488693    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489045    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489049    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489052    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489055    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489059    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489062    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489064    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489067    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489069    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489072    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489074    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489077    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489081    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489085    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489088    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489091    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489094    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 09:04:52.560538 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489097    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489100    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489102    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489105    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489108    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489111    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489115    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489118    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489120    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489123    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489126    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489128    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489131    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489133    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489136    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489138    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489141    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489143    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489146    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489151    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 09:04:52.620604 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489153    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 09:04:52.571669 ip-10-0-130-231 systemd[1]: Started Kubernetes Kubelet.
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489156    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489158    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489161    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489163    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489166    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489168    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489170    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489173    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489176    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489178    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489180    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489183    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489185    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489188    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489190    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489193    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489195    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489200    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489202    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 09:04:52.637286 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489205    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489207    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489210    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489213    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489216    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489219    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489221    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489225    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489227    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489230    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489232    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489237    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489240    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489242    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489245    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489247    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489250    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489252    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489255    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489257    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 09:04:52.837650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489260    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489264    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489268    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489270    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489273    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489276    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489278    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489281    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489283    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489286    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489290    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489292    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489295    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489297    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489300    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489302    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489305    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489307    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489309    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489312    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 09:04:52.838881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489314    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.489317    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489395    2556 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489403    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489414    2556 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489420    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489423    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489427    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489430    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489434    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489437    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489440    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489444    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489447    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489450    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489453    2556 flags.go:64] FLAG: --cgroup-root=""
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489456    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489459    2556 flags.go:64] FLAG: --client-ca-file=""
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489462    2556 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489464    2556 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489468    2556 flags.go:64] FLAG: --cluster-domain=""
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489471    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489477    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489480    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 09:04:52.840309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489483    2556 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489486    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489489    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489492    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489496    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489499    2556 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489502    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489504    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489507    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489510    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489514    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489519    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489521    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489524    2556 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489527    2556 flags.go:64] FLAG: --enable-server="true"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489530    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489535    2556 flags.go:64] FLAG: --event-burst="100"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489538    2556 flags.go:64] FLAG: --event-qps="50"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489540    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489543    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489546    2556 flags.go:64] FLAG: --eviction-hard=""
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489550    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489553    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489556    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489559    2556 flags.go:64] FLAG: --eviction-soft=""
Jul 16 09:04:52.841735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489562    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489564    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489567    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489570    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489573    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489577    2556 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489580    2556 flags.go:64] FLAG: --feature-gates=""
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489584    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489587    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489589    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489593    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489596    2556 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489599    2556 flags.go:64] FLAG: --help="false"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489601    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489604    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489607    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489610    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489614    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489618    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489621    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489624    2556 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489627    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489630    2556 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 09:04:52.842836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489633    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489636    2556 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489638    2556 flags.go:64] FLAG: --kube-reserved=""
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489642    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489645    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489648    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489650    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489653    2556 flags.go:64] FLAG: --lock-file=""
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489656    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489659    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489662    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489667    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489669    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489673    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489677    2556 flags.go:64] FLAG: --logging-format="text"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489680    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489683    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489686    2556 flags.go:64] FLAG: --manifest-url=""
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489689    2556 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489693    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489696    2556 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489700    2556 flags.go:64] FLAG: --max-pods="110"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489703    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489705    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489708    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 09:04:52.843933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489711    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489714    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489718    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489721    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489729    2556 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489732    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489735    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489738    2556 flags.go:64] FLAG: --pod-cidr=""
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489741    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489746    2556 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489749    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489752    2556 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489755    2556 flags.go:64] FLAG: --port="10250"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489758    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489761    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09e862281c97ffd16"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489764    2556 flags.go:64] FLAG: --qos-reserved=""
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489767    2556 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489770    2556 flags.go:64] FLAG: --register-node="true"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489773    2556 flags.go:64] FLAG: --register-with-taints=""
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489777    2556 flags.go:64] FLAG: --registry-burst="10"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489779    2556 flags.go:64] FLAG: --registry-qps="5"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489783    2556 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489786    2556 flags.go:64] FLAG: --reserved-memory=""
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489789    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489793    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 09:04:52.845002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489796    2556 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489798    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489801    2556 flags.go:64] FLAG: --runonce="false"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489804    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489807    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489810    2556 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489813    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489816    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489819    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489822    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489826    2556 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489829    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489831    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489834    2556 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489837    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489841    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489844    2556 flags.go:64] FLAG: --system-cgroups=""
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489847    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489853    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489856    2556 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489858    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489862    2556 flags.go:64] FLAG: --tls-min-version=""
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489865    2556 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489867    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489870    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 09:04:52.846299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489873    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489876    2556 flags.go:64] FLAG: --v="2"
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489880    2556 flags.go:64] FLAG: --version="false"
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489890    2556 flags.go:64] FLAG: --vmodule=""
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489894    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.489897    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490067    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490071    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490074    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490077    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490081    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490085    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490088    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490091    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490093    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490096    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490099    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490103    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490106    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490108    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490111    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 09:04:52.847387 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490113    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490116    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490119    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490122    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490124    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490127    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490131    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490135    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490137    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490140    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490144    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490147    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490150    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490153    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490156    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490159    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490162    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490165    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490168    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 09:04:52.848680 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490171    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490174    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490177    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490179    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490182    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490185    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490188    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490191    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490193    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490197    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490200    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490203    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490205    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490208    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490211    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490213    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490216    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490219    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490221    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490224    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 09:04:52.849741 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490227    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490229    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490232    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490234    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490236    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490239    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490242    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490245    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490248    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490250    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490253    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490255    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490258    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490260    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490263    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490265    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490268    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490271    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490273    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490276    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 09:04:52.850826 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490278    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490282    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490284    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490287    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490289    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490292    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490295    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490298    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490300    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490303    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490306    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490308    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490310    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490313    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490315    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490318    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490320    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490323    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490325    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 09:04:52.851900 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490329    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 09:04:52.852901 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490331    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 09:04:52.852901 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490334    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 09:04:52.852901 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490336    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 09:04:52.852901 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490339    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 09:04:52.852901 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.490341    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 09:04:52.852901 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.491129    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 09:04:52.852901 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.500126    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 09:04:52.852901 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.500144    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 09:04:52.852901 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.501180    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 09:04:52.852901 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.501190    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 09:04:52.852901 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501767    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 09:04:52.852901 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501799    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 09:04:52.852901 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501923    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 09:04:52.852901 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501929    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501933    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501935    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501938    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501941    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501944    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501947    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501949    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501952    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501955    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501957    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501961    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501964    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501966    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501970    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501973    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501976    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501978    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501983    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 09:04:52.853560 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501987    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501990    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501994    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.501997    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502001    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502006    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502009    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502013    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502016    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502020    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502024    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502027    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502031    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502034    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502037    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502039    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502042    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502045    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502047    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 09:04:52.854635 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502050    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502053    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502056    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502058    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502061    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502066    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502069    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502072    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502074    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502077    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502080    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502083    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502086    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502089    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502092    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502094    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502097    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502100    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502103    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 09:04:52.855513 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502105    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502108    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502111    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502113    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502116    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502118    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502121    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502124    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502126    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502129    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502131    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502134    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502137    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502140    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502142    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502145    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502147    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502150    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502154    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502157    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 09:04:52.856599 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502159    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502162    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502165    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502168    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502170    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502173    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502175    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502178    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502181    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502184    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502186    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502189    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502192    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502195    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502197    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502200    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502203    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502205    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 09:04:52.857477 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502208    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.502213    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502363    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502370    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502373    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502376    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502379    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502382    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502385    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502388    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502391    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502394    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502396    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502402    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502405    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 09:04:52.858344 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502408    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502411    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502414    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502417    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502419    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502423    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502425    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502428    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502430    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502433    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502435    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502438    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502440    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502443    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502446    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502448    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502451    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502454    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502456    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502459    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 09:04:52.861616 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502461    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502464    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502466    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502469    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502471    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502474    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502476    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502479    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502481    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502484    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502488    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502491    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502493    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502496    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502498    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502501    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502504    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502506    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502509    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 09:04:52.862684 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502512    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502514    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502517    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502520    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502522    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502525    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502527    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502530    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502532    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502535    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502537    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502540    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502543    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502546    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502550    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502553    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502556    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502560    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502563    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 09:04:52.869672 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502565    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502568    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502570    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502573    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502578    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502580    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502583    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502587    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502590    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502592    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502595    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502597    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502600    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502602    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502605    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502607    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502610    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502612    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502616    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502619    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 09:04:52.870539 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502622    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 09:04:52.871624 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502625    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 09:04:52.871624 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502628    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 09:04:52.871624 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502632    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 09:04:52.871624 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502634    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 09:04:52.871624 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502637    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 09:04:52.871624 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502640    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 09:04:52.871624 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:52.502642    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 09:04:52.871624 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.502647    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 09:04:52.871624 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.502758    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 09:04:52.871624 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.504994    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 09:04:52.871624 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.506478    2556 server.go:1019] "Starting client certificate rotation"
Jul 16 09:04:52.871624 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.506584    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 09:04:52.871624 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.506615    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 09:04:52.872273 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.509298    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 09:04:52.872273 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.510554    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 09:04:52.872273 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.528318    2556 log.go:25] "Validated CRI v1 runtime API"
Jul 16 09:04:52.872273 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.530502    2556 log.go:25] "Validated CRI v1 image API"
Jul 16 09:04:52.872273 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.533029    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 09:04:52.872273 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.537674    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 09:04:52.872273 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.539848    2556 fs.go:135] Filesystem UUIDs: map[73d12be3-8467-4dec-84c3-a0f2d36713e1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c5ffbd24-eb19-4101-981f-abef0942e616:/dev/nvme0n1p4]
Jul 16 09:04:52.872273 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.539862    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.546765    2556 manager.go:216] Machine: {Timestamp:2026-07-16 09:04:52.545313303 +0000 UTC m=+0.369164863 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098630 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21b116cdabafc852fdf34faf82aaec SystemUUID:ec21b116-cdab-afc8-52fd-f34faf82aaec BootID:e78d3d6c-48b4-49a9-89dc-0e51385d1e9e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:59:d0:73:2e:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:59:d0:73:2e:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:17:e3:ef:cd:2a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.546865    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.546951    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.550336    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.550379    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-231.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.551939    2556 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.551949    2556 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.551958    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.551967    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.553498    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.556228    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.556366    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.556398    2556 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.556414    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.556424    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.556433    2556 kubelet.go:398] "Adding apiserver pod source"
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.556441    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 09:04:52.872923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.556901    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.556917    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.561219    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.565501    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.565707    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.565941    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.565958    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.565964    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.565971    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.565978    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.565984    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.566740    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.566747    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.566758    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.566767    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.566777    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.566787    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.567666    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.567673    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.568970    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.568970    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.570832    2556 server.go:1268] "Started kubelet"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.570908    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.570922    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.570968    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.572383    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.573473    2556 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.577392    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.580409    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.580433    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.580495    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.582071    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.582084    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.582102    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.582260    2556 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.582268    2556 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.582552    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-231.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.582584    2556 factory.go:55] Registering systemd factory
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.582598    2556 factory.go:223] Registration of the systemd container factory successfully
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.582815    2556 factory.go:153] Registering CRI-O factory
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.582831    2556 factory.go:223] Registration of the crio container factory successfully
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.582874    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.582904    2556 factory.go:103] Registering Raw factory
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.582917    2556 manager.go:1196] Started watching for new ooms in manager
Jul 16 09:04:52.873789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.583195    2556 manager.go:349] Starting recovery of all containers
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.582746    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-231.ec2.internal.18c2b9cd0387d601  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-231.ec2.internal,UID:ip-10-0-130-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-231.ec2.internal,},FirstTimestamp:2026-07-16 09:04:52.570805761 +0000 UTC m=+0.394657320,LastTimestamp:2026-07-16 09:04:52.570805761 +0000 UTC m=+0.394657320,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-231.ec2.internal,}"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.585104    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.585223    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.593164    2556 manager.go:354] Recovery completed
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.598023    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tv7kx"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.599818    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.601556    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.601582    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.601591    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasSufficientPID"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.602033    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.602043    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.602046    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.602061    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.602705    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.602741    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.602751    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasSufficientPID"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.603090    2556 policy_none.go:49] "None policy: Start"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.603103    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.603113    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.603428    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-231.ec2.internal.18c2b9cd055d3d2b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-231.ec2.internal,UID:ip-10-0-130-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-231.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-231.ec2.internal,},FirstTimestamp:2026-07-16 09:04:52.601568555 +0000 UTC m=+0.425420114,LastTimestamp:2026-07-16 09:04:52.601568555 +0000 UTC m=+0.425420114,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-231.ec2.internal,}"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.604125    2556 policy_none.go:47] "Start"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.607976    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tv7kx"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.681450    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.687857    2556 manager.go:337] "Starting Device Plugin manager"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.687910    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.687924    2556 server.go:87] "Starting device plugin registration server"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.688175    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.688188    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.688306    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.688412    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.688422    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 09:04:52.875734 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.689025    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.689078    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.710324    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.711551    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.711583    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.711602    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.711653    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.714567    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.788277    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.789090    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.789116    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.789126    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasSufficientPID"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.789148    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.792416    2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-231.ec2.internal\" not found" node="ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.798648    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.798666    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-231.ec2.internal\": node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.812082    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-231.ec2.internal"]
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.812139    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.813382    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.813410    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.813425    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasSufficientPID"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.814537    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.814628    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.814655    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.815737    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.815759    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.815770    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasSufficientPID"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.816183    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.816206    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.816219    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasSufficientPID"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.816844    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.816865    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.827840    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.827993    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.828004    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeHasSufficientPID"
Jul 16 09:04:52.877048 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.827913    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:52.984973 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.883409    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b3c0d52a204f48311b3bdc937f9876d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal\" (UID: \"4b3c0d52a204f48311b3bdc937f9876d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.984973 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.883442    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b3c0d52a204f48311b3bdc937f9876d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal\" (UID: \"4b3c0d52a204f48311b3bdc937f9876d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.984973 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.883467    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/164f37f8c5097726cc0dfd83f2773660-config\") pod \"kube-apiserver-proxy-ip-10-0-130-231.ec2.internal\" (UID: \"164f37f8c5097726cc0dfd83f2773660\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.984973 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.899374    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-231.ec2.internal\" not found" node="ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.984973 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.903972    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-231.ec2.internal\" not found" node="ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.984973 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:52.928098    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:52.984973 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.984545    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b3c0d52a204f48311b3bdc937f9876d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal\" (UID: \"4b3c0d52a204f48311b3bdc937f9876d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.984973 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.984573    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b3c0d52a204f48311b3bdc937f9876d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal\" (UID: \"4b3c0d52a204f48311b3bdc937f9876d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.984973 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.984592    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/164f37f8c5097726cc0dfd83f2773660-config\") pod \"kube-apiserver-proxy-ip-10-0-130-231.ec2.internal\" (UID: \"164f37f8c5097726cc0dfd83f2773660\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.984973 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.984639    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b3c0d52a204f48311b3bdc937f9876d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal\" (UID: \"4b3c0d52a204f48311b3bdc937f9876d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.984973 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.984653    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b3c0d52a204f48311b3bdc937f9876d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal\" (UID: \"4b3c0d52a204f48311b3bdc937f9876d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:52.984973 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:52.984684    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/164f37f8c5097726cc0dfd83f2773660-config\") pod \"kube-apiserver-proxy-ip-10-0-130-231.ec2.internal\" (UID: \"164f37f8c5097726cc0dfd83f2773660\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:53.047865 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:53.028782    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:53.165670 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:53.129443    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:53.292650 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:53.200932    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:53.292650 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:53.206486    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:53.292650 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:53.230394    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:53.395162 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:53.330906    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:53.497789 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:53.431385    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:53.497789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:53.438580    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 09:04:53.508575 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:53.505271    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 09:04:53.508575 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:53.505395    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 09:04:53.508575 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:53.505401    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 09:04:53.614072 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:53.531477    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:53.614072 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:53.611281    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 08:59:53 +0000 UTC" deadline="2028-02-11 12:10:46.993584135 +0000 UTC"
Jul 16 09:04:53.614072 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:53.611303    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13803h5m53.382283772s"
Jul 16 09:04:53.726944 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:53.632029    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:53.733396 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:53.732520    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:53.845831 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:53.833416    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:53.958914 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:53.933990    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-231.ec2.internal\" not found"
Jul 16 09:04:53.977573 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:53.973066    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 09:04:53.981862 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:53.981163    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:54.086446 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.000311    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 09:04:54.086446 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.002468    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-231.ec2.internal"
Jul 16 09:04:54.086446 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.012174    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 09:04:54.086446 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.055302    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 09:04:54.558161 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.558135    2556 apiserver.go:52] "Watching apiserver"
Jul 16 09:04:54.567877 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.567853    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 09:04:54.568195 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.568171    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-231.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf","openshift-cluster-node-tuning-operator/tuned-mh56v","openshift-image-registry/node-ca-xst8k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal","openshift-multus/network-metrics-daemon-sbf5q","openshift-network-diagnostics/network-check-target-57v9s","openshift-network-operator/iptables-alerter-2b2r4","kube-system/global-pull-secret-syncer-w6rvh","kube-system/konnectivity-agent-hg7sb","openshift-dns/node-resolver-xm6zn","openshift-multus/multus-9hs7m","openshift-multus/multus-additional-cni-plugins-lgr75","openshift-ovn-kubernetes/ovnkube-node-llwv9"]
Jul 16 09:04:54.571057 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.571038    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:04:54.571136 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:54.571113    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:04:54.573327 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.573313    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hg7sb"
Jul 16 09:04:54.575606 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.575585    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.575715 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.575649    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n5x7r\""
Jul 16 09:04:54.575715 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.575657    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 09:04:54.575928 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.575910    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 09:04:54.577698 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.577682    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 09:04:54.577954 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.577940    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 09:04:54.578088 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.578076    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-64pjf\""
Jul 16 09:04:54.578235 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.578221    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xst8k"
Jul 16 09:04:54.580131 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.580116    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 09:04:54.580404 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.580391    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2b2r4"
Jul 16 09:04:54.580947 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.580931    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6pskb\""
Jul 16 09:04:54.581086 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.581073    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 09:04:54.581209 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.581198    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 09:04:54.581314 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.581303    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 09:04:54.582817 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.582801    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 09:04:54.582971 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.582959    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 09:04:54.583126 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.583113    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m275q\""
Jul 16 09:04:54.583306 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.583294    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 09:04:54.584527 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.584513    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:04:54.584586 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:54.584569    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:04:54.587551 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.587532    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.589804 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.589785    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 09:04:54.589889 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.589811    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 09:04:54.589889 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.589813    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 09:04:54.589989 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.589922    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fqv4x\""
Jul 16 09:04:54.589989 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.589934    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.590217 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.590203    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 09:04:54.592320 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.592304    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kkt4j\""
Jul 16 09:04:54.592413 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.592303    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 09:04:54.592618 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.592602    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.592664 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.592627    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 09:04:54.593995 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.593977    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07047c0e-998f-4081-b64e-d285a6d5750a-host\") pod \"node-ca-xst8k\" (UID: \"07047c0e-998f-4081-b64e-d285a6d5750a\") " pod="openshift-image-registry/node-ca-xst8k"
Jul 16 09:04:54.594096 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.593998    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/07047c0e-998f-4081-b64e-d285a6d5750a-serviceca\") pod \"node-ca-xst8k\" (UID: \"07047c0e-998f-4081-b64e-d285a6d5750a\") " pod="openshift-image-registry/node-ca-xst8k"
Jul 16 09:04:54.594096 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594017    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83250eb6-4c2f-4fc2-8200-f8bb30fa93e6-agent-certs\") pod \"konnectivity-agent-hg7sb\" (UID: \"83250eb6-4c2f-4fc2-8200-f8bb30fa93e6\") " pod="kube-system/konnectivity-agent-hg7sb"
Jul 16 09:04:54.594096 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594032    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-kubernetes\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.594096 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594049    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-lib-modules\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.594290 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594093    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-tuned\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.594290 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594133    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f8093502-40bf-45df-b7ec-b570acc55353-host-slash\") pod \"iptables-alerter-2b2r4\" (UID: \"f8093502-40bf-45df-b7ec-b570acc55353\") " pod="openshift-network-operator/iptables-alerter-2b2r4"
Jul 16 09:04:54.594290 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594164    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwn6l\" (UniqueName: \"kubernetes.io/projected/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-kube-api-access-qwn6l\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:04:54.594290 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594194    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-sysctl-conf\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.594290 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594221    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-run\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.594290 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594270    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-host\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.594599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594293    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9pk9\" (UniqueName: \"kubernetes.io/projected/07047c0e-998f-4081-b64e-d285a6d5750a-kube-api-access-c9pk9\") pod \"node-ca-xst8k\" (UID: \"07047c0e-998f-4081-b64e-d285a6d5750a\") " pod="openshift-image-registry/node-ca-xst8k"
Jul 16 09:04:54.594599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594351    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k4s5\" (UniqueName: \"kubernetes.io/projected/f8093502-40bf-45df-b7ec-b570acc55353-kube-api-access-9k4s5\") pod \"iptables-alerter-2b2r4\" (UID: \"f8093502-40bf-45df-b7ec-b570acc55353\") " pod="openshift-network-operator/iptables-alerter-2b2r4"
Jul 16 09:04:54.594599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594387    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:04:54.594599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594405    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-sysctl-d\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.594599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594445    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjjzx\" (UniqueName: \"kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx\") pod \"network-check-target-57v9s\" (UID: \"c54d6cc3-8d45-401c-8f2b-c52524b80b47\") " pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:04:54.594599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594513    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83250eb6-4c2f-4fc2-8200-f8bb30fa93e6-konnectivity-ca\") pod \"konnectivity-agent-hg7sb\" (UID: \"83250eb6-4c2f-4fc2-8200-f8bb30fa93e6\") " pod="kube-system/konnectivity-agent-hg7sb"
Jul 16 09:04:54.594599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594541    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-modprobe-d\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.594599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594564    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-sysconfig\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.594971 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594612    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f8093502-40bf-45df-b7ec-b570acc55353-iptables-alerter-script\") pod \"iptables-alerter-2b2r4\" (UID: \"f8093502-40bf-45df-b7ec-b570acc55353\") " pod="openshift-network-operator/iptables-alerter-2b2r4"
Jul 16 09:04:54.594971 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594639    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-systemd\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.594971 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594663    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-sys\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.594971 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594691    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-var-lib-kubelet\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.594971 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594717    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11454c61-b3ee-4bdb-b069-719a1754d9e4-tmp\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.594971 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.594756    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2slpl\" (UniqueName: \"kubernetes.io/projected/11454c61-b3ee-4bdb-b069-719a1754d9e4-kube-api-access-2slpl\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.595257 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.595020    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 09:04:54.595257 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.595042    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 09:04:54.595257 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.595023    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6zcfz\""
Jul 16 09:04:54.595257 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.595158    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 09:04:54.595471 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.595451    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xm6zn"
Jul 16 09:04:54.597724 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.597703    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 09:04:54.597830 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.597780    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-94rz7\""
Jul 16 09:04:54.597953 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.597939    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:04:54.598002 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:54.597987    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:04:54.598200 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.598184    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 09:04:54.599133 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.599116    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 09:04:54.600901 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.600883    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.603083 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.603064    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 09:04:54.603177 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.603066    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-792zk\""
Jul 16 09:04:54.603177 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.603070    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 09:04:54.603439 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.603419    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 09:04:54.603497 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.603445    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 09:04:54.603497 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.603458    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 09:04:54.604173 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.604152    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 09:04:54.627226 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.627201    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wmcgx"
Jul 16 09:04:54.637604 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.637584    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wmcgx"
Jul 16 09:04:54.682941 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.682922    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 09:04:54.695254 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695228    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2slpl\" (UniqueName: \"kubernetes.io/projected/11454c61-b3ee-4bdb-b069-719a1754d9e4-kube-api-access-2slpl\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.695347 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695261    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/07047c0e-998f-4081-b64e-d285a6d5750a-serviceca\") pod \"node-ca-xst8k\" (UID: \"07047c0e-998f-4081-b64e-d285a6d5750a\") " pod="openshift-image-registry/node-ca-xst8k"
Jul 16 09:04:54.695347 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695285    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-var-lib-openvswitch\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.695347 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695311    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-node-log\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.695600 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695494    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-cnibin\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.695600 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695525    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gllf5\" (UniqueName: \"kubernetes.io/projected/7ea846f2-1826-41e4-bf80-1c42f1c001c7-kube-api-access-gllf5\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.695600 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695545    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ea846f2-1826-41e4-bf80-1c42f1c001c7-multus-daemon-config\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.695600 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695565    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-run-multus-certs\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.695827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695604    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f695655-2301-4d69-a98f-fc51b8aeea13-cnibin\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.695827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695628    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k4s5\" (UniqueName: \"kubernetes.io/projected/f8093502-40bf-45df-b7ec-b570acc55353-kube-api-access-9k4s5\") pod \"iptables-alerter-2b2r4\" (UID: \"f8093502-40bf-45df-b7ec-b570acc55353\") " pod="openshift-network-operator/iptables-alerter-2b2r4"
Jul 16 09:04:54.695827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695647    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f695655-2301-4d69-a98f-fc51b8aeea13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.695827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695665    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.695827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695689    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjzx\" (UniqueName: \"kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx\") pod \"network-check-target-57v9s\" (UID: \"c54d6cc3-8d45-401c-8f2b-c52524b80b47\") " pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:04:54.695827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695711    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-slash\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.695827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695726    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-run-ovn-kubernetes\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.695827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695757    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/40819698-f872-4fc6-a82d-f81196572c63-ovn-node-metrics-cert\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.695827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695780    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-hostroot\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.695827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695798    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f695655-2301-4d69-a98f-fc51b8aeea13-os-release\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.695827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695796    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/07047c0e-998f-4081-b64e-d285a6d5750a-serviceca\") pod \"node-ca-xst8k\" (UID: \"07047c0e-998f-4081-b64e-d285a6d5750a\") " pod="openshift-image-registry/node-ca-xst8k"
Jul 16 09:04:54.695827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695814    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-sys\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695868    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6526b2dd-27b6-4b19-860e-dcb145d1803b-kubelet-config\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695893    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-sys\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695906    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695933    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695952    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-etc-kubernetes\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695968    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f695655-2301-4d69-a98f-fc51b8aeea13-system-cni-dir\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.695998    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-registration-dir\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696025    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-device-dir\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696046    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-kubernetes\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696064    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-sysctl-conf\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696083    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-run\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696127    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-kubernetes\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696164    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-host\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696192    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-host\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696194    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbn7g\" (UniqueName: \"kubernetes.io/projected/40819698-f872-4fc6-a82d-f81196572c63-kube-api-access-kbn7g\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696191    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-sysctl-conf\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.696279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696165    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-run\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696213    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ea846f2-1826-41e4-bf80-1c42f1c001c7-cni-binary-copy\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696235    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f695655-2301-4d69-a98f-fc51b8aeea13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696253    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f695655-2301-4d69-a98f-fc51b8aeea13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696271    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-sysctl-d\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696287    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83250eb6-4c2f-4fc2-8200-f8bb30fa93e6-konnectivity-ca\") pod \"konnectivity-agent-hg7sb\" (UID: \"83250eb6-4c2f-4fc2-8200-f8bb30fa93e6\") " pod="kube-system/konnectivity-agent-hg7sb"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696314    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-sysconfig\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696343    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-cni-netd\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696378    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-run-netns\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696377    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-sysctl-d\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696427    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nrmf\" (UniqueName: \"kubernetes.io/projected/79b61fa9-efeb-494d-8ad3-31962d93f9ef-kube-api-access-9nrmf\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696430    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-sysconfig\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696451    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-systemd\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696469    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07047c0e-998f-4081-b64e-d285a6d5750a-host\") pod \"node-ca-xst8k\" (UID: \"07047c0e-998f-4081-b64e-d285a6d5750a\") " pod="openshift-image-registry/node-ca-xst8k"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696492    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-etc-openvswitch\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696497    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-systemd\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696517    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-multus-cni-dir\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.697060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696540    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/40819698-f872-4fc6-a82d-f81196572c63-ovnkube-script-lib\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696555    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-os-release\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696579    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjhwl\" (UniqueName: \"kubernetes.io/projected/2f695655-2301-4d69-a98f-fc51b8aeea13-kube-api-access-mjhwl\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696516    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07047c0e-998f-4081-b64e-d285a6d5750a-host\") pod \"node-ca-xst8k\" (UID: \"07047c0e-998f-4081-b64e-d285a6d5750a\") " pod="openshift-image-registry/node-ca-xst8k"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696600    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83250eb6-4c2f-4fc2-8200-f8bb30fa93e6-agent-certs\") pod \"konnectivity-agent-hg7sb\" (UID: \"83250eb6-4c2f-4fc2-8200-f8bb30fa93e6\") " pod="kube-system/konnectivity-agent-hg7sb"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696624    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-lib-modules\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696649    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-tuned\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696673    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwn6l\" (UniqueName: \"kubernetes.io/projected/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-kube-api-access-qwn6l\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696697    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-systemd-units\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696722    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-run-systemd\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696746    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/40819698-f872-4fc6-a82d-f81196572c63-ovnkube-config\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696770    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-system-cni-dir\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696774    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-lib-modules\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696794    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4e101a1-6ad1-4a51-9cf2-cc73c46c849a-hosts-file\") pod \"node-resolver-xm6zn\" (UID: \"d4e101a1-6ad1-4a51-9cf2-cc73c46c849a\") " pod="openshift-dns/node-resolver-xm6zn"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696799    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83250eb6-4c2f-4fc2-8200-f8bb30fa93e6-konnectivity-ca\") pod \"konnectivity-agent-hg7sb\" (UID: \"83250eb6-4c2f-4fc2-8200-f8bb30fa93e6\") " pod="kube-system/konnectivity-agent-hg7sb"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696837    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdt4w\" (UniqueName: \"kubernetes.io/projected/d4e101a1-6ad1-4a51-9cf2-cc73c46c849a-kube-api-access-cdt4w\") pod \"node-resolver-xm6zn\" (UID: \"d4e101a1-6ad1-4a51-9cf2-cc73c46c849a\") " pod="openshift-dns/node-resolver-xm6zn"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696872    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-run-openvswitch\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.697915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696904    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/40819698-f872-4fc6-a82d-f81196572c63-env-overrides\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696931    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696959    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-modprobe-d\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696949    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.696987    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-run-ovn\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697010    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-log-socket\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697049    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-multus-socket-dir-parent\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697082    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-sys-fs\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697096    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-modprobe-d\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697111    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-var-lib-kubelet\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697137    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11454c61-b3ee-4bdb-b069-719a1754d9e4-tmp\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697163    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f8093502-40bf-45df-b7ec-b570acc55353-host-slash\") pod \"iptables-alerter-2b2r4\" (UID: \"f8093502-40bf-45df-b7ec-b570acc55353\") " pod="openshift-network-operator/iptables-alerter-2b2r4"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697173    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11454c61-b3ee-4bdb-b069-719a1754d9e4-var-lib-kubelet\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697189    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-run-netns\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697243    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-var-lib-cni-multus\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697258    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f8093502-40bf-45df-b7ec-b570acc55353-host-slash\") pod \"iptables-alerter-2b2r4\" (UID: \"f8093502-40bf-45df-b7ec-b570acc55353\") " pod="openshift-network-operator/iptables-alerter-2b2r4"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697272    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4e101a1-6ad1-4a51-9cf2-cc73c46c849a-tmp-dir\") pod \"node-resolver-xm6zn\" (UID: \"d4e101a1-6ad1-4a51-9cf2-cc73c46c849a\") " pod="openshift-dns/node-resolver-xm6zn"
Jul 16 09:04:54.699097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697296    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-run-k8s-cni-cncf-io\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.700223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697320    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-multus-conf-dir\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.700223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697347    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pk9\" (UniqueName: \"kubernetes.io/projected/07047c0e-998f-4081-b64e-d285a6d5750a-kube-api-access-c9pk9\") pod \"node-ca-xst8k\" (UID: \"07047c0e-998f-4081-b64e-d285a6d5750a\") " pod="openshift-image-registry/node-ca-xst8k"
Jul 16 09:04:54.700223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697390    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:04:54.700223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697415    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6526b2dd-27b6-4b19-860e-dcb145d1803b-dbus\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:04:54.700223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697438    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-kubelet\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.700223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697465    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-cni-bin\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.700223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697495    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f695655-2301-4d69-a98f-fc51b8aeea13-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.700223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697523    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f8093502-40bf-45df-b7ec-b570acc55353-iptables-alerter-script\") pod \"iptables-alerter-2b2r4\" (UID: \"f8093502-40bf-45df-b7ec-b570acc55353\") " pod="openshift-network-operator/iptables-alerter-2b2r4"
Jul 16 09:04:54.700223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697555    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-var-lib-cni-bin\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.700223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697584    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-var-lib-kubelet\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.700223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.697610    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-socket-dir\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.700223 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:54.697778    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:04:54.700223 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:54.697854    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs podName:a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690 nodeName:}" failed. No retries permitted until 2026-07-16 09:04:55.197832855 +0000 UTC m=+3.021684423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs") pod "network-metrics-daemon-sbf5q" (UID: "a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:04:54.700223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.698410    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f8093502-40bf-45df-b7ec-b570acc55353-iptables-alerter-script\") pod \"iptables-alerter-2b2r4\" (UID: \"f8093502-40bf-45df-b7ec-b570acc55353\") " pod="openshift-network-operator/iptables-alerter-2b2r4"
Jul 16 09:04:54.701042 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.700953    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11454c61-b3ee-4bdb-b069-719a1754d9e4-etc-tuned\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.701042 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.701014    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11454c61-b3ee-4bdb-b069-719a1754d9e4-tmp\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.701233 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.701215    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83250eb6-4c2f-4fc2-8200-f8bb30fa93e6-agent-certs\") pod \"konnectivity-agent-hg7sb\" (UID: \"83250eb6-4c2f-4fc2-8200-f8bb30fa93e6\") " pod="kube-system/konnectivity-agent-hg7sb"
Jul 16 09:04:54.702570 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:54.702523    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 09:04:54.702652 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:54.702574    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 09:04:54.702652 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:54.702585    2556 projected.go:196] Error preparing data for projected volume kube-api-access-qjjzx for pod openshift-network-diagnostics/network-check-target-57v9s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:04:54.702652 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:54.702628    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx podName:c54d6cc3-8d45-401c-8f2b-c52524b80b47 nodeName:}" failed. No retries permitted until 2026-07-16 09:04:55.202614299 +0000 UTC m=+3.026465847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qjjzx" (UniqueName: "kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx") pod "network-check-target-57v9s" (UID: "c54d6cc3-8d45-401c-8f2b-c52524b80b47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:04:54.705111 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.705082    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2slpl\" (UniqueName: \"kubernetes.io/projected/11454c61-b3ee-4bdb-b069-719a1754d9e4-kube-api-access-2slpl\") pod \"tuned-mh56v\" (UID: \"11454c61-b3ee-4bdb-b069-719a1754d9e4\") " pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.705230 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.705214    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwn6l\" (UniqueName: \"kubernetes.io/projected/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-kube-api-access-qwn6l\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:04:54.705326 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.705306    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k4s5\" (UniqueName: \"kubernetes.io/projected/f8093502-40bf-45df-b7ec-b570acc55353-kube-api-access-9k4s5\") pod \"iptables-alerter-2b2r4\" (UID: \"f8093502-40bf-45df-b7ec-b570acc55353\") " pod="openshift-network-operator/iptables-alerter-2b2r4"
Jul 16 09:04:54.707584 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.707560    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9pk9\" (UniqueName: \"kubernetes.io/projected/07047c0e-998f-4081-b64e-d285a6d5750a-kube-api-access-c9pk9\") pod \"node-ca-xst8k\" (UID: \"07047c0e-998f-4081-b64e-d285a6d5750a\") " pod="openshift-image-registry/node-ca-xst8k"
Jul 16 09:04:54.731227 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:54.731195    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164f37f8c5097726cc0dfd83f2773660.slice/crio-444d0fa4a6277738695992fb38a888b1e2d895a70269b4fa105c7c8c0b8130ce WatchSource:0}: Error finding container 444d0fa4a6277738695992fb38a888b1e2d895a70269b4fa105c7c8c0b8130ce: Status 404 returned error can't find the container with id 444d0fa4a6277738695992fb38a888b1e2d895a70269b4fa105c7c8c0b8130ce
Jul 16 09:04:54.736178 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.736158    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:04:54.746744 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:54.746722    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3c0d52a204f48311b3bdc937f9876d.slice/crio-1c53e834dbdb6fc735f7d9e20e3ed558970cb4760c2b53052398ab2f568d2f13 WatchSource:0}: Error finding container 1c53e834dbdb6fc735f7d9e20e3ed558970cb4760c2b53052398ab2f568d2f13: Status 404 returned error can't find the container with id 1c53e834dbdb6fc735f7d9e20e3ed558970cb4760c2b53052398ab2f568d2f13
Jul 16 09:04:54.798685 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.798656    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbn7g\" (UniqueName: \"kubernetes.io/projected/40819698-f872-4fc6-a82d-f81196572c63-kube-api-access-kbn7g\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.798852 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.798686    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ea846f2-1826-41e4-bf80-1c42f1c001c7-cni-binary-copy\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.798852 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.798723    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f695655-2301-4d69-a98f-fc51b8aeea13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.798852 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.798740    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f695655-2301-4d69-a98f-fc51b8aeea13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.799079 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.798877    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-cni-netd\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.799079 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.798909    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f695655-2301-4d69-a98f-fc51b8aeea13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.799079 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.798922    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-run-netns\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.799079 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.798983    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-run-netns\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.799079 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.798992    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-cni-netd\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.799079 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799031    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nrmf\" (UniqueName: \"kubernetes.io/projected/79b61fa9-efeb-494d-8ad3-31962d93f9ef-kube-api-access-9nrmf\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.799079 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799064    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-etc-openvswitch\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799085    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-multus-cni-dir\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799111    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/40819698-f872-4fc6-a82d-f81196572c63-ovnkube-script-lib\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799113    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-etc-openvswitch\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799133    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-os-release\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799199    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-os-release\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799227    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjhwl\" (UniqueName: \"kubernetes.io/projected/2f695655-2301-4d69-a98f-fc51b8aeea13-kube-api-access-mjhwl\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799270    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-systemd-units\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799230    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-multus-cni-dir\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799297    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-run-systemd\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799300    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f695655-2301-4d69-a98f-fc51b8aeea13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799337    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/40819698-f872-4fc6-a82d-f81196572c63-ovnkube-config\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799338    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-systemd-units\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799379    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-system-cni-dir\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799342    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ea846f2-1826-41e4-bf80-1c42f1c001c7-cni-binary-copy\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799392    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-run-systemd\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799430    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-system-cni-dir\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.799481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799467    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4e101a1-6ad1-4a51-9cf2-cc73c46c849a-hosts-file\") pod \"node-resolver-xm6zn\" (UID: \"d4e101a1-6ad1-4a51-9cf2-cc73c46c849a\") " pod="openshift-dns/node-resolver-xm6zn"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799494    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdt4w\" (UniqueName: \"kubernetes.io/projected/d4e101a1-6ad1-4a51-9cf2-cc73c46c849a-kube-api-access-cdt4w\") pod \"node-resolver-xm6zn\" (UID: \"d4e101a1-6ad1-4a51-9cf2-cc73c46c849a\") " pod="openshift-dns/node-resolver-xm6zn"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799513    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-run-openvswitch\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799537    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/40819698-f872-4fc6-a82d-f81196572c63-env-overrides\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799543    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4e101a1-6ad1-4a51-9cf2-cc73c46c849a-hosts-file\") pod \"node-resolver-xm6zn\" (UID: \"d4e101a1-6ad1-4a51-9cf2-cc73c46c849a\") " pod="openshift-dns/node-resolver-xm6zn"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799564    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799569    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-run-openvswitch\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799591    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-run-ovn\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799619    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-log-socket\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799622    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799645    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-multus-socket-dir-parent\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799658    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-run-ovn\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799670    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-log-socket\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799671    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-sys-fs\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799703    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-multus-socket-dir-parent\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799712    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-run-netns\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799720    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-sys-fs\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.800927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799750    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-var-lib-cni-multus\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799775    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-run-netns\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799779    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4e101a1-6ad1-4a51-9cf2-cc73c46c849a-tmp-dir\") pod \"node-resolver-xm6zn\" (UID: \"d4e101a1-6ad1-4a51-9cf2-cc73c46c849a\") " pod="openshift-dns/node-resolver-xm6zn"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799804    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-run-k8s-cni-cncf-io\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799822    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-multus-conf-dir\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799849    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6526b2dd-27b6-4b19-860e-dcb145d1803b-dbus\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799804    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-var-lib-cni-multus\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799871    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-run-k8s-cni-cncf-io\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799874    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-kubelet\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799911    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-cni-bin\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799915    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-kubelet\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799916    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-multus-conf-dir\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799915    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6526b2dd-27b6-4b19-860e-dcb145d1803b-dbus\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799940    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f695655-2301-4d69-a98f-fc51b8aeea13-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799969    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-var-lib-cni-bin\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799972    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-cni-bin\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.799994    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-var-lib-kubelet\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800019    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-socket-dir\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.801470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800038    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-var-lib-cni-bin\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800050    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4e101a1-6ad1-4a51-9cf2-cc73c46c849a-tmp-dir\") pod \"node-resolver-xm6zn\" (UID: \"d4e101a1-6ad1-4a51-9cf2-cc73c46c849a\") " pod="openshift-dns/node-resolver-xm6zn"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800046    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-var-lib-openvswitch\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800084    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-var-lib-kubelet\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800097    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-node-log\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800088    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-var-lib-openvswitch\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800131    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-node-log\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800164    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-cnibin\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800167    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-socket-dir\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800194    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gllf5\" (UniqueName: \"kubernetes.io/projected/7ea846f2-1826-41e4-bf80-1c42f1c001c7-kube-api-access-gllf5\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800203    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-cnibin\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800238    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ea846f2-1826-41e4-bf80-1c42f1c001c7-multus-daemon-config\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800268    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-run-multus-certs\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800293    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f695655-2301-4d69-a98f-fc51b8aeea13-cnibin\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800302    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/40819698-f872-4fc6-a82d-f81196572c63-env-overrides\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800322    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f695655-2301-4d69-a98f-fc51b8aeea13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800292    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/40819698-f872-4fc6-a82d-f81196572c63-ovnkube-script-lib\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800333    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-host-run-multus-certs\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.802011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800352    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800367    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f695655-2301-4d69-a98f-fc51b8aeea13-cnibin\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800373    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/40819698-f872-4fc6-a82d-f81196572c63-ovnkube-config\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800411    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-slash\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800436    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-run-ovn-kubernetes\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800456    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-slash\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800458    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f695655-2301-4d69-a98f-fc51b8aeea13-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800458    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/40819698-f872-4fc6-a82d-f81196572c63-ovn-node-metrics-cert\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800496    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800511    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-hostroot\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800521    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-run-ovn-kubernetes\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800545    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-hostroot\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800555    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f695655-2301-4d69-a98f-fc51b8aeea13-os-release\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800586    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6526b2dd-27b6-4b19-860e-dcb145d1803b-kubelet-config\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800605    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f695655-2301-4d69-a98f-fc51b8aeea13-os-release\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800614    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800654    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.802550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800662    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6526b2dd-27b6-4b19-860e-dcb145d1803b-kubelet-config\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:04:54.803034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800686    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-etc-kubernetes\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.803034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800715    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f695655-2301-4d69-a98f-fc51b8aeea13-system-cni-dir\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.803034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800711    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40819698-f872-4fc6-a82d-f81196572c63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.803034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800745    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-registration-dir\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.803034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800758    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ea846f2-1826-41e4-bf80-1c42f1c001c7-etc-kubernetes\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.803034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800771    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-device-dir\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.803034 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:54.800689    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 09:04:54.803034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800772    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ea846f2-1826-41e4-bf80-1c42f1c001c7-multus-daemon-config\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.803034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800815    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-registration-dir\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.803034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800825    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f695655-2301-4d69-a98f-fc51b8aeea13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.803034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800779    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f695655-2301-4d69-a98f-fc51b8aeea13-system-cni-dir\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.803034 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:54.800846    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret podName:6526b2dd-27b6-4b19-860e-dcb145d1803b nodeName:}" failed. No retries permitted until 2026-07-16 09:04:55.300828646 +0000 UTC m=+3.124680210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret") pod "global-pull-secret-syncer-w6rvh" (UID: "6526b2dd-27b6-4b19-860e-dcb145d1803b") : object "kube-system"/"original-pull-secret" not registered
Jul 16 09:04:54.803034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.800851    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/79b61fa9-efeb-494d-8ad3-31962d93f9ef-device-dir\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.803034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.802541    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/40819698-f872-4fc6-a82d-f81196572c63-ovn-node-metrics-cert\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.812080 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.812053    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nrmf\" (UniqueName: \"kubernetes.io/projected/79b61fa9-efeb-494d-8ad3-31962d93f9ef-kube-api-access-9nrmf\") pod \"aws-ebs-csi-driver-node-9r5xf\" (UID: \"79b61fa9-efeb-494d-8ad3-31962d93f9ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:54.812305 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.812279    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gllf5\" (UniqueName: \"kubernetes.io/projected/7ea846f2-1826-41e4-bf80-1c42f1c001c7-kube-api-access-gllf5\") pod \"multus-9hs7m\" (UID: \"7ea846f2-1826-41e4-bf80-1c42f1c001c7\") " pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.812541 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.812524    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjhwl\" (UniqueName: \"kubernetes.io/projected/2f695655-2301-4d69-a98f-fc51b8aeea13-kube-api-access-mjhwl\") pod \"multus-additional-cni-plugins-lgr75\" (UID: \"2f695655-2301-4d69-a98f-fc51b8aeea13\") " pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:54.813056 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.813035    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbn7g\" (UniqueName: \"kubernetes.io/projected/40819698-f872-4fc6-a82d-f81196572c63-kube-api-access-kbn7g\") pod \"ovnkube-node-llwv9\" (UID: \"40819698-f872-4fc6-a82d-f81196572c63\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:54.813128 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.813076    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdt4w\" (UniqueName: \"kubernetes.io/projected/d4e101a1-6ad1-4a51-9cf2-cc73c46c849a-kube-api-access-cdt4w\") pod \"node-resolver-xm6zn\" (UID: \"d4e101a1-6ad1-4a51-9cf2-cc73c46c849a\") " pod="openshift-dns/node-resolver-xm6zn"
Jul 16 09:04:54.915841 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.915814    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hg7sb"
Jul 16 09:04:54.924192 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.924174    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xm6zn"
Jul 16 09:04:54.925916 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:54.925891    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83250eb6_4c2f_4fc2_8200_f8bb30fa93e6.slice/crio-8822ccbbd528d5640c929f49c52f77fced34104524f65075685460b4261f4c6f WatchSource:0}: Error finding container 8822ccbbd528d5640c929f49c52f77fced34104524f65075685460b4261f4c6f: Status 404 returned error can't find the container with id 8822ccbbd528d5640c929f49c52f77fced34104524f65075685460b4261f4c6f
Jul 16 09:04:54.932629 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:54.932582    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e101a1_6ad1_4a51_9cf2_cc73c46c849a.slice/crio-e6e6e7e929bfc54c4ea5b5fdc303100bb322108df8f87aca2a1608cdfaabd01a WatchSource:0}: Error finding container e6e6e7e929bfc54c4ea5b5fdc303100bb322108df8f87aca2a1608cdfaabd01a: Status 404 returned error can't find the container with id e6e6e7e929bfc54c4ea5b5fdc303100bb322108df8f87aca2a1608cdfaabd01a
Jul 16 09:04:54.941336 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.941319    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mh56v"
Jul 16 09:04:54.950688 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:54.950670    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11454c61_b3ee_4bdb_b069_719a1754d9e4.slice/crio-b6c8408952c2a48357f7e7e612e6d269adaf1c9c1ce841cf91454a7816aa801c WatchSource:0}: Error finding container b6c8408952c2a48357f7e7e612e6d269adaf1c9c1ce841cf91454a7816aa801c: Status 404 returned error can't find the container with id b6c8408952c2a48357f7e7e612e6d269adaf1c9c1ce841cf91454a7816aa801c
Jul 16 09:04:54.954645 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.954629    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xst8k"
Jul 16 09:04:54.963091 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:54.963071    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07047c0e_998f_4081_b64e_d285a6d5750a.slice/crio-9ef4c3c31bfdfa7cb05198851101bd27d7e9a01e67bd199f3086edbfec857413 WatchSource:0}: Error finding container 9ef4c3c31bfdfa7cb05198851101bd27d7e9a01e67bd199f3086edbfec857413: Status 404 returned error can't find the container with id 9ef4c3c31bfdfa7cb05198851101bd27d7e9a01e67bd199f3086edbfec857413
Jul 16 09:04:54.968166 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.968151    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 09:04:54.971127 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.971109    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2b2r4"
Jul 16 09:04:54.979945 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:54.979927    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8093502_40bf_45df_b7ec_b570acc55353.slice/crio-594357f2faea721cac5e1f94bf108d36d6340961f3562af63bb5b869dc451d79 WatchSource:0}: Error finding container 594357f2faea721cac5e1f94bf108d36d6340961f3562af63bb5b869dc451d79: Status 404 returned error can't find the container with id 594357f2faea721cac5e1f94bf108d36d6340961f3562af63bb5b869dc451d79
Jul 16 09:04:54.984070 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:54.984054    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9hs7m"
Jul 16 09:04:54.992079 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:54.992060    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea846f2_1826_41e4_bf80_1c42f1c001c7.slice/crio-58ac7aa67be354e63baf74a01c7ce1d8c3193cc86ba3018311b1957e6505b5dc WatchSource:0}: Error finding container 58ac7aa67be354e63baf74a01c7ce1d8c3193cc86ba3018311b1957e6505b5dc: Status 404 returned error can't find the container with id 58ac7aa67be354e63baf74a01c7ce1d8c3193cc86ba3018311b1957e6505b5dc
Jul 16 09:04:55.001506 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.001489    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lgr75"
Jul 16 09:04:55.009763 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:55.009742    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f695655_2301_4d69_a98f_fc51b8aeea13.slice/crio-53e88c0680631e47ef1e6d0fda018b9a57a2960dac3505ab0d4672829cfb92e8 WatchSource:0}: Error finding container 53e88c0680631e47ef1e6d0fda018b9a57a2960dac3505ab0d4672829cfb92e8: Status 404 returned error can't find the container with id 53e88c0680631e47ef1e6d0fda018b9a57a2960dac3505ab0d4672829cfb92e8
Jul 16 09:04:55.024850 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.024814    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf"
Jul 16 09:04:55.027817 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.027655    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:04:55.036010 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:55.034942    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b61fa9_efeb_494d_8ad3_31962d93f9ef.slice/crio-2c635125612dfb1716851605cc3c1ac3dc1b54bf3e7aa1a9003baf0a43fdc82b WatchSource:0}: Error finding container 2c635125612dfb1716851605cc3c1ac3dc1b54bf3e7aa1a9003baf0a43fdc82b: Status 404 returned error can't find the container with id 2c635125612dfb1716851605cc3c1ac3dc1b54bf3e7aa1a9003baf0a43fdc82b
Jul 16 09:04:55.038160 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:04:55.038133    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40819698_f872_4fc6_a82d_f81196572c63.slice/crio-cc8db8ba616d61182e307963286b2438373271539a15b532ebbf3dff762f17a9 WatchSource:0}: Error finding container cc8db8ba616d61182e307963286b2438373271539a15b532ebbf3dff762f17a9: Status 404 returned error can't find the container with id cc8db8ba616d61182e307963286b2438373271539a15b532ebbf3dff762f17a9
Jul 16 09:04:55.204507 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.204427    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:04:55.204507 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.204467    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjzx\" (UniqueName: \"kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx\") pod \"network-check-target-57v9s\" (UID: \"c54d6cc3-8d45-401c-8f2b-c52524b80b47\") " pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:04:55.204676 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:55.204577    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:04:55.204676 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:55.204586    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 09:04:55.204676 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:55.204600    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 09:04:55.204676 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:55.204610    2556 projected.go:196] Error preparing data for projected volume kube-api-access-qjjzx for pod openshift-network-diagnostics/network-check-target-57v9s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:04:55.204676 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:55.204637    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs podName:a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690 nodeName:}" failed. No retries permitted until 2026-07-16 09:04:56.204620907 +0000 UTC m=+4.028472457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs") pod "network-metrics-daemon-sbf5q" (UID: "a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:04:55.204676 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:55.204653    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx podName:c54d6cc3-8d45-401c-8f2b-c52524b80b47 nodeName:}" failed. No retries permitted until 2026-07-16 09:04:56.204646323 +0000 UTC m=+4.028497872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjjzx" (UniqueName: "kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx") pod "network-check-target-57v9s" (UID: "c54d6cc3-8d45-401c-8f2b-c52524b80b47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:04:55.305693 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.305661    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:04:55.305867 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:55.305834    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 09:04:55.305936 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:55.305907    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret podName:6526b2dd-27b6-4b19-860e-dcb145d1803b nodeName:}" failed. No retries permitted until 2026-07-16 09:04:56.305886365 +0000 UTC m=+4.129737929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret") pod "global-pull-secret-syncer-w6rvh" (UID: "6526b2dd-27b6-4b19-860e-dcb145d1803b") : object "kube-system"/"original-pull-secret" not registered
Jul 16 09:04:55.640522 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.640389    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 08:59:55 +0000 UTC" deadline="2028-01-06 12:32:43.988914792 +0000 UTC"
Jul 16 09:04:55.640522 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.640471    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12939h27m48.348474762s"
Jul 16 09:04:55.712617 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.712588    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:04:55.712803 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:55.712732    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:04:55.731761 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.731700    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2b2r4" event={"ID":"f8093502-40bf-45df-b7ec-b570acc55353","Type":"ContainerStarted","Data":"594357f2faea721cac5e1f94bf108d36d6340961f3562af63bb5b869dc451d79"}
Jul 16 09:04:55.742824 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.742735    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xst8k" event={"ID":"07047c0e-998f-4081-b64e-d285a6d5750a","Type":"ContainerStarted","Data":"9ef4c3c31bfdfa7cb05198851101bd27d7e9a01e67bd199f3086edbfec857413"}
Jul 16 09:04:55.751298 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.751267    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xm6zn" event={"ID":"d4e101a1-6ad1-4a51-9cf2-cc73c46c849a","Type":"ContainerStarted","Data":"e6e6e7e929bfc54c4ea5b5fdc303100bb322108df8f87aca2a1608cdfaabd01a"}
Jul 16 09:04:55.768092 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.768047    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal" event={"ID":"4b3c0d52a204f48311b3bdc937f9876d","Type":"ContainerStarted","Data":"1c53e834dbdb6fc735f7d9e20e3ed558970cb4760c2b53052398ab2f568d2f13"}
Jul 16 09:04:55.781683 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.781655    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9" event={"ID":"40819698-f872-4fc6-a82d-f81196572c63","Type":"ContainerStarted","Data":"cc8db8ba616d61182e307963286b2438373271539a15b532ebbf3dff762f17a9"}
Jul 16 09:04:55.793546 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.793518    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf" event={"ID":"79b61fa9-efeb-494d-8ad3-31962d93f9ef","Type":"ContainerStarted","Data":"2c635125612dfb1716851605cc3c1ac3dc1b54bf3e7aa1a9003baf0a43fdc82b"}
Jul 16 09:04:55.803408 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.803380    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9hs7m" event={"ID":"7ea846f2-1826-41e4-bf80-1c42f1c001c7","Type":"ContainerStarted","Data":"58ac7aa67be354e63baf74a01c7ce1d8c3193cc86ba3018311b1957e6505b5dc"}
Jul 16 09:04:55.813767 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.813656    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mh56v" event={"ID":"11454c61-b3ee-4bdb-b069-719a1754d9e4","Type":"ContainerStarted","Data":"b6c8408952c2a48357f7e7e612e6d269adaf1c9c1ce841cf91454a7816aa801c"}
Jul 16 09:04:55.826998 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.826910    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hg7sb" event={"ID":"83250eb6-4c2f-4fc2-8200-f8bb30fa93e6","Type":"ContainerStarted","Data":"8822ccbbd528d5640c929f49c52f77fced34104524f65075685460b4261f4c6f"}
Jul 16 09:04:55.834514 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.834490    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-231.ec2.internal" event={"ID":"164f37f8c5097726cc0dfd83f2773660","Type":"ContainerStarted","Data":"444d0fa4a6277738695992fb38a888b1e2d895a70269b4fa105c7c8c0b8130ce"}
Jul 16 09:04:55.842935 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.842908    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgr75" event={"ID":"2f695655-2301-4d69-a98f-fc51b8aeea13","Type":"ContainerStarted","Data":"53e88c0680631e47ef1e6d0fda018b9a57a2960dac3505ab0d4672829cfb92e8"}
Jul 16 09:04:55.968695 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:55.968607    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 09:04:56.212707 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:56.212676    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:04:56.212877 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:56.212734    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjzx\" (UniqueName: \"kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx\") pod \"network-check-target-57v9s\" (UID: \"c54d6cc3-8d45-401c-8f2b-c52524b80b47\") " pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:04:56.212954 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:56.212899    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 09:04:56.212954 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:56.212922    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 09:04:56.212954 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:56.212936    2556 projected.go:196] Error preparing data for projected volume kube-api-access-qjjzx for pod openshift-network-diagnostics/network-check-target-57v9s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:04:56.213113 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:56.212992    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx podName:c54d6cc3-8d45-401c-8f2b-c52524b80b47 nodeName:}" failed. No retries permitted until 2026-07-16 09:04:58.212974095 +0000 UTC m=+6.036825650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjjzx" (UniqueName: "kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx") pod "network-check-target-57v9s" (UID: "c54d6cc3-8d45-401c-8f2b-c52524b80b47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:04:56.213236 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:56.213213    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:04:56.213306 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:56.213287    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs podName:a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690 nodeName:}" failed. No retries permitted until 2026-07-16 09:04:58.213266207 +0000 UTC m=+6.037117774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs") pod "network-metrics-daemon-sbf5q" (UID: "a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:04:56.313402 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:56.313309    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:04:56.313592 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:56.313506    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 09:04:56.313592 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:56.313578    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret podName:6526b2dd-27b6-4b19-860e-dcb145d1803b nodeName:}" failed. No retries permitted until 2026-07-16 09:04:58.313559554 +0000 UTC m=+6.137411106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret") pod "global-pull-secret-syncer-w6rvh" (UID: "6526b2dd-27b6-4b19-860e-dcb145d1803b") : object "kube-system"/"original-pull-secret" not registered
Jul 16 09:04:56.641265 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:56.641145    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 08:59:55 +0000 UTC" deadline="2027-12-18 11:26:03.768330391 +0000 UTC"
Jul 16 09:04:56.641265 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:56.641214    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12482h21m7.127121045s"
Jul 16 09:04:56.713820 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:56.713557    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:04:56.713820 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:56.713568    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:04:56.713820 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:56.713691    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:04:56.713820 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:56.713807    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:04:57.712466 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:57.712377    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:04:57.712940 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:57.712534    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:04:58.229531 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:58.228701    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjzx\" (UniqueName: \"kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx\") pod \"network-check-target-57v9s\" (UID: \"c54d6cc3-8d45-401c-8f2b-c52524b80b47\") " pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:04:58.229531 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:58.228798    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:04:58.229531 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:58.228954    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:04:58.229531 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:58.229036    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs podName:a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:02.229016358 +0000 UTC m=+10.052867912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs") pod "network-metrics-daemon-sbf5q" (UID: "a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:04:58.229531 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:58.229417    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 09:04:58.229531 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:58.229455    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 09:04:58.229531 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:58.229470    2556 projected.go:196] Error preparing data for projected volume kube-api-access-qjjzx for pod openshift-network-diagnostics/network-check-target-57v9s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:04:58.229531 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:58.229513    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx podName:c54d6cc3-8d45-401c-8f2b-c52524b80b47 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:02.229501105 +0000 UTC m=+10.053352654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjjzx" (UniqueName: "kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx") pod "network-check-target-57v9s" (UID: "c54d6cc3-8d45-401c-8f2b-c52524b80b47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:04:58.329723 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:58.329685    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:04:58.329937 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:58.329869    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 09:04:58.329937 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:58.329931    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret podName:6526b2dd-27b6-4b19-860e-dcb145d1803b nodeName:}" failed. No retries permitted until 2026-07-16 09:05:02.329911446 +0000 UTC m=+10.153762998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret") pod "global-pull-secret-syncer-w6rvh" (UID: "6526b2dd-27b6-4b19-860e-dcb145d1803b") : object "kube-system"/"original-pull-secret" not registered
Jul 16 09:04:58.712892 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:58.712229    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:04:58.712892 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:58.712386    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:04:58.712892 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:58.712613    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:04:58.712892 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:58.712711    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:04:59.712324 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:04:59.712295    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:04:59.712525 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:04:59.712462    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:00.714213 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:00.714180    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:00.714751 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:00.714326    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:00.714751 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:00.714742    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:00.714891 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:00.714846    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:01.713449 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:01.712716    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:01.713449 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:01.712902    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:02.269237 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:02.269185    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:02.269785 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:02.269250    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjzx\" (UniqueName: \"kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx\") pod \"network-check-target-57v9s\" (UID: \"c54d6cc3-8d45-401c-8f2b-c52524b80b47\") " pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:02.269785 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:02.269399    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:02.269785 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:02.269414    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 09:05:02.269785 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:02.269475    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 09:05:02.269785 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:02.269485    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs podName:a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:10.269461884 +0000 UTC m=+18.093313432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs") pod "network-metrics-daemon-sbf5q" (UID: "a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:02.269785 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:02.269492    2556 projected.go:196] Error preparing data for projected volume kube-api-access-qjjzx for pod openshift-network-diagnostics/network-check-target-57v9s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:02.269785 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:02.269548    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx podName:c54d6cc3-8d45-401c-8f2b-c52524b80b47 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:10.269531982 +0000 UTC m=+18.093383546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjjzx" (UniqueName: "kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx") pod "network-check-target-57v9s" (UID: "c54d6cc3-8d45-401c-8f2b-c52524b80b47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:02.369803 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:02.369767    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:02.369989 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:02.369941    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:02.370092 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:02.370016    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret podName:6526b2dd-27b6-4b19-860e-dcb145d1803b nodeName:}" failed. No retries permitted until 2026-07-16 09:05:10.369997144 +0000 UTC m=+18.193848718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret") pod "global-pull-secret-syncer-w6rvh" (UID: "6526b2dd-27b6-4b19-860e-dcb145d1803b") : object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:02.712889 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:02.712806    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:02.713226 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:02.713195    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:02.713943 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:02.713920    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:02.714050 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:02.714000    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:03.712436 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:03.712401    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:03.712943 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:03.712527    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:04.713981 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:04.713562    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:04.713981 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:04.713726    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:04.713981 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:04.713859    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:04.713981 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:04.713721    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:05.712177 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:05.711977    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:05.712372 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:05.712291    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:06.712904 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:06.712863    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:06.713328 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:06.713016    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:06.713328 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:06.713062    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:06.713328 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:06.713175    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:07.712082 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:07.712054    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:07.712218 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:07.712164    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:08.712444 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:08.712410    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:08.712900 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:08.712542    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:08.712900 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:08.712614    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:08.712900 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:08.712719    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:09.712457 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:09.712424    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:09.712842 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:09.712531    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:10.337277 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:10.337244    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:10.337479 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:10.337300    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjzx\" (UniqueName: \"kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx\") pod \"network-check-target-57v9s\" (UID: \"c54d6cc3-8d45-401c-8f2b-c52524b80b47\") " pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:10.337479 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:10.337445    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:10.337576 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:10.337489    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 09:05:10.337576 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:10.337507    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 09:05:10.337576 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:10.337509    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs podName:a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:26.337493218 +0000 UTC m=+34.161344777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs") pod "network-metrics-daemon-sbf5q" (UID: "a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:10.337576 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:10.337520    2556 projected.go:196] Error preparing data for projected volume kube-api-access-qjjzx for pod openshift-network-diagnostics/network-check-target-57v9s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:10.337576 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:10.337573    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx podName:c54d6cc3-8d45-401c-8f2b-c52524b80b47 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:26.337558707 +0000 UTC m=+34.161410259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjjzx" (UniqueName: "kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx") pod "network-check-target-57v9s" (UID: "c54d6cc3-8d45-401c-8f2b-c52524b80b47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:10.437981 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:10.437945    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:10.438151 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:10.438078    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:10.438151 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:10.438132    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret podName:6526b2dd-27b6-4b19-860e-dcb145d1803b nodeName:}" failed. No retries permitted until 2026-07-16 09:05:26.438117229 +0000 UTC m=+34.261968776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret") pod "global-pull-secret-syncer-w6rvh" (UID: "6526b2dd-27b6-4b19-860e-dcb145d1803b") : object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:10.712388 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:10.712337    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:10.712575 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:10.712497    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:10.712575 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:10.712548    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:10.712968 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:10.712655    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:11.712665 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:11.712624    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:11.713106 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:11.712759    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:12.712767 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:12.712736    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:12.713209 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:12.712856    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:12.713209 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:12.712864    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:12.713209 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:12.712953    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:13.712403 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:13.712364    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:13.712550 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:13.712496    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:14.712094 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:14.712066    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:14.712556 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:14.712073    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:14.712556 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:14.712213    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:14.712556 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:14.712268    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:15.712533 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:15.712505    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:15.712911 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:15.712605    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:16.712749 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.712580    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:16.713397 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.712638    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:16.713397 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:16.712830    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:16.713397 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:16.712930    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:16.893033 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.892916    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xst8k" event={"ID":"07047c0e-998f-4081-b64e-d285a6d5750a","Type":"ContainerStarted","Data":"53773b539f9e887c9a31ec4cf0fa3382defef254c887577dd72bfa355680c590"}
Jul 16 09:05:16.894632 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.894602    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xm6zn" event={"ID":"d4e101a1-6ad1-4a51-9cf2-cc73c46c849a","Type":"ContainerStarted","Data":"b9df6d816f7b6d582844288086e4ed7e050478b51700cceed0087ee6c541a1a7"}
Jul 16 09:05:16.896315 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.896288    2556 generic.go:356] "Generic (PLEG): container finished" podID="4b3c0d52a204f48311b3bdc937f9876d" containerID="957df733e6af2b53d52c29d3c6b6da24147ced7288b6d3969e7838beea76feea" exitCode=0
Jul 16 09:05:16.896518 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.896376    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal" event={"ID":"4b3c0d52a204f48311b3bdc937f9876d","Type":"ContainerDied","Data":"957df733e6af2b53d52c29d3c6b6da24147ced7288b6d3969e7838beea76feea"}
Jul 16 09:05:16.899607 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.899588    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:05:16.899946 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.899914    2556 generic.go:356] "Generic (PLEG): container finished" podID="40819698-f872-4fc6-a82d-f81196572c63" containerID="144aebfd3b93d0c64ceb40f48cea4b4797177c9223fe45e9fa934270d906ffc0" exitCode=1
Jul 16 09:05:16.900048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.899970    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9" event={"ID":"40819698-f872-4fc6-a82d-f81196572c63","Type":"ContainerStarted","Data":"b242b5777f094f8d795926e029792059f31b4336cccc54123f1246af7a328c7d"}
Jul 16 09:05:16.900048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.900029    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9" event={"ID":"40819698-f872-4fc6-a82d-f81196572c63","Type":"ContainerStarted","Data":"1378db971f8ba645bd95419070d81eba2172151a5a5caf82469b26b7f7d051d4"}
Jul 16 09:05:16.900158 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.900060    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9" event={"ID":"40819698-f872-4fc6-a82d-f81196572c63","Type":"ContainerStarted","Data":"82be006807bfd90f9791a56bc33def6de080831422c9b38aa4a48d2132f9a80f"}
Jul 16 09:05:16.900158 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.900088    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9" event={"ID":"40819698-f872-4fc6-a82d-f81196572c63","Type":"ContainerStarted","Data":"f41b1c7c32010cea827d5460ebaa82c3f132a03631100b5c9122ab9862e56eea"}
Jul 16 09:05:16.900158 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.900124    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9" event={"ID":"40819698-f872-4fc6-a82d-f81196572c63","Type":"ContainerDied","Data":"144aebfd3b93d0c64ceb40f48cea4b4797177c9223fe45e9fa934270d906ffc0"}
Jul 16 09:05:16.900158 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.900153    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9" event={"ID":"40819698-f872-4fc6-a82d-f81196572c63","Type":"ContainerStarted","Data":"89adcbd3c4cd86017556e37091191376386ddfef838759df3b951b4b047105a1"}
Jul 16 09:05:16.901767 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.901743    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf" event={"ID":"79b61fa9-efeb-494d-8ad3-31962d93f9ef","Type":"ContainerStarted","Data":"6a9af515aa4ef628c8418ba5f6c4d540b9495862c0851940c0f3b05def0dace9"}
Jul 16 09:05:16.903383 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.903359    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9hs7m" event={"ID":"7ea846f2-1826-41e4-bf80-1c42f1c001c7","Type":"ContainerStarted","Data":"f8cfe5583811de525d58e6ccf0678cd7ca98e4978e30999b7ce524a80da5d4c2"}
Jul 16 09:05:16.904996 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.904970    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mh56v" event={"ID":"11454c61-b3ee-4bdb-b069-719a1754d9e4","Type":"ContainerStarted","Data":"1b97fec76a38549dc121ea0db320a394609c3831d9ab632fab9b98e9e0092af9"}
Jul 16 09:05:16.906503 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.906484    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hg7sb" event={"ID":"83250eb6-4c2f-4fc2-8200-f8bb30fa93e6","Type":"ContainerStarted","Data":"3ae1a663dc3f62cb24e6cc47645c6ec76bf93a89e2e7a4b09cac4e5a52e51eda"}
Jul 16 09:05:16.908113 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.908088    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-231.ec2.internal" event={"ID":"164f37f8c5097726cc0dfd83f2773660","Type":"ContainerStarted","Data":"5ff5b64ed589e9927173aeb9e193ecdd5b7834b269a53077e4b7d9dd32d0a06d"}
Jul 16 09:05:16.909640 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.909616    2556 generic.go:356] "Generic (PLEG): container finished" podID="2f695655-2301-4d69-a98f-fc51b8aeea13" containerID="c923f6572ae1d0d84a32c856e526ba1778355647c1df86494e2c04b4fd82bc64" exitCode=0
Jul 16 09:05:16.909737 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.909649    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgr75" event={"ID":"2f695655-2301-4d69-a98f-fc51b8aeea13","Type":"ContainerDied","Data":"c923f6572ae1d0d84a32c856e526ba1778355647c1df86494e2c04b4fd82bc64"}
Jul 16 09:05:16.920956 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.920908    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xst8k" podStartSLOduration=2.913366731 podStartE2EDuration="23.92089154s" totalImagesPullingTime="21.007524809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:16.907234625 +0000 UTC m=+24.731086206" watchObservedRunningTime="2026-07-16 09:05:16.92089154 +0000 UTC m=+24.744743110"
Jul 16 09:05:16.937587 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.937540    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hg7sb" podStartSLOduration=6.979860847 podStartE2EDuration="23.93752288s" totalImagesPullingTime="16.957662033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:16.937163239 +0000 UTC m=+24.761014845" watchObservedRunningTime="2026-07-16 09:05:16.93752288 +0000 UTC m=+24.761374451"
Jul 16 09:05:16.937710 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.937642    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xm6zn" podStartSLOduration=1.896172156 podStartE2EDuration="22.937633302s" totalImagesPullingTime="21.041461146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:04:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:16.920486207 +0000 UTC m=+24.744337776" watchObservedRunningTime="2026-07-16 09:05:16.937633302 +0000 UTC m=+24.761484873"
Jul 16 09:05:16.956523 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.956446    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mh56v" podStartSLOduration=2.933786894 podStartE2EDuration="23.956429819s" totalImagesPullingTime="21.022642925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:16.956384995 +0000 UTC m=+24.780236565" watchObservedRunningTime="2026-07-16 09:05:16.956429819 +0000 UTC m=+24.780281388"
Jul 16 09:05:16.974255 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:16.974213    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9hs7m" podStartSLOduration=2.943473544 podStartE2EDuration="23.974198784s" totalImagesPullingTime="21.03072524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:16.974173327 +0000 UTC m=+24.798024901" watchObservedRunningTime="2026-07-16 09:05:16.974198784 +0000 UTC m=+24.798050350"
Jul 16 09:05:17.050041 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:17.049999    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-231.ec2.internal" podStartSLOduration=23.0499858 podStartE2EDuration="23.0499858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:17.049641758 +0000 UTC m=+24.873493327" watchObservedRunningTime="2026-07-16 09:05:17.0499858 +0000 UTC m=+24.873837368"
Jul 16 09:05:17.712323 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:17.712295    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:17.712480 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:17.712456    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:17.797714 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:17.797692    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 09:05:17.913854 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:17.913770    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf" event={"ID":"79b61fa9-efeb-494d-8ad3-31962d93f9ef","Type":"ContainerStarted","Data":"1d9a6cc918dbc33e257b2b474c109c21aebe2b546f50d0fe6104d2e4520fd637"}
Jul 16 09:05:17.915418 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:17.915381    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2b2r4" event={"ID":"f8093502-40bf-45df-b7ec-b570acc55353","Type":"ContainerStarted","Data":"64068abdc5dfd43106b25eb7256116c5aff86ed5a5f32eb52d86fcd2592ab4f8"}
Jul 16 09:05:17.917813 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:17.917788    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal" event={"ID":"4b3c0d52a204f48311b3bdc937f9876d","Type":"ContainerStarted","Data":"48e956b4b2ca09eda5cb23b0359dd7ccbfa7525ca4fc0756f421861fc3d7506c"}
Jul 16 09:05:17.930986 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:17.930940    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2b2r4" podStartSLOduration=8.027111607 podStartE2EDuration="24.930923153s" totalImagesPullingTime="16.903811546s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:17.930150509 +0000 UTC m=+25.754002078" watchObservedRunningTime="2026-07-16 09:05:17.930923153 +0000 UTC m=+25.754774724"
Jul 16 09:05:17.944319 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:17.944271    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-231.ec2.internal" podStartSLOduration=23.944255001 podStartE2EDuration="23.944255001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:17.94361194 +0000 UTC m=+25.767463509" watchObservedRunningTime="2026-07-16 09:05:17.944255001 +0000 UTC m=+25.768106571"
Jul 16 09:05:18.702927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:18.702824    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T09:05:17.797711087Z","UUID":"804b7531-4ad0-445c-9715-29e669126fd8","Handler":null,"Name":"","Endpoint":""}
Jul 16 09:05:18.704466 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:18.704442    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 09:05:18.704630 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:18.704486    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 09:05:18.715703 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:18.715678    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:18.715824 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:18.715678    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:18.715824 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:18.715794    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:18.715941 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:18.715888    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:18.924511 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:18.924485    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:05:18.925049 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:18.925023    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9" event={"ID":"40819698-f872-4fc6-a82d-f81196572c63","Type":"ContainerStarted","Data":"9dbf3101d8eae19d5659e2ed35af424fe7203a978f46e54f49d9ee213906ca81"}
Jul 16 09:05:19.400773 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:19.400688    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hg7sb"
Jul 16 09:05:19.401335 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:19.401318    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hg7sb"
Jul 16 09:05:19.712269 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:19.712238    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:19.712428 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:19.712387    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:19.929497 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:19.929459    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf" event={"ID":"79b61fa9-efeb-494d-8ad3-31962d93f9ef","Type":"ContainerStarted","Data":"ad1a5118eadfabf9f0a67e9e084a48aed283916d7bb262ee01a6510e23fbb708"}
Jul 16 09:05:19.947076 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:19.947030    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r5xf" podStartSLOduration=7.554891164 podStartE2EDuration="26.94701775s" totalImagesPullingTime="19.392126586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:04:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:19.946757347 +0000 UTC m=+27.770608935" watchObservedRunningTime="2026-07-16 09:05:19.94701775 +0000 UTC m=+27.770869323"
Jul 16 09:05:20.712759 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:20.712417    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:20.712759 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:20.712536    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:20.712759 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:20.712599    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:20.712759 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:20.712701    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:21.180975 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:21.180953    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hg7sb"
Jul 16 09:05:21.181367 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:21.181077    2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 16 09:05:21.181427 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:21.181390    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hg7sb"
Jul 16 09:05:21.712984 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:21.712774    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:21.713115 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:21.713017    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:21.936762 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:21.936737    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:05:21.937107 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:21.937074    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9" event={"ID":"40819698-f872-4fc6-a82d-f81196572c63","Type":"ContainerStarted","Data":"f8c7bdd73ec45b9bf07876f48bf06eab4333ab4f45783ded307222d2528d7ec6"}
Jul 16 09:05:21.937341 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:21.937313    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:05:21.937518 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:21.937501    2556 scope.go:117] "RemoveContainer" containerID="144aebfd3b93d0c64ceb40f48cea4b4797177c9223fe45e9fa934270d906ffc0"
Jul 16 09:05:21.939011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:21.938978    2556 generic.go:356] "Generic (PLEG): container finished" podID="2f695655-2301-4d69-a98f-fc51b8aeea13" containerID="15dcd3fabd47c1fe7bfe92f90e8c135af74b65355e7c3eb85aa0b247dfce5513" exitCode=0
Jul 16 09:05:21.939079 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:21.939035    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgr75" event={"ID":"2f695655-2301-4d69-a98f-fc51b8aeea13","Type":"ContainerDied","Data":"15dcd3fabd47c1fe7bfe92f90e8c135af74b65355e7c3eb85aa0b247dfce5513"}
Jul 16 09:05:21.953828 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:21.953813    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:05:22.712703 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:22.712673    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:22.713375 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:22.712726    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:22.713375 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:22.712852    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:22.713375 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:22.712970    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:22.946724 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:22.946690    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:05:22.947142 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:22.947111    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9" event={"ID":"40819698-f872-4fc6-a82d-f81196572c63","Type":"ContainerStarted","Data":"94b22a0be494b451371ef96b6d18f13fcb750213c3c17aef2c0416d8686cc3c5"}
Jul 16 09:05:22.947363 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:22.947323    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:05:22.947495 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:22.947426    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:05:22.962856 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:22.962805    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:05:22.975570 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:22.975526    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9" podStartSLOduration=7.974183677 podStartE2EDuration="28.975511133s" totalImagesPullingTime="21.001327456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:04:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:22.974339472 +0000 UTC m=+30.798191060" watchObservedRunningTime="2026-07-16 09:05:22.975511133 +0000 UTC m=+30.799362702"
Jul 16 09:05:23.171846 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:23.171815    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w6rvh"]
Jul 16 09:05:23.171995 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:23.171937    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:23.172035 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:23.172010    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:23.175096 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:23.175074    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sbf5q"]
Jul 16 09:05:23.175234 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:23.175196    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:23.175300 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:23.175286    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:23.175897 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:23.175871    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-57v9s"]
Jul 16 09:05:23.176015 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:23.175971    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:23.176078 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:23.176058    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:23.950758 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:23.950721    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgr75" event={"ID":"2f695655-2301-4d69-a98f-fc51b8aeea13","Type":"ContainerStarted","Data":"6864ad7c5d91f0970d9716be5da2aec717e889143353089d93f39a79df0dda51"}
Jul 16 09:05:24.712364 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:24.712330    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:24.712514 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:24.712375    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:24.712514 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:24.712466    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:24.712609 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:24.712523    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:24.712648 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:24.712626    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:24.712749 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:24.712730    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:24.954830 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:24.954796    2556 generic.go:356] "Generic (PLEG): container finished" podID="2f695655-2301-4d69-a98f-fc51b8aeea13" containerID="6864ad7c5d91f0970d9716be5da2aec717e889143353089d93f39a79df0dda51" exitCode=0
Jul 16 09:05:24.955185 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:24.954879    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgr75" event={"ID":"2f695655-2301-4d69-a98f-fc51b8aeea13","Type":"ContainerDied","Data":"6864ad7c5d91f0970d9716be5da2aec717e889143353089d93f39a79df0dda51"}
Jul 16 09:05:25.959272 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:25.959090    2556 generic.go:356] "Generic (PLEG): container finished" podID="2f695655-2301-4d69-a98f-fc51b8aeea13" containerID="62ef485287b734bc5767babc8c86cbbef101047b288e4e52e47ceb7ee8ae060e" exitCode=0
Jul 16 09:05:25.959830 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:25.959150    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgr75" event={"ID":"2f695655-2301-4d69-a98f-fc51b8aeea13","Type":"ContainerDied","Data":"62ef485287b734bc5767babc8c86cbbef101047b288e4e52e47ceb7ee8ae060e"}
Jul 16 09:05:26.357488 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:26.357414    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:26.357488 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:26.357455    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjzx\" (UniqueName: \"kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx\") pod \"network-check-target-57v9s\" (UID: \"c54d6cc3-8d45-401c-8f2b-c52524b80b47\") " pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:26.357652 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:26.357558    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:26.357652 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:26.357618    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs podName:a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:58.357602249 +0000 UTC m=+66.181453799 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs") pod "network-metrics-daemon-sbf5q" (UID: "a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:26.357652 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:26.357563    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 09:05:26.357765 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:26.357664    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 09:05:26.357765 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:26.357673    2556 projected.go:196] Error preparing data for projected volume kube-api-access-qjjzx for pod openshift-network-diagnostics/network-check-target-57v9s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:26.357765 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:26.357713    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx podName:c54d6cc3-8d45-401c-8f2b-c52524b80b47 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:58.357703624 +0000 UTC m=+66.181555170 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjjzx" (UniqueName: "kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx") pod "network-check-target-57v9s" (UID: "c54d6cc3-8d45-401c-8f2b-c52524b80b47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:26.457997 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:26.457967    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:26.458174 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:26.458135    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:26.458242 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:26.458227    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret podName:6526b2dd-27b6-4b19-860e-dcb145d1803b nodeName:}" failed. No retries permitted until 2026-07-16 09:05:58.458206123 +0000 UTC m=+66.282057694 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret") pod "global-pull-secret-syncer-w6rvh" (UID: "6526b2dd-27b6-4b19-860e-dcb145d1803b") : object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:26.712688 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:26.712645    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:26.712910 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:26.712761    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:26.712910 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:26.712782    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:26.712910 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:26.712645    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:26.712910 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:26.712875    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:26.713064 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:26.712940    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:28.711959 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:28.711922    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:28.712621 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:28.711933    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:28.712621 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:28.712059    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:05:28.712621 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:28.711933    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:28.712621 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:28.712151    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57v9s" podUID="c54d6cc3-8d45-401c-8f2b-c52524b80b47"
Jul 16 09:05:28.712621 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:28.712251    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w6rvh" podUID="6526b2dd-27b6-4b19-860e-dcb145d1803b"
Jul 16 09:05:29.001019 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.000988    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-231.ec2.internal" event="NodeReady"
Jul 16 09:05:29.001197 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.001137    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 09:05:29.041473 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.041442    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cdf5748c-ndjml"]
Jul 16 09:05:29.043938 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.043911    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.046548 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.046524    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 09:05:29.048517 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.047100    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 09:05:29.048517 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.047024    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 09:05:29.050872 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.050851    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8dsdg\""
Jul 16 09:05:29.053419 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.053398    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 09:05:29.054026 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.054007    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cngmn"]
Jul 16 09:05:29.055560 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.055543    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:29.057942 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.057925    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 09:05:29.058028 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.058007    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 09:05:29.058098 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.058033    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xmnzs\""
Jul 16 09:05:29.063159 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.063140    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cdf5748c-ndjml"]
Jul 16 09:05:29.063907 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.063886    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r4nxb"]
Jul 16 09:05:29.065307 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.065290    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r4nxb"
Jul 16 09:05:29.067600 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.067579    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 09:05:29.067724 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.067704    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 09:05:29.068210 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.068189    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cngmn"]
Jul 16 09:05:29.068279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.068227    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q4lck\""
Jul 16 09:05:29.068279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.068201    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 09:05:29.075119 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.075097    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r4nxb"]
Jul 16 09:05:29.107932 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.107907    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:29.176452 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.176419    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bfvc\" (UniqueName: \"kubernetes.io/projected/364f1f1a-63c3-4132-a787-1d516c2ee60a-kube-api-access-7bfvc\") pod \"ingress-canary-r4nxb\" (UID: \"364f1f1a-63c3-4132-a787-1d516c2ee60a\") " pod="openshift-ingress-canary/ingress-canary-r4nxb"
Jul 16 09:05:29.176597 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.176463    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fca9065a-bd2e-4622-a18e-8a126ad46f57-trusted-ca\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.176597 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.176511    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fca9065a-bd2e-4622-a18e-8a126ad46f57-image-registry-private-configuration\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.176597 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.176543    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hltbm\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-kube-api-access-hltbm\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.176597 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.176569    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:29.176804 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.176613    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/364f1f1a-63c3-4132-a787-1d516c2ee60a-cert\") pod \"ingress-canary-r4nxb\" (UID: \"364f1f1a-63c3-4132-a787-1d516c2ee60a\") " pod="openshift-ingress-canary/ingress-canary-r4nxb"
Jul 16 09:05:29.176804 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.176659    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fca9065a-bd2e-4622-a18e-8a126ad46f57-ca-trust-extracted\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.176804 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.176710    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bc732aed-8a79-4e68-bc65-f2eec109b398-config-volume\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:29.176804 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.176767    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fca9065a-bd2e-4622-a18e-8a126ad46f57-installation-pull-secrets\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.176804 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.176796    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.176968 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.176867    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-certificates\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.176968 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.176907    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrkrr\" (UniqueName: \"kubernetes.io/projected/bc732aed-8a79-4e68-bc65-f2eec109b398-kube-api-access-qrkrr\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:29.176968 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.176924    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-bound-sa-token\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.176968 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.176954    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc732aed-8a79-4e68-bc65-f2eec109b398-tmp-dir\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:29.254327 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.254251    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:29.277389 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277356    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fca9065a-bd2e-4622-a18e-8a126ad46f57-ca-trust-extracted\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.277519 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277421    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bc732aed-8a79-4e68-bc65-f2eec109b398-config-volume\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:29.277519 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277466    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fca9065a-bd2e-4622-a18e-8a126ad46f57-installation-pull-secrets\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.277519 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277495    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.277677 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277525    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-certificates\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.277677 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277555    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrkrr\" (UniqueName: \"kubernetes.io/projected/bc732aed-8a79-4e68-bc65-f2eec109b398-kube-api-access-qrkrr\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:29.277677 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277579    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-bound-sa-token\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.277677 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277598    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc732aed-8a79-4e68-bc65-f2eec109b398-tmp-dir\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:29.277677 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277622    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bfvc\" (UniqueName: \"kubernetes.io/projected/364f1f1a-63c3-4132-a787-1d516c2ee60a-kube-api-access-7bfvc\") pod \"ingress-canary-r4nxb\" (UID: \"364f1f1a-63c3-4132-a787-1d516c2ee60a\") " pod="openshift-ingress-canary/ingress-canary-r4nxb"
Jul 16 09:05:29.277677 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277644    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fca9065a-bd2e-4622-a18e-8a126ad46f57-trusted-ca\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.278004 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277680    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fca9065a-bd2e-4622-a18e-8a126ad46f57-image-registry-private-configuration\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.278004 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277700    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hltbm\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-kube-api-access-hltbm\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.278004 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277717    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:29.278004 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277736    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/364f1f1a-63c3-4132-a787-1d516c2ee60a-cert\") pod \"ingress-canary-r4nxb\" (UID: \"364f1f1a-63c3-4132-a787-1d516c2ee60a\") " pod="openshift-ingress-canary/ingress-canary-r4nxb"
Jul 16 09:05:29.278004 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277743    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fca9065a-bd2e-4622-a18e-8a126ad46f57-ca-trust-extracted\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.278004 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.277980    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc732aed-8a79-4e68-bc65-f2eec109b398-tmp-dir\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:29.278292 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.278079    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bc732aed-8a79-4e68-bc65-f2eec109b398-config-volume\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:29.278594 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:29.278571    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:05:29.278715 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:29.278651    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls podName:bc732aed-8a79-4e68-bc65-f2eec109b398 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:29.778629485 +0000 UTC m=+37.602481046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls") pod "dns-default-cngmn" (UID: "bc732aed-8a79-4e68-bc65-f2eec109b398") : secret "dns-default-metrics-tls" not found
Jul 16 09:05:29.278852 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:29.278577    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 09:05:29.278852 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:29.278849    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdf5748c-ndjml: secret "image-registry-tls" not found
Jul 16 09:05:29.278950 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:29.278897    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls podName:fca9065a-bd2e-4622-a18e-8a126ad46f57 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:29.778881945 +0000 UTC m=+37.602733501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls") pod "image-registry-6cdf5748c-ndjml" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57") : secret "image-registry-tls" not found
Jul 16 09:05:29.279007 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.278984    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-certificates\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.279316 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.279281    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fca9065a-bd2e-4622-a18e-8a126ad46f57-trusted-ca\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.282893 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.282867    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fca9065a-bd2e-4622-a18e-8a126ad46f57-installation-pull-secrets\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.282994 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.282890    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fca9065a-bd2e-4622-a18e-8a126ad46f57-image-registry-private-configuration\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.282994 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.282921    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/364f1f1a-63c3-4132-a787-1d516c2ee60a-cert\") pod \"ingress-canary-r4nxb\" (UID: \"364f1f1a-63c3-4132-a787-1d516c2ee60a\") " pod="openshift-ingress-canary/ingress-canary-r4nxb"
Jul 16 09:05:29.287654 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.287629    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-bound-sa-token\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.287849 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.287821    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrkrr\" (UniqueName: \"kubernetes.io/projected/bc732aed-8a79-4e68-bc65-f2eec109b398-kube-api-access-qrkrr\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:29.287942 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.287865    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hltbm\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-kube-api-access-hltbm\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.288274 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.288241    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bfvc\" (UniqueName: \"kubernetes.io/projected/364f1f1a-63c3-4132-a787-1d516c2ee60a-kube-api-access-7bfvc\") pod \"ingress-canary-r4nxb\" (UID: \"364f1f1a-63c3-4132-a787-1d516c2ee60a\") " pod="openshift-ingress-canary/ingress-canary-r4nxb"
Jul 16 09:05:29.376496 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.376466    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r4nxb"
Jul 16 09:05:29.782224 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.782182    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:29.782848 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:29.782322    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:05:29.782848 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.782368    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:29.782848 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:29.782424    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls podName:bc732aed-8a79-4e68-bc65-f2eec109b398 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:30.78240046 +0000 UTC m=+38.606252031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls") pod "dns-default-cngmn" (UID: "bc732aed-8a79-4e68-bc65-f2eec109b398") : secret "dns-default-metrics-tls" not found
Jul 16 09:05:29.782848 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:29.782485    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 09:05:29.782848 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:29.782501    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdf5748c-ndjml: secret "image-registry-tls" not found
Jul 16 09:05:29.782848 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:29.782556    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls podName:fca9065a-bd2e-4622-a18e-8a126ad46f57 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:30.782538758 +0000 UTC m=+38.606390310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls") pod "image-registry-6cdf5748c-ndjml" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57") : secret "image-registry-tls" not found
Jul 16 09:05:29.971286 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.971110    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgr75" event={"ID":"2f695655-2301-4d69-a98f-fc51b8aeea13","Type":"ContainerStarted","Data":"9f415d9301c48e5a0ee05eabb8e04854afd3bf05cfad96a8b9ac7381f4652b92"}
Jul 16 09:05:29.983201 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:29.983167    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r4nxb"]
Jul 16 09:05:30.712424 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:30.712388    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:30.712583 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:30.712388    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:30.712638 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:30.712592    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:30.716072 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:30.716046    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 09:05:30.716230 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:30.716083    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xwv7m\""
Jul 16 09:05:30.716230 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:30.716093    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 09:05:30.716230 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:30.716104    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 09:05:30.716230 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:30.716129    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 09:05:30.716230 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:30.716129    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h777f\""
Jul 16 09:05:30.791725 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:30.791704    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:30.792049 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:30.791753    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:30.792049 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:30.791839    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 09:05:30.792049 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:30.791844    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:05:30.792049 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:30.791851    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdf5748c-ndjml: secret "image-registry-tls" not found
Jul 16 09:05:30.792049 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:30.791890    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls podName:bc732aed-8a79-4e68-bc65-f2eec109b398 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:32.79187674 +0000 UTC m=+40.615728287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls") pod "dns-default-cngmn" (UID: "bc732aed-8a79-4e68-bc65-f2eec109b398") : secret "dns-default-metrics-tls" not found
Jul 16 09:05:30.792049 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:30.791902    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls podName:fca9065a-bd2e-4622-a18e-8a126ad46f57 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:32.791896028 +0000 UTC m=+40.615747574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls") pod "image-registry-6cdf5748c-ndjml" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57") : secret "image-registry-tls" not found
Jul 16 09:05:30.976115 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:30.976027    2556 generic.go:356] "Generic (PLEG): container finished" podID="2f695655-2301-4d69-a98f-fc51b8aeea13" containerID="9f415d9301c48e5a0ee05eabb8e04854afd3bf05cfad96a8b9ac7381f4652b92" exitCode=0
Jul 16 09:05:30.976250 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:30.976116    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgr75" event={"ID":"2f695655-2301-4d69-a98f-fc51b8aeea13","Type":"ContainerDied","Data":"9f415d9301c48e5a0ee05eabb8e04854afd3bf05cfad96a8b9ac7381f4652b92"}
Jul 16 09:05:30.977336 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:30.977127    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r4nxb" event={"ID":"364f1f1a-63c3-4132-a787-1d516c2ee60a","Type":"ContainerStarted","Data":"0e6967959948f16aea67a3fc453db0791c5e181405d6337308fb447bd774d342"}
Jul 16 09:05:31.983293 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:31.983265    2556 generic.go:356] "Generic (PLEG): container finished" podID="2f695655-2301-4d69-a98f-fc51b8aeea13" containerID="104e70130d32cceb3de2ef783dd798a980a5b270357253d2a46d0660c65d5533" exitCode=0
Jul 16 09:05:31.983752 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:31.983315    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgr75" event={"ID":"2f695655-2301-4d69-a98f-fc51b8aeea13","Type":"ContainerDied","Data":"104e70130d32cceb3de2ef783dd798a980a5b270357253d2a46d0660c65d5533"}
Jul 16 09:05:32.806302 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:32.806090    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:32.806459 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:32.806254    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 09:05:32.806459 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:32.806392    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:32.806459 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:32.806397    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdf5748c-ndjml: secret "image-registry-tls" not found
Jul 16 09:05:32.806589 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:32.806465    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls podName:fca9065a-bd2e-4622-a18e-8a126ad46f57 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:36.806442759 +0000 UTC m=+44.630294337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls") pod "image-registry-6cdf5748c-ndjml" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57") : secret "image-registry-tls" not found
Jul 16 09:05:32.806589 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:32.806499    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:05:32.806589 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:32.806545    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls podName:bc732aed-8a79-4e68-bc65-f2eec109b398 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:36.806529213 +0000 UTC m=+44.630380780 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls") pod "dns-default-cngmn" (UID: "bc732aed-8a79-4e68-bc65-f2eec109b398") : secret "dns-default-metrics-tls" not found
Jul 16 09:05:32.989669 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:32.989632    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgr75" event={"ID":"2f695655-2301-4d69-a98f-fc51b8aeea13","Type":"ContainerStarted","Data":"22cfc420364a0f47931bd3d8bb443a87699d286b338eabfe42c3bdae0fdbf576"}
Jul 16 09:05:33.011155 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:33.011070    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lgr75" podStartSLOduration=8.296697116 podStartE2EDuration="40.011051094s" totalImagesPullingTime="31.714353978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:04:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:33.010139556 +0000 UTC m=+40.833991126" watchObservedRunningTime="2026-07-16 09:05:33.011051094 +0000 UTC m=+40.834902666"
Jul 16 09:05:33.134514 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:33.134463    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:33.690355 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:33.690323    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:33.746354 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:33.746333    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:33.993139 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:33.993050    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r4nxb" event={"ID":"364f1f1a-63c3-4132-a787-1d516c2ee60a","Type":"ContainerStarted","Data":"62aa989d2bbde227e5db9c3576a9465e41189d0ab4140a8e866008a1103c76e1"}
Jul 16 09:05:34.012143 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:34.012100    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r4nxb" podStartSLOduration=1.616737716 podStartE2EDuration="5.012084596s" totalImagesPullingTime="3.39534688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:34.010948734 +0000 UTC m=+41.834800331" watchObservedRunningTime="2026-07-16 09:05:34.012084596 +0000 UTC m=+41.835936190"
Jul 16 09:05:36.833156 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:36.833112    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:36.833641 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:36.833278    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:36.833641 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:36.833286    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 09:05:36.833641 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:36.833393    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdf5748c-ndjml: secret "image-registry-tls" not found
Jul 16 09:05:36.833641 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:36.833331    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:05:36.833641 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:36.833466    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls podName:fca9065a-bd2e-4622-a18e-8a126ad46f57 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:44.833444928 +0000 UTC m=+52.657296495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls") pod "image-registry-6cdf5748c-ndjml" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57") : secret "image-registry-tls" not found
Jul 16 09:05:36.833641 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:36.833539    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls podName:bc732aed-8a79-4e68-bc65-f2eec109b398 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:44.833521743 +0000 UTC m=+52.657373290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls") pod "dns-default-cngmn" (UID: "bc732aed-8a79-4e68-bc65-f2eec109b398") : secret "dns-default-metrics-tls" not found
Jul 16 09:05:38.991069 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:38.991038    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:39.056418 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:39.056389    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:40.168814 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:40.168753    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:40.228966 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:40.228938    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:41.291168 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:41.291137    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:41.390396 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:41.390370    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:44.891456 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:44.891424    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:05:44.891813 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:44.891479    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:05:44.891813 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:44.891562    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:05:44.891813 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:44.891581    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 09:05:44.891813 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:44.891592    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdf5748c-ndjml: secret "image-registry-tls" not found
Jul 16 09:05:44.891813 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:44.891621    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls podName:bc732aed-8a79-4e68-bc65-f2eec109b398 nodeName:}" failed. No retries permitted until 2026-07-16 09:06:00.891605029 +0000 UTC m=+68.715456575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls") pod "dns-default-cngmn" (UID: "bc732aed-8a79-4e68-bc65-f2eec109b398") : secret "dns-default-metrics-tls" not found
Jul 16 09:05:44.891813 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:44.891636    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls podName:fca9065a-bd2e-4622-a18e-8a126ad46f57 nodeName:}" failed. No retries permitted until 2026-07-16 09:06:00.891629369 +0000 UTC m=+68.715480916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls") pod "image-registry-6cdf5748c-ndjml" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57") : secret "image-registry-tls" not found
Jul 16 09:05:47.511422 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.511388    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:47.587076 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.587046    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:47.687393 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.687366    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:47.748090 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.748064    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"]
Jul 16 09:05:47.772038 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.771978    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"]
Jul 16 09:05:47.772132 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.772064    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:05:47.774336 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.774311    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 09:05:47.775183 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.775159    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 16 09:05:47.775305 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.775288    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 09:05:47.775388 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.775293    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 09:05:47.812651 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.812629    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03e234ed-9742-403c-a4ec-dc65282f7ba4-tmp\") pod \"klusterlet-addon-workmgr-54bf77557-k4z8c\" (UID: \"03e234ed-9742-403c-a4ec-dc65282f7ba4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:05:47.812749 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.812668    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/03e234ed-9742-403c-a4ec-dc65282f7ba4-klusterlet-config\") pod \"klusterlet-addon-workmgr-54bf77557-k4z8c\" (UID: \"03e234ed-9742-403c-a4ec-dc65282f7ba4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:05:47.812749 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.812694    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9r7q\" (UniqueName: \"kubernetes.io/projected/03e234ed-9742-403c-a4ec-dc65282f7ba4-kube-api-access-j9r7q\") pod \"klusterlet-addon-workmgr-54bf77557-k4z8c\" (UID: \"03e234ed-9742-403c-a4ec-dc65282f7ba4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:05:47.913465 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.913437    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03e234ed-9742-403c-a4ec-dc65282f7ba4-tmp\") pod \"klusterlet-addon-workmgr-54bf77557-k4z8c\" (UID: \"03e234ed-9742-403c-a4ec-dc65282f7ba4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:05:47.913593 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.913479    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/03e234ed-9742-403c-a4ec-dc65282f7ba4-klusterlet-config\") pod \"klusterlet-addon-workmgr-54bf77557-k4z8c\" (UID: \"03e234ed-9742-403c-a4ec-dc65282f7ba4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:05:47.913593 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.913503    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9r7q\" (UniqueName: \"kubernetes.io/projected/03e234ed-9742-403c-a4ec-dc65282f7ba4-kube-api-access-j9r7q\") pod \"klusterlet-addon-workmgr-54bf77557-k4z8c\" (UID: \"03e234ed-9742-403c-a4ec-dc65282f7ba4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:05:47.913840 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.913821    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03e234ed-9742-403c-a4ec-dc65282f7ba4-tmp\") pod \"klusterlet-addon-workmgr-54bf77557-k4z8c\" (UID: \"03e234ed-9742-403c-a4ec-dc65282f7ba4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:05:47.917474 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.917455    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/03e234ed-9742-403c-a4ec-dc65282f7ba4-klusterlet-config\") pod \"klusterlet-addon-workmgr-54bf77557-k4z8c\" (UID: \"03e234ed-9742-403c-a4ec-dc65282f7ba4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:05:47.926064 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:47.926038    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9r7q\" (UniqueName: \"kubernetes.io/projected/03e234ed-9742-403c-a4ec-dc65282f7ba4-kube-api-access-j9r7q\") pod \"klusterlet-addon-workmgr-54bf77557-k4z8c\" (UID: \"03e234ed-9742-403c-a4ec-dc65282f7ba4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:05:48.081192 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:48.081118    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:05:48.216615 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:48.216586    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"]
Jul 16 09:05:48.220299 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:05:48.220265    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e234ed_9742_403c_a4ec_dc65282f7ba4.slice/crio-1fd87ab60cc443effb61ad6e4ed6cb9979fb5646c7168f4e985eb12ba742a2e8 WatchSource:0}: Error finding container 1fd87ab60cc443effb61ad6e4ed6cb9979fb5646c7168f4e985eb12ba742a2e8: Status 404 returned error can't find the container with id 1fd87ab60cc443effb61ad6e4ed6cb9979fb5646c7168f4e985eb12ba742a2e8
Jul 16 09:05:48.890416 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:48.890389    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:48.991365 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:48.991322    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:49.028116 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:49.028086    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c" event={"ID":"03e234ed-9742-403c-a4ec-dc65282f7ba4","Type":"ContainerStarted","Data":"1fd87ab60cc443effb61ad6e4ed6cb9979fb5646c7168f4e985eb12ba742a2e8"}
Jul 16 09:05:49.555122 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:49.555094    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:52.038406 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:52.038319    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c" event={"ID":"03e234ed-9742-403c-a4ec-dc65282f7ba4","Type":"ContainerStarted","Data":"6b428ac9c6d2d6db81eb3c5061db908bb7c2a0b55ab161098e69078d159debc4"}
Jul 16 09:05:52.038768 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:52.038508    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:05:52.039820 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:52.039803    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:05:52.057193 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:52.054866    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c" podStartSLOduration=1.5671740280000002 podStartE2EDuration="5.054847755s" totalImagesPullingTime="3.487673727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:52.053417705 +0000 UTC m=+59.877269273" watchObservedRunningTime="2026-07-16 09:05:52.054847755 +0000 UTC m=+59.878699330"
Jul 16 09:05:54.965462 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:54.965433    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-llwv9"
Jul 16 09:05:55.123150 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:55.123124    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:55.222635 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:55.222569    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:05:58.391617 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:58.391575    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:05:58.391994 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:58.391631    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjzx\" (UniqueName: \"kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx\") pod \"network-check-target-57v9s\" (UID: \"c54d6cc3-8d45-401c-8f2b-c52524b80b47\") " pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:58.394461 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:58.394445    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 09:05:58.394514 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:58.394495    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 09:05:58.402211 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:58.402192    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 09:05:58.402302 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:05:58.402248    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs podName:a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690 nodeName:}" failed. No retries permitted until 2026-07-16 09:07:02.402232739 +0000 UTC m=+130.226084286 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs") pod "network-metrics-daemon-sbf5q" (UID: "a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690") : secret "metrics-daemon-secret" not found
Jul 16 09:05:58.404199 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:58.404181    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 09:05:58.415216 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:58.415189    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjjzx\" (UniqueName: \"kubernetes.io/projected/c54d6cc3-8d45-401c-8f2b-c52524b80b47-kube-api-access-qjjzx\") pod \"network-check-target-57v9s\" (UID: \"c54d6cc3-8d45-401c-8f2b-c52524b80b47\") " pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:58.492364 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:58.492312    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:58.494713 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:58.494698    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 09:05:58.505323 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:58.505305    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6526b2dd-27b6-4b19-860e-dcb145d1803b-original-pull-secret\") pod \"global-pull-secret-syncer-w6rvh\" (UID: \"6526b2dd-27b6-4b19-860e-dcb145d1803b\") " pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:58.624393 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:58.624370    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xwv7m\""
Jul 16 09:05:58.632137 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:58.632120    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:05:58.632192 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:58.632139    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w6rvh"
Jul 16 09:05:58.756964 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:58.756944    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-57v9s"]
Jul 16 09:05:58.760079 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:05:58.760055    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc54d6cc3_8d45_401c_8f2b_c52524b80b47.slice/crio-417b74cf1198c5be8e85df4b71108b58e34613168cd37a4ca07956ddab4d764a WatchSource:0}: Error finding container 417b74cf1198c5be8e85df4b71108b58e34613168cd37a4ca07956ddab4d764a: Status 404 returned error can't find the container with id 417b74cf1198c5be8e85df4b71108b58e34613168cd37a4ca07956ddab4d764a
Jul 16 09:05:58.768647 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:58.768625    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w6rvh"]
Jul 16 09:05:58.771454 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:05:58.771434    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6526b2dd_27b6_4b19_860e_dcb145d1803b.slice/crio-fef65089cd80da0f013d3ea30f4d3c6beeb425d46b58303ff148862575d7408b WatchSource:0}: Error finding container fef65089cd80da0f013d3ea30f4d3c6beeb425d46b58303ff148862575d7408b: Status 404 returned error can't find the container with id fef65089cd80da0f013d3ea30f4d3c6beeb425d46b58303ff148862575d7408b
Jul 16 09:05:59.056781 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:59.056742    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w6rvh" event={"ID":"6526b2dd-27b6-4b19-860e-dcb145d1803b","Type":"ContainerStarted","Data":"fef65089cd80da0f013d3ea30f4d3c6beeb425d46b58303ff148862575d7408b"}
Jul 16 09:05:59.057693 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:05:59.057674    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-57v9s" event={"ID":"c54d6cc3-8d45-401c-8f2b-c52524b80b47","Type":"ContainerStarted","Data":"417b74cf1198c5be8e85df4b71108b58e34613168cd37a4ca07956ddab4d764a"}
Jul 16 09:06:00.909960 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:00.909922    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:06:00.910410 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:00.909988    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:06:00.910410 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:06:00.910109    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:06:00.910410 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:06:00.910136    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 09:06:00.910410 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:06:00.910151    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdf5748c-ndjml: secret "image-registry-tls" not found
Jul 16 09:06:00.910410 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:06:00.910209    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls podName:bc732aed-8a79-4e68-bc65-f2eec109b398 nodeName:}" failed. No retries permitted until 2026-07-16 09:06:32.910184692 +0000 UTC m=+100.734036262 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls") pod "dns-default-cngmn" (UID: "bc732aed-8a79-4e68-bc65-f2eec109b398") : secret "dns-default-metrics-tls" not found
Jul 16 09:06:00.910410 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:06:00.910231    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls podName:fca9065a-bd2e-4622-a18e-8a126ad46f57 nodeName:}" failed. No retries permitted until 2026-07-16 09:06:32.910220977 +0000 UTC m=+100.734072529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls") pod "image-registry-6cdf5748c-ndjml" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57") : secret "image-registry-tls" not found
Jul 16 09:06:03.155368 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:03.155323    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:06:03.218368 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:03.218325    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:06:03.637474 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:03.637446    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:06:04.073461 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:04.073425    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-57v9s" event={"ID":"c54d6cc3-8d45-401c-8f2b-c52524b80b47","Type":"ContainerStarted","Data":"2292e4cb7ea4c62c844009450045536f8888fdf9679c04cfe99ca32f2f4e41b7"}
Jul 16 09:06:04.073637 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:04.073541    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:06:04.074907 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:04.074883    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w6rvh" event={"ID":"6526b2dd-27b6-4b19-860e-dcb145d1803b","Type":"ContainerStarted","Data":"6798126602bcd9f020393e655a880ab5f19ed2a537e684fdb6857fc78d6a132d"}
Jul 16 09:06:04.089684 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:04.089631    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-57v9s" podStartSLOduration=66.027017227 podStartE2EDuration="1m11.089617119s" totalImagesPullingTime="5.062599892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:06:04.089190191 +0000 UTC m=+71.913041799" watchObservedRunningTime="2026-07-16 09:06:04.089617119 +0000 UTC m=+71.913468679"
Jul 16 09:06:04.104953 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:04.104896    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w6rvh" podStartSLOduration=65.042890278 podStartE2EDuration="1m10.104875987s" totalImagesPullingTime="5.061985709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:04:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:06:04.104268103 +0000 UTC m=+71.928119673" watchObservedRunningTime="2026-07-16 09:06:04.104875987 +0000 UTC m=+71.928727556"
Jul 16 09:06:04.322556 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:04.322524    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:06:04.705421 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:04.705391    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:06:06.356245 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:06.356211    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:06:25.628520 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:25.628412    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:06:26.146780 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:26.146748    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:06:32.934501 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:32.934470    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:06:32.934885 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:32.934512    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:06:32.934885 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:06:32.934610    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:06:32.934885 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:06:32.934663    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 09:06:32.934885 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:06:32.934670    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls podName:bc732aed-8a79-4e68-bc65-f2eec109b398 nodeName:}" failed. No retries permitted until 2026-07-16 09:07:36.934653064 +0000 UTC m=+164.758504616 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls") pod "dns-default-cngmn" (UID: "bc732aed-8a79-4e68-bc65-f2eec109b398") : secret "dns-default-metrics-tls" not found
Jul 16 09:06:32.934885 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:06:32.934673    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdf5748c-ndjml: secret "image-registry-tls" not found
Jul 16 09:06:32.934885 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:06:32.934719    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls podName:fca9065a-bd2e-4622-a18e-8a126ad46f57 nodeName:}" failed. No retries permitted until 2026-07-16 09:07:36.934707568 +0000 UTC m=+164.758559116 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls") pod "image-registry-6cdf5748c-ndjml" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57") : secret "image-registry-tls" not found
Jul 16 09:06:35.079438 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:06:35.079406    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-57v9s"
Jul 16 09:07:02.436755 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:07:02.436698    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:07:02.437165 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:07:02.436861    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 09:07:02.437165 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:07:02.436942    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs podName:a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:04.436924798 +0000 UTC m=+252.260776345 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs") pod "network-metrics-daemon-sbf5q" (UID: "a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690") : secret "metrics-daemon-secret" not found
Jul 16 09:07:32.058242 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:07:32.058204    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml" podUID="fca9065a-bd2e-4622-a18e-8a126ad46f57"
Jul 16 09:07:32.066373 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:07:32.066326    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cngmn" podUID="bc732aed-8a79-4e68-bc65-f2eec109b398"
Jul 16 09:07:32.291740 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:07:32.291708    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cngmn"
Jul 16 09:07:32.291919 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:07:32.291708    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:07:33.727053 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:07:33.727006    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:07:36.961264 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:07:36.961226    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:07:36.961683 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:07:36.961312    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:07:36.961683 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:07:36.961386    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 09:07:36.961683 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:07:36.961410    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdf5748c-ndjml: secret "image-registry-tls" not found
Jul 16 09:07:36.961683 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:07:36.961444    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:07:36.961683 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:07:36.961475    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls podName:fca9065a-bd2e-4622-a18e-8a126ad46f57 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:38.961458541 +0000 UTC m=+286.785310105 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls") pod "image-registry-6cdf5748c-ndjml" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57") : secret "image-registry-tls" not found
Jul 16 09:07:36.961683 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:07:36.961494    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls podName:bc732aed-8a79-4e68-bc65-f2eec109b398 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:38.961480972 +0000 UTC m=+286.785332519 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls") pod "dns-default-cngmn" (UID: "bc732aed-8a79-4e68-bc65-f2eec109b398") : secret "dns-default-metrics-tls" not found
Jul 16 09:07:37.400720 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:07:37.400635    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:07:48.712737 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:07:48.712654    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:07:52.039194 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:07:52.039135    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c" podUID="03e234ed-9742-403c-a4ec-dc65282f7ba4" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused"
Jul 16 09:07:52.338067 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:07:52.338036    2556 generic.go:356] "Generic (PLEG): container finished" podID="03e234ed-9742-403c-a4ec-dc65282f7ba4" containerID="6b428ac9c6d2d6db81eb3c5061db908bb7c2a0b55ab161098e69078d159debc4" exitCode=1
Jul 16 09:07:52.338223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:07:52.338072    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c" event={"ID":"03e234ed-9742-403c-a4ec-dc65282f7ba4","Type":"ContainerDied","Data":"6b428ac9c6d2d6db81eb3c5061db908bb7c2a0b55ab161098e69078d159debc4"}
Jul 16 09:07:52.338378 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:07:52.338365    2556 scope.go:117] "RemoveContainer" containerID="6b428ac9c6d2d6db81eb3c5061db908bb7c2a0b55ab161098e69078d159debc4"
Jul 16 09:07:53.342264 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:07:53.342228    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c" event={"ID":"03e234ed-9742-403c-a4ec-dc65282f7ba4","Type":"ContainerStarted","Data":"0025bdd841f1f494e09a93c0df9c0f34874bc811ed49be309824ce819f6ebdad"}
Jul 16 09:07:53.342679 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:07:53.342563    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:07:53.343178 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:07:53.343159    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:08:37.094406 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:08:37.094371    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:04.439180 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:04.439134    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:09:04.439667 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:04.439311    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 09:09:04.439667 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:04.439406    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs podName:a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690 nodeName:}" failed. No retries permitted until 2026-07-16 09:11:06.439386048 +0000 UTC m=+374.263237595 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs") pod "network-metrics-daemon-sbf5q" (UID: "a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690") : secret "metrics-daemon-secret" not found
Jul 16 09:09:20.693340 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.693259    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-67bcfd8b64-c689b"]
Jul 16 09:09:20.696322 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.696292    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:20.702705 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.702673    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-v6l9b\""
Jul 16 09:09:20.702902 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.702883    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 09:09:20.703432 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.703411    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 16 09:09:20.703540 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.703437    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 16 09:09:20.703540 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.703411    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 16 09:09:20.703931 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.703643    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 16 09:09:20.704854 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.704838    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 09:09:20.715246 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.715225    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67bcfd8b64-c689b"]
Jul 16 09:09:20.762195 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.762168    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp"]
Jul 16 09:09:20.763721 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.763706    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp"
Jul 16 09:09:20.766401 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.766383    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 16 09:09:20.766637 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.766610    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 16 09:09:20.766687 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.766656    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 16 09:09:20.766730 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.766703    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-94vwx\""
Jul 16 09:09:20.766903 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.766888    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 16 09:09:20.775563 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.775544    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp"]
Jul 16 09:09:20.846647 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.846619    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-default-certificate\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:20.846743 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.846654    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:20.846743 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.846681    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8dfk\" (UniqueName: \"kubernetes.io/projected/bfa44217-2dd9-4774-8030-59a4a3754b6c-kube-api-access-r8dfk\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:20.846821 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.846776    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-stats-auth\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:20.846821 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.846813    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:20.890357 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.890332    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:20.947590 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.947527    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-default-certificate\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:20.947590 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.947561    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:20.947590 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.947584    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8dfk\" (UniqueName: \"kubernetes.io/projected/bfa44217-2dd9-4774-8030-59a4a3754b6c-kube-api-access-r8dfk\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:20.947834 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.947708    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8c3e4dc-5cd5-4ee5-98df-312d867b3933-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7h5tp\" (UID: \"a8c3e4dc-5cd5-4ee5-98df-312d867b3933\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp"
Jul 16 09:09:20.947834 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:20.947719    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle podName:bfa44217-2dd9-4774-8030-59a4a3754b6c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:21.447699946 +0000 UTC m=+269.271551518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle") pod "router-default-67bcfd8b64-c689b" (UID: "bfa44217-2dd9-4774-8030-59a4a3754b6c") : configmap references non-existent config key: service-ca.crt
Jul 16 09:09:20.947834 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.947797    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-stats-auth\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:20.947834 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.947831    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:20.948016 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.947852    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8c3e4dc-5cd5-4ee5-98df-312d867b3933-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7h5tp\" (UID: \"a8c3e4dc-5cd5-4ee5-98df-312d867b3933\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp"
Jul 16 09:09:20.948016 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.947871    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pnxx\" (UniqueName: \"kubernetes.io/projected/a8c3e4dc-5cd5-4ee5-98df-312d867b3933-kube-api-access-9pnxx\") pod \"kube-storage-version-migrator-operator-799cb7f958-7h5tp\" (UID: \"a8c3e4dc-5cd5-4ee5-98df-312d867b3933\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp"
Jul 16 09:09:20.948016 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:20.947930    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 09:09:20.948016 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:20.947996    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs podName:bfa44217-2dd9-4774-8030-59a4a3754b6c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:21.447979627 +0000 UTC m=+269.271831190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs") pod "router-default-67bcfd8b64-c689b" (UID: "bfa44217-2dd9-4774-8030-59a4a3754b6c") : secret "router-metrics-certs-default" not found
Jul 16 09:09:20.949939 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.949914    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-default-certificate\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:20.950021 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.949974    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-stats-auth\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:20.957474 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.957455    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8dfk\" (UniqueName: \"kubernetes.io/projected/bfa44217-2dd9-4774-8030-59a4a3754b6c-kube-api-access-r8dfk\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:20.990683 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:20.990656    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:21.049033 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:21.049006    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8c3e4dc-5cd5-4ee5-98df-312d867b3933-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7h5tp\" (UID: \"a8c3e4dc-5cd5-4ee5-98df-312d867b3933\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp"
Jul 16 09:09:21.049136 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:21.049070    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8c3e4dc-5cd5-4ee5-98df-312d867b3933-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7h5tp\" (UID: \"a8c3e4dc-5cd5-4ee5-98df-312d867b3933\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp"
Jul 16 09:09:21.049136 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:21.049098    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pnxx\" (UniqueName: \"kubernetes.io/projected/a8c3e4dc-5cd5-4ee5-98df-312d867b3933-kube-api-access-9pnxx\") pod \"kube-storage-version-migrator-operator-799cb7f958-7h5tp\" (UID: \"a8c3e4dc-5cd5-4ee5-98df-312d867b3933\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp"
Jul 16 09:09:21.049584 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:21.049564    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8c3e4dc-5cd5-4ee5-98df-312d867b3933-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7h5tp\" (UID: \"a8c3e4dc-5cd5-4ee5-98df-312d867b3933\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp"
Jul 16 09:09:21.051068 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:21.051050    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8c3e4dc-5cd5-4ee5-98df-312d867b3933-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7h5tp\" (UID: \"a8c3e4dc-5cd5-4ee5-98df-312d867b3933\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp"
Jul 16 09:09:21.058174 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:21.058152    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pnxx\" (UniqueName: \"kubernetes.io/projected/a8c3e4dc-5cd5-4ee5-98df-312d867b3933-kube-api-access-9pnxx\") pod \"kube-storage-version-migrator-operator-799cb7f958-7h5tp\" (UID: \"a8c3e4dc-5cd5-4ee5-98df-312d867b3933\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp"
Jul 16 09:09:21.072124 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:21.072105    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp"
Jul 16 09:09:21.187061 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:21.187035    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp"]
Jul 16 09:09:21.190236 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:09:21.190210    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8c3e4dc_5cd5_4ee5_98df_312d867b3933.slice/crio-e744d9ba51d06bf0d46c84548788e3693c4f1649f7da2a34fdb8c4d1db6343a1 WatchSource:0}: Error finding container e744d9ba51d06bf0d46c84548788e3693c4f1649f7da2a34fdb8c4d1db6343a1: Status 404 returned error can't find the container with id e744d9ba51d06bf0d46c84548788e3693c4f1649f7da2a34fdb8c4d1db6343a1
Jul 16 09:09:21.451014 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:21.450990    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:21.451134 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:21.451035    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:21.451178 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:21.451163    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle podName:bfa44217-2dd9-4774-8030-59a4a3754b6c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:22.45114583 +0000 UTC m=+270.274997381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle") pod "router-default-67bcfd8b64-c689b" (UID: "bfa44217-2dd9-4774-8030-59a4a3754b6c") : configmap references non-existent config key: service-ca.crt
Jul 16 09:09:21.451222 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:21.451171    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 09:09:21.451222 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:21.451220    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs podName:bfa44217-2dd9-4774-8030-59a4a3754b6c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:22.451204394 +0000 UTC m=+270.275055942 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs") pod "router-default-67bcfd8b64-c689b" (UID: "bfa44217-2dd9-4774-8030-59a4a3754b6c") : secret "router-metrics-certs-default" not found
Jul 16 09:09:21.592506 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:21.592477    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp" event={"ID":"a8c3e4dc-5cd5-4ee5-98df-312d867b3933","Type":"ContainerStarted","Data":"e744d9ba51d06bf0d46c84548788e3693c4f1649f7da2a34fdb8c4d1db6343a1"}
Jul 16 09:09:22.459021 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:22.458991    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:22.459383 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:22.459039    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:22.459383 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:22.459134    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 09:09:22.459383 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:22.459165    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle podName:bfa44217-2dd9-4774-8030-59a4a3754b6c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:24.459147752 +0000 UTC m=+272.282999299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle") pod "router-default-67bcfd8b64-c689b" (UID: "bfa44217-2dd9-4774-8030-59a4a3754b6c") : configmap references non-existent config key: service-ca.crt
Jul 16 09:09:22.459383 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:22.459189    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs podName:bfa44217-2dd9-4774-8030-59a4a3754b6c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:24.459180194 +0000 UTC m=+272.283031740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs") pod "router-default-67bcfd8b64-c689b" (UID: "bfa44217-2dd9-4774-8030-59a4a3754b6c") : secret "router-metrics-certs-default" not found
Jul 16 09:09:24.473118 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:24.473086    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:24.473596 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:24.473152    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:24.473596 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:24.473269    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 09:09:24.473596 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:24.473287    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle podName:bfa44217-2dd9-4774-8030-59a4a3754b6c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:28.47326426 +0000 UTC m=+276.297115820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle") pod "router-default-67bcfd8b64-c689b" (UID: "bfa44217-2dd9-4774-8030-59a4a3754b6c") : configmap references non-existent config key: service-ca.crt
Jul 16 09:09:24.473596 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:24.473322    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs podName:bfa44217-2dd9-4774-8030-59a4a3754b6c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:28.473305695 +0000 UTC m=+276.297157242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs") pod "router-default-67bcfd8b64-c689b" (UID: "bfa44217-2dd9-4774-8030-59a4a3754b6c") : secret "router-metrics-certs-default" not found
Jul 16 09:09:25.109144 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:25.109111    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:25.210101 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:25.210032    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:25.606447 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:25.606361    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp" event={"ID":"a8c3e4dc-5cd5-4ee5-98df-312d867b3933","Type":"ContainerStarted","Data":"26f212d931649b782c11812c5950923d082a411b1c0c5fd7cdf7fd5f33e58549"}
Jul 16 09:09:25.625068 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:25.625023    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp" podStartSLOduration=1.863623943 podStartE2EDuration="5.625009226s" totalImagesPullingTime="3.761385283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:09:25.624448627 +0000 UTC m=+273.448300212" watchObservedRunningTime="2026-07-16 09:09:25.625009226 +0000 UTC m=+273.448860842"
Jul 16 09:09:26.130566 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.130534    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g8rpt"]
Jul 16 09:09:26.132312 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.132296    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.134711 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.134682    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 09:09:26.134971 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.134956    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 09:09:26.135043 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.135021    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 09:09:26.135630 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.135611    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gw7j9\""
Jul 16 09:09:26.136314 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.136300    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 09:09:26.147678 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.147653    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g8rpt"]
Jul 16 09:09:26.199981 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.199953    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:26.270207 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.270182    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:26.285326 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.285301    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxc7f\" (UniqueName: \"kubernetes.io/projected/3d0169f2-e8bd-4351-936c-f387521d6175-kube-api-access-jxc7f\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.285444 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.285369    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.285444 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.285396    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.285444 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.285428    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d0169f2-e8bd-4351-936c-f387521d6175-data-volume\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.285558 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.285502    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d0169f2-e8bd-4351-936c-f387521d6175-crio-socket\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.386268 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.386197    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.386268 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.386243    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.386477 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.386292    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d0169f2-e8bd-4351-936c-f387521d6175-data-volume\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.386477 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:26.386315    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 09:09:26.386477 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.386336    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d0169f2-e8bd-4351-936c-f387521d6175-crio-socket\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.386477 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:26.386415    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm podName:3d0169f2-e8bd-4351-936c-f387521d6175 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:26.886393486 +0000 UTC m=+274.710245035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g8rpt" (UID: "3d0169f2-e8bd-4351-936c-f387521d6175") : configmap "kube-rbac-proxy" not found
Jul 16 09:09:26.386477 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:26.386425    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:26.386477 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.386446    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d0169f2-e8bd-4351-936c-f387521d6175-crio-socket\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.386477 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.386462    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxc7f\" (UniqueName: \"kubernetes.io/projected/3d0169f2-e8bd-4351-936c-f387521d6175-kube-api-access-jxc7f\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.386477 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:26.386472    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls podName:3d0169f2-e8bd-4351-936c-f387521d6175 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:26.886460749 +0000 UTC m=+274.710312311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g8rpt" (UID: "3d0169f2-e8bd-4351-936c-f387521d6175") : secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:26.386923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.386764    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d0169f2-e8bd-4351-936c-f387521d6175-data-volume\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.400743 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.400718    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxc7f\" (UniqueName: \"kubernetes.io/projected/3d0169f2-e8bd-4351-936c-f387521d6175-kube-api-access-jxc7f\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.416082 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.416062    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:26.502291 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.502266    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:26.605651 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.605628    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:26.703538 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.703513    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:26.891100 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.891066    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.891100 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.891107    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:26.891307 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:26.891188    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 09:09:26.891307 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:26.891238    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:26.891307 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:26.891247    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm podName:3d0169f2-e8bd-4351-936c-f387521d6175 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:27.891231749 +0000 UTC m=+275.715083300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g8rpt" (UID: "3d0169f2-e8bd-4351-936c-f387521d6175") : configmap "kube-rbac-proxy" not found
Jul 16 09:09:26.891307 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:26.891286    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls podName:3d0169f2-e8bd-4351-936c-f387521d6175 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:27.891275095 +0000 UTC m=+275.715126642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g8rpt" (UID: "3d0169f2-e8bd-4351-936c-f387521d6175") : secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:26.927943 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.927919    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:26.999121 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:26.999067    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:27.898986 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:27.898951    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:27.898986 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:27.898986    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:27.899422 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:27.899075    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 09:09:27.899422 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:27.899154    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm podName:3d0169f2-e8bd-4351-936c-f387521d6175 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:29.899134292 +0000 UTC m=+277.722985859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g8rpt" (UID: "3d0169f2-e8bd-4351-936c-f387521d6175") : configmap "kube-rbac-proxy" not found
Jul 16 09:09:27.899422 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:27.899155    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:27.899422 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:27.899193    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls podName:3d0169f2-e8bd-4351-936c-f387521d6175 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:29.899183644 +0000 UTC m=+277.723035195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g8rpt" (UID: "3d0169f2-e8bd-4351-936c-f387521d6175") : secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:28.321728 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:28.321703    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xm6zn_d4e101a1-6ad1-4a51-9cf2-cc73c46c849a/dns-node-resolver/0.log"
Jul 16 09:09:28.502475 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:28.502448    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:28.502612 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:28.502570    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:28.502651 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:28.502611    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 09:09:28.502684 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:28.502672    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle podName:bfa44217-2dd9-4774-8030-59a4a3754b6c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:36.502658324 +0000 UTC m=+284.326509871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle") pod "router-default-67bcfd8b64-c689b" (UID: "bfa44217-2dd9-4774-8030-59a4a3754b6c") : configmap references non-existent config key: service-ca.crt
Jul 16 09:09:28.502725 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:28.502687    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs podName:bfa44217-2dd9-4774-8030-59a4a3754b6c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:36.50268096 +0000 UTC m=+284.326532507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs") pod "router-default-67bcfd8b64-c689b" (UID: "bfa44217-2dd9-4774-8030-59a4a3754b6c") : secret "router-metrics-certs-default" not found
Jul 16 09:09:28.552623 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:28.552600    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:28.624145 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:28.624088    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:29.091936 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:29.091899    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:29.198838 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:29.198806    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:29.324579 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:29.324559    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xst8k_07047c0e-998f-4081-b64e-d285a6d5750a/node-ca/0.log"
Jul 16 09:09:29.631238 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:29.631211    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:29.913377 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:29.913331    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:29.913551 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:29.913392    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:29.913551 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:29.913446    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 09:09:29.913551 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:29.913508    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm podName:3d0169f2-e8bd-4351-936c-f387521d6175 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:33.913493289 +0000 UTC m=+281.737344837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g8rpt" (UID: "3d0169f2-e8bd-4351-936c-f387521d6175") : configmap "kube-rbac-proxy" not found
Jul 16 09:09:29.913676 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:29.913555    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:29.913676 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:29.913607    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls podName:3d0169f2-e8bd-4351-936c-f387521d6175 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:33.913593201 +0000 UTC m=+281.737444748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g8rpt" (UID: "3d0169f2-e8bd-4351-936c-f387521d6175") : secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:30.122790 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:30.122768    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r4nxb_364f1f1a-63c3-4132-a787-1d516c2ee60a/serve-healthcheck-canary/0.log"
Jul 16 09:09:30.315764 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:30.315694    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:30.422155 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:30.422125    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:30.517928 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:30.517899    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:30.628555 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:30.628483    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:30.698988 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:30.698964    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:31.656822 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:31.656783    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:31.800323 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:31.800293    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:32.199848 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:32.199818    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:32.387144 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:32.387109    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:32.593758 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:32.593690    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:33.234400 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:33.234366    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:33.619802 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:33.619722    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:33.942735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:33.942709    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:33.942884 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:33.942743    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:33.942884 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:33.942831    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 09:09:33.942955 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:33.942898    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm podName:3d0169f2-e8bd-4351-936c-f387521d6175 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:41.942877188 +0000 UTC m=+289.766728739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g8rpt" (UID: "3d0169f2-e8bd-4351-936c-f387521d6175") : configmap "kube-rbac-proxy" not found
Jul 16 09:09:33.942955 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:33.942900    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:33.942955 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:33.942948    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls podName:3d0169f2-e8bd-4351-936c-f387521d6175 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:41.942931171 +0000 UTC m=+289.766782735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g8rpt" (UID: "3d0169f2-e8bd-4351-936c-f387521d6175") : secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:33.996846 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:33.996821    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:34.097786 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:34.097764    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:34.198782 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:34.198726    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:34.263400 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:34.263342    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:34.388090 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:34.388066    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:34.622786 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:34.622723    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:35.292657 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:35.292614    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml" podUID="fca9065a-bd2e-4622-a18e-8a126ad46f57"
Jul 16 09:09:35.292657 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:35.292614    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cngmn" podUID="bc732aed-8a79-4e68-bc65-f2eec109b398"
Jul 16 09:09:35.595728 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:35.595643    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:35.634969 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:35.634949    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:09:35.635090 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:35.634949    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cngmn"
Jul 16 09:09:35.795663 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:35.795635    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:36.186464 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:36.186430    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:36.390643 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:36.390615    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:36.446987 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:36.446927    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:36.561721 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:36.561692    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:36.561834 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:36.561729    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:36.562263 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:36.562238    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfa44217-2dd9-4774-8030-59a4a3754b6c-service-ca-bundle\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:36.564076 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:36.564049    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfa44217-2dd9-4774-8030-59a4a3754b6c-metrics-certs\") pod \"router-default-67bcfd8b64-c689b\" (UID: \"bfa44217-2dd9-4774-8030-59a4a3754b6c\") " pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:36.606952 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:36.606932    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:36.730879 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:36.730760    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67bcfd8b64-c689b"]
Jul 16 09:09:36.733246 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:09:36.733215    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa44217_2dd9_4774_8030_59a4a3754b6c.slice/crio-29e8703020fe3647e906ffa685b17139ad1b3465a3eeb0189c64021b65f200d3 WatchSource:0}: Error finding container 29e8703020fe3647e906ffa685b17139ad1b3465a3eeb0189c64021b65f200d3: Status 404 returned error can't find the container with id 29e8703020fe3647e906ffa685b17139ad1b3465a3eeb0189c64021b65f200d3
Jul 16 09:09:36.785056 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:36.785032    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:37.405513 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:37.405480    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:37.641605 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:37.641572    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67bcfd8b64-c689b" event={"ID":"bfa44217-2dd9-4774-8030-59a4a3754b6c","Type":"ContainerStarted","Data":"869be4bb3e32ef0e49f9795dba2b65a2be22fef05af8c4b161514db8634722cb"}
Jul 16 09:09:37.641766 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:37.641625    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67bcfd8b64-c689b" event={"ID":"bfa44217-2dd9-4774-8030-59a4a3754b6c","Type":"ContainerStarted","Data":"29e8703020fe3647e906ffa685b17139ad1b3465a3eeb0189c64021b65f200d3"}
Jul 16 09:09:37.663543 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:37.663495    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-67bcfd8b64-c689b" podStartSLOduration=17.663480184 podStartE2EDuration="17.663480184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:09:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:09:37.661952624 +0000 UTC m=+285.485804195" watchObservedRunningTime="2026-07-16 09:09:37.663480184 +0000 UTC m=+285.487331753"
Jul 16 09:09:37.993706 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:37.993633    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:38.299836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:38.299751    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:38.400747 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:38.400716    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:38.607994 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:38.607916    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:38.610245 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:38.610225    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:38.644499 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:38.644469    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:38.645635 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:38.645616    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-67bcfd8b64-c689b"
Jul 16 09:09:38.792478 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:38.792425    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:38.977896 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:38.977873    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:09:38.978010 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:38.977930    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:09:38.980287 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:38.980256    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc732aed-8a79-4e68-bc65-f2eec109b398-metrics-tls\") pod \"dns-default-cngmn\" (UID: \"bc732aed-8a79-4e68-bc65-f2eec109b398\") " pod="openshift-dns/dns-default-cngmn"
Jul 16 09:09:38.980426 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:38.980319    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls\") pod \"image-registry-6cdf5748c-ndjml\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") " pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:09:39.194043 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:39.193994    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:39.239504 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:39.239447    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xmnzs\""
Jul 16 09:09:39.239504 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:39.239445    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8dsdg\""
Jul 16 09:09:39.247029 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:39.247016    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cngmn"
Jul 16 09:09:39.247092 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:39.247035    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:09:39.374675 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:39.374579    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cngmn"]
Jul 16 09:09:39.377145 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:09:39.377119    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc732aed_8a79_4e68_bc65_f2eec109b398.slice/crio-ee58d6945e31d1e097b0e2959b5427acd38f37af72345cdac2a5718d1af6c6b4 WatchSource:0}: Error finding container ee58d6945e31d1e097b0e2959b5427acd38f37af72345cdac2a5718d1af6c6b4: Status 404 returned error can't find the container with id ee58d6945e31d1e097b0e2959b5427acd38f37af72345cdac2a5718d1af6c6b4
Jul 16 09:09:39.391433 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:39.391413    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cdf5748c-ndjml"]
Jul 16 09:09:39.395749 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:09:39.394429    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca9065a_bd2e_4622_a18e_8a126ad46f57.slice/crio-aeda5851925c0bc1fb611d2c8aa63c180bff0d5e3cb50155c2e581e8bc5bb619 WatchSource:0}: Error finding container aeda5851925c0bc1fb611d2c8aa63c180bff0d5e3cb50155c2e581e8bc5bb619: Status 404 returned error can't find the container with id aeda5851925c0bc1fb611d2c8aa63c180bff0d5e3cb50155c2e581e8bc5bb619
Jul 16 09:09:39.648778 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:39.648679    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml" event={"ID":"fca9065a-bd2e-4622-a18e-8a126ad46f57","Type":"ContainerStarted","Data":"c9b22898c248d9183693ace67c5c1c5519f49d862a324723ae9161b2cc8fa8a6"}
Jul 16 09:09:39.648778 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:39.648748    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:09:39.648778 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:39.648771    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml" event={"ID":"fca9065a-bd2e-4622-a18e-8a126ad46f57","Type":"ContainerStarted","Data":"aeda5851925c0bc1fb611d2c8aa63c180bff0d5e3cb50155c2e581e8bc5bb619"}
Jul 16 09:09:39.649870 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:39.649838    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cngmn" event={"ID":"bc732aed-8a79-4e68-bc65-f2eec109b398","Type":"ContainerStarted","Data":"ee58d6945e31d1e097b0e2959b5427acd38f37af72345cdac2a5718d1af6c6b4"}
Jul 16 09:09:39.670764 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:39.670722    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml" podStartSLOduration=285.670709235 podStartE2EDuration="4m45.670709235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:09:39.669641547 +0000 UTC m=+287.493493138" watchObservedRunningTime="2026-07-16 09:09:39.670709235 +0000 UTC m=+287.494560804"
Jul 16 09:09:40.318689 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:40.318656    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:40.421279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:40.421247    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:40.491303 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:40.491275    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:40.637957 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:40.637880    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:40.793239 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:40.793210    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:41.092122 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:41.092088    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:42.002456 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:42.002407    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:42.002456 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:42.002453    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:42.003064 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:42.003041    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d0169f2-e8bd-4351-936c-f387521d6175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:42.004980 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:42.004958    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d0169f2-e8bd-4351-936c-f387521d6175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g8rpt\" (UID: \"3d0169f2-e8bd-4351-936c-f387521d6175\") " pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:42.041171 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:42.041140    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g8rpt"
Jul 16 09:09:42.220525 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:42.220499    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g8rpt"]
Jul 16 09:09:42.223744 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:09:42.223717    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0169f2_e8bd_4351_936c_f387521d6175.slice/crio-75a28a262c9beaecef30679b944db5202f2b2b5c18ba2028fa50dbb1afdf1ad6 WatchSource:0}: Error finding container 75a28a262c9beaecef30679b944db5202f2b2b5c18ba2028fa50dbb1afdf1ad6: Status 404 returned error can't find the container with id 75a28a262c9beaecef30679b944db5202f2b2b5c18ba2028fa50dbb1afdf1ad6
Jul 16 09:09:42.663363 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:42.663318    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g8rpt" event={"ID":"3d0169f2-e8bd-4351-936c-f387521d6175","Type":"ContainerStarted","Data":"75a28a262c9beaecef30679b944db5202f2b2b5c18ba2028fa50dbb1afdf1ad6"}
Jul 16 09:09:42.664864 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:42.664839    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cngmn" event={"ID":"bc732aed-8a79-4e68-bc65-f2eec109b398","Type":"ContainerStarted","Data":"fc9e1597233acf0a4fcf4eed84c13c706be8d1154755be6436bdb7ce1925f100"}
Jul 16 09:09:42.664963 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:42.664884    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cngmn" event={"ID":"bc732aed-8a79-4e68-bc65-f2eec109b398","Type":"ContainerStarted","Data":"76a3927b8f978cbdec1317b78062344686068c2aee88b6c78fa92792f38a45cc"}
Jul 16 09:09:42.665020 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:42.664984    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cngmn"
Jul 16 09:09:42.684419 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:42.684373    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cngmn" podStartSLOduration=250.923477449 podStartE2EDuration="4m13.684337901s" totalImagesPullingTime="2.760860452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:09:42.683507712 +0000 UTC m=+290.507359300" watchObservedRunningTime="2026-07-16 09:09:42.684337901 +0000 UTC m=+290.508189472"
Jul 16 09:09:43.952185 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:43.952151    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:44.006498 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:44.006457    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:47.681841 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:47.681808    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:47.683566 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:47.683539    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g8rpt" event={"ID":"3d0169f2-e8bd-4351-936c-f387521d6175","Type":"ContainerStarted","Data":"117f875eac1e7b58d35319e4fba116cab39d6ec7439c73e7392832434b1b8fcb"}
Jul 16 09:09:49.142487 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:49.142437    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:49.368680 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:49.368648    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:49.641995 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:49.641957    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:49.745311 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:49.745264    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:49.843401 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:49.843371    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:50.929933 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:50.929898    2556 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:9e52074c0d83354691642410dcd96770c3d39a04e2a483011757fc219d666d9f: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift/origin-insights-runtime-exporter:latest"
Jul 16 09:09:50.930330 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:50.929997    2556 kuberuntime_manager.go:1459] "Unhandled Error" err="container exporter start failed in pod insights-runtime-extractor-g8rpt_openshift-insights(3d0169f2-e8bd-4351-936c-f387521d6175): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:9e52074c0d83354691642410dcd96770c3d39a04e2a483011757fc219d666d9f: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 16 09:09:51.713786 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:51.713734    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sbf5q" podUID="a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690"
Jul 16 09:09:52.053361 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:52.053310    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:52.157021 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:52.156984    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:52.592048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:52.592020    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:09:52.593774 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:52.593752    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:09:52.599662 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:52.599647    2556 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 09:09:52.670183 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:52.670118    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cngmn"
Jul 16 09:09:52.703103 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:52.703055    2556 generic.go:356] "Generic (PLEG): container finished" podID="03e234ed-9742-403c-a4ec-dc65282f7ba4" containerID="0025bdd841f1f494e09a93c0df9c0f34874bc811ed49be309824ce819f6ebdad" exitCode=1
Jul 16 09:09:52.703265 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:52.703110    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c" event={"ID":"03e234ed-9742-403c-a4ec-dc65282f7ba4","Type":"ContainerDied","Data":"0025bdd841f1f494e09a93c0df9c0f34874bc811ed49be309824ce819f6ebdad"}
Jul 16 09:09:52.703265 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:52.703173    2556 scope.go:117] "RemoveContainer" containerID="6b428ac9c6d2d6db81eb3c5061db908bb7c2a0b55ab161098e69078d159debc4"
Jul 16 09:09:52.703544 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:52.703495    2556 scope.go:117] "RemoveContainer" containerID="0025bdd841f1f494e09a93c0df9c0f34874bc811ed49be309824ce819f6ebdad"
Jul 16 09:09:52.703744 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:52.703702    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-54bf77557-k4z8c_open-cluster-management-agent-addon(03e234ed-9742-403c-a4ec-dc65282f7ba4)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c" podUID="03e234ed-9742-403c-a4ec-dc65282f7ba4"
Jul 16 09:09:53.343492 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:53.343457    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:09:53.708494 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:53.708465    2556 scope.go:117] "RemoveContainer" containerID="0025bdd841f1f494e09a93c0df9c0f34874bc811ed49be309824ce819f6ebdad"
Jul 16 09:09:53.708720 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:53.708681    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-54bf77557-k4z8c_open-cluster-management-agent-addon(03e234ed-9742-403c-a4ec-dc65282f7ba4)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c" podUID="03e234ed-9742-403c-a4ec-dc65282f7ba4"
Jul 16 09:09:54.594478 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:54.594450    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"exporter\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:9e52074c0d83354691642410dcd96770c3d39a04e2a483011757fc219d666d9f: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-g8rpt" podUID="3d0169f2-e8bd-4351-936c-f387521d6175"
Jul 16 09:09:54.712913 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:54.712881    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"exporter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:9e52074c0d83354691642410dcd96770c3d39a04e2a483011757fc219d666d9f: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-g8rpt" podUID="3d0169f2-e8bd-4351-936c-f387521d6175"
Jul 16 09:09:54.714889 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:54.714864    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g8rpt" event={"ID":"3d0169f2-e8bd-4351-936c-f387521d6175","Type":"ContainerStarted","Data":"0d355ed25da85ece6451a64ed7fbe708820be4c29a5ce5cd356164bbf7f7432b"}
Jul 16 09:09:55.719010 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:55.717235    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:09:55.719010 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:55.717655    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"exporter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:9e52074c0d83354691642410dcd96770c3d39a04e2a483011757fc219d666d9f: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-g8rpt" podUID="3d0169f2-e8bd-4351-936c-f387521d6175"
Jul 16 09:09:56.233832 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:56.233803    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:56.296999 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:56.296966    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:57.418823 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.418791    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:57.447358 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.447331    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f74f96f5c-cnvgq"]
Jul 16 09:09:57.451602 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.451582    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.455089 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.455072    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 09:09:57.455221 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.455204    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 09:09:57.455287 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.455097    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 09:09:57.455287 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.455278    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 09:09:57.455413 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.455101    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mzcd6\""
Jul 16 09:09:57.455413 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.455122    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 09:09:57.455413 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.455097    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 09:09:57.455413 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.455209    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 09:09:57.465106 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.465089    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f74f96f5c-cnvgq"]
Jul 16 09:09:57.510698 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.510678    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:57.520778 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.520762    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-oauth-serving-cert\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.520851 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.520788    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16581f4e-613e-44da-a399-08d4f6d5e157-console-oauth-config\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.520851 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.520805    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16581f4e-613e-44da-a399-08d4f6d5e157-console-serving-cert\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.520952 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.520916    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-console-config\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.521007 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.520964    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvgmk\" (UniqueName: \"kubernetes.io/projected/16581f4e-613e-44da-a399-08d4f6d5e157-kube-api-access-lvgmk\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.521058 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.521000    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-service-ca\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.585711 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.585690    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xxh4b"]
Jul 16 09:09:57.589515 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.589499    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xxh4b"
Jul 16 09:09:57.590433 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.590410    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:57.591819 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.591799    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 16 09:09:57.591916 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.591850    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-h8l5v\""
Jul 16 09:09:57.598644 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.598613    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xxh4b"]
Jul 16 09:09:57.622167 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.622141    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-oauth-serving-cert\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.622270 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.622176    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16581f4e-613e-44da-a399-08d4f6d5e157-console-oauth-config\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.622270 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.622204    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16581f4e-613e-44da-a399-08d4f6d5e157-console-serving-cert\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.622270 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.622261    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-console-config\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.622456 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.622300    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvgmk\" (UniqueName: \"kubernetes.io/projected/16581f4e-613e-44da-a399-08d4f6d5e157-kube-api-access-lvgmk\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.622456 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.622327    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-service-ca\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.622844 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.622826    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-oauth-serving-cert\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.622980 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.622962    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-console-config\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.623029 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.622970    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-service-ca\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.624528 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.624512    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16581f4e-613e-44da-a399-08d4f6d5e157-console-oauth-config\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.624675 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.624658    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16581f4e-613e-44da-a399-08d4f6d5e157-console-serving-cert\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.631296 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.631272    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvgmk\" (UniqueName: \"kubernetes.io/projected/16581f4e-613e-44da-a399-08d4f6d5e157-kube-api-access-lvgmk\") pod \"console-f74f96f5c-cnvgq\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") " pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.723296 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.723246    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/afbdc34c-42b2-4fa8-af4c-c93c59ae3d14-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-xxh4b\" (UID: \"afbdc34c-42b2-4fa8-af4c-c93c59ae3d14\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xxh4b"
Jul 16 09:09:57.734243 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.734215    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:57.760540 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.760516    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:09:57.824727 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.824372    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/afbdc34c-42b2-4fa8-af4c-c93c59ae3d14-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-xxh4b\" (UID: \"afbdc34c-42b2-4fa8-af4c-c93c59ae3d14\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xxh4b"
Jul 16 09:09:57.827155 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.827120    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/afbdc34c-42b2-4fa8-af4c-c93c59ae3d14-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-xxh4b\" (UID: \"afbdc34c-42b2-4fa8-af4c-c93c59ae3d14\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xxh4b"
Jul 16 09:09:57.897629 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.897597    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xxh4b"
Jul 16 09:09:57.899044 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:57.899022    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f74f96f5c-cnvgq"]
Jul 16 09:09:57.900574 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:09:57.900551    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16581f4e_613e_44da_a399_08d4f6d5e157.slice/crio-cfb051ee3cc0a3c7f0b7f59ca1be71a7efdaf0d59dbbbc3f169a2361056fde6b WatchSource:0}: Error finding container cfb051ee3cc0a3c7f0b7f59ca1be71a7efdaf0d59dbbbc3f169a2361056fde6b: Status 404 returned error can't find the container with id cfb051ee3cc0a3c7f0b7f59ca1be71a7efdaf0d59dbbbc3f169a2361056fde6b
Jul 16 09:09:58.020447 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:58.020417    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xxh4b"]
Jul 16 09:09:58.022881 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:09:58.022857    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafbdc34c_42b2_4fa8_af4c_c93c59ae3d14.slice/crio-8ce3902dc633d627ec146c2f3694dc5047743cd5b56aedc90430857494801324 WatchSource:0}: Error finding container 8ce3902dc633d627ec146c2f3694dc5047743cd5b56aedc90430857494801324: Status 404 returned error can't find the container with id 8ce3902dc633d627ec146c2f3694dc5047743cd5b56aedc90430857494801324
Jul 16 09:09:58.082138 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:58.082111    2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:09:58.082471 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:58.082460    2556 scope.go:117] "RemoveContainer" containerID="0025bdd841f1f494e09a93c0df9c0f34874bc811ed49be309824ce819f6ebdad"
Jul 16 09:09:58.082609 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:09:58.082592    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-54bf77557-k4z8c_open-cluster-management-agent-addon(03e234ed-9742-403c-a4ec-dc65282f7ba4)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c" podUID="03e234ed-9742-403c-a4ec-dc65282f7ba4"
Jul 16 09:09:58.725825 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:58.725790    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xxh4b" event={"ID":"afbdc34c-42b2-4fa8-af4c-c93c59ae3d14","Type":"ContainerStarted","Data":"8ce3902dc633d627ec146c2f3694dc5047743cd5b56aedc90430857494801324"}
Jul 16 09:09:58.727163 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:58.727131    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f74f96f5c-cnvgq" event={"ID":"16581f4e-613e-44da-a399-08d4f6d5e157","Type":"ContainerStarted","Data":"cfb051ee3cc0a3c7f0b7f59ca1be71a7efdaf0d59dbbbc3f169a2361056fde6b"}
Jul 16 09:09:59.245119 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:59.245090    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:09:59.252933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:59.252907    2556 patch_prober.go:28] interesting pod/image-registry-6cdf5748c-ndjml container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 09:09:59.253065 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:59.252954    2556 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml" podUID="fca9065a-bd2e-4622-a18e-8a126ad46f57" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 09:09:59.732190 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:59.732156    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xxh4b" event={"ID":"afbdc34c-42b2-4fa8-af4c-c93c59ae3d14","Type":"ContainerStarted","Data":"89b3b582d5ac7c9c3fcfab74ce2e249928f0263a2e53f315a1224da8775f9d4b"}
Jul 16 09:09:59.732663 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:59.732227    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xxh4b"
Jul 16 09:09:59.737865 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:59.737841    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xxh4b"
Jul 16 09:09:59.749133 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:09:59.749092    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xxh4b" podStartSLOduration=1.528393888 podStartE2EDuration="2.749078711s" totalImagesPullingTime="1.220684823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:09:59.747539334 +0000 UTC m=+307.571390926" watchObservedRunningTime="2026-07-16 09:09:59.749078711 +0000 UTC m=+307.572930280"
Jul 16 09:10:00.613466 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.613433    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:00.649530 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.649496    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-q4s49"]
Jul 16 09:10:00.659482 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.658409    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:00.662579 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.662400    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vqm28\""
Jul 16 09:10:00.662579 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.662427    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 09:10:00.662579 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.662440    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 16 09:10:00.662579 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.662469    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 16 09:10:00.662579 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.662469    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 09:10:00.662579 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.662399    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 09:10:00.662952 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.662935    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:10:00.664022 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.663983    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-q4s49"]
Jul 16 09:10:00.733605 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.733575    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:00.748664 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.748631    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82e995ba-71e5-4466-873b-e94402391a32-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-q4s49\" (UID: \"82e995ba-71e5-4466-873b-e94402391a32\") " pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:00.748790 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.748669    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qr69\" (UniqueName: \"kubernetes.io/projected/82e995ba-71e5-4466-873b-e94402391a32-kube-api-access-4qr69\") pod \"prometheus-operator-64785b6675-q4s49\" (UID: \"82e995ba-71e5-4466-873b-e94402391a32\") " pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:00.748994 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.748973    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82e995ba-71e5-4466-873b-e94402391a32-metrics-client-ca\") pod \"prometheus-operator-64785b6675-q4s49\" (UID: \"82e995ba-71e5-4466-873b-e94402391a32\") " pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:00.749071 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.749051    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82e995ba-71e5-4466-873b-e94402391a32-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-q4s49\" (UID: \"82e995ba-71e5-4466-873b-e94402391a32\") " pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:00.850344 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.850312    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82e995ba-71e5-4466-873b-e94402391a32-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-q4s49\" (UID: \"82e995ba-71e5-4466-873b-e94402391a32\") " pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:00.850344 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.850361    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qr69\" (UniqueName: \"kubernetes.io/projected/82e995ba-71e5-4466-873b-e94402391a32-kube-api-access-4qr69\") pod \"prometheus-operator-64785b6675-q4s49\" (UID: \"82e995ba-71e5-4466-873b-e94402391a32\") " pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:00.850587 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.850406    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82e995ba-71e5-4466-873b-e94402391a32-metrics-client-ca\") pod \"prometheus-operator-64785b6675-q4s49\" (UID: \"82e995ba-71e5-4466-873b-e94402391a32\") " pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:00.850587 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.850428    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82e995ba-71e5-4466-873b-e94402391a32-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-q4s49\" (UID: \"82e995ba-71e5-4466-873b-e94402391a32\") " pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:00.850587 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:10:00.850554    2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 16 09:10:00.850766 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:10:00.850635    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e995ba-71e5-4466-873b-e94402391a32-prometheus-operator-tls podName:82e995ba-71e5-4466-873b-e94402391a32 nodeName:}" failed. No retries permitted until 2026-07-16 09:10:01.350607442 +0000 UTC m=+309.174459011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/82e995ba-71e5-4466-873b-e94402391a32-prometheus-operator-tls") pod "prometheus-operator-64785b6675-q4s49" (UID: "82e995ba-71e5-4466-873b-e94402391a32") : secret "prometheus-operator-tls" not found
Jul 16 09:10:00.851072 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.851053    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82e995ba-71e5-4466-873b-e94402391a32-metrics-client-ca\") pod \"prometheus-operator-64785b6675-q4s49\" (UID: \"82e995ba-71e5-4466-873b-e94402391a32\") " pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:00.852632 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.852605    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82e995ba-71e5-4466-873b-e94402391a32-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-q4s49\" (UID: \"82e995ba-71e5-4466-873b-e94402391a32\") " pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:00.861438 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.861407    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qr69\" (UniqueName: \"kubernetes.io/projected/82e995ba-71e5-4466-873b-e94402391a32-kube-api-access-4qr69\") pod \"prometheus-operator-64785b6675-q4s49\" (UID: \"82e995ba-71e5-4466-873b-e94402391a32\") " pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:00.862525 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.862492    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:00.924481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:00.924456    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:01.354980 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:01.354890    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82e995ba-71e5-4466-873b-e94402391a32-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-q4s49\" (UID: \"82e995ba-71e5-4466-873b-e94402391a32\") " pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:01.357284 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:01.357256    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82e995ba-71e5-4466-873b-e94402391a32-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-q4s49\" (UID: \"82e995ba-71e5-4466-873b-e94402391a32\") " pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:01.400063 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:01.400036    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:01.571681 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:01.571650    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49"
Jul 16 09:10:01.697220 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:01.697059    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-q4s49"]
Jul 16 09:10:01.699586 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:10:01.699559    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e995ba_71e5_4466_873b_e94402391a32.slice/crio-5940d405234c22e8a0d20ca6c652464ff33846f63cb9834416326b21c5d4f93f WatchSource:0}: Error finding container 5940d405234c22e8a0d20ca6c652464ff33846f63cb9834416326b21c5d4f93f: Status 404 returned error can't find the container with id 5940d405234c22e8a0d20ca6c652464ff33846f63cb9834416326b21c5d4f93f
Jul 16 09:10:01.739738 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:01.739688    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f74f96f5c-cnvgq" event={"ID":"16581f4e-613e-44da-a399-08d4f6d5e157","Type":"ContainerStarted","Data":"a8aac055ec6ce8bb3cd9673aa5535d0f2c71b7e41c4661be5bc1cef9b319bb62"}
Jul 16 09:10:01.740828 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:01.740807    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49" event={"ID":"82e995ba-71e5-4466-873b-e94402391a32","Type":"ContainerStarted","Data":"5940d405234c22e8a0d20ca6c652464ff33846f63cb9834416326b21c5d4f93f"}
Jul 16 09:10:01.767195 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:01.767137    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f74f96f5c-cnvgq" podStartSLOduration=1.910605041 podStartE2EDuration="4.767119402s" totalImagesPullingTime="2.856514361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:10:01.765807136 +0000 UTC m=+309.589658704" watchObservedRunningTime="2026-07-16 09:10:01.767119402 +0000 UTC m=+309.590970972"
Jul 16 09:10:01.931041 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:01.931013    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:02.031972 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:02.031940    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:02.191012 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:02.190928    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:02.322602 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:02.322572    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:02.713693 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:02.713657    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:10:03.261640 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:03.261609    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:03.364460 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:03.364428    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:03.464874 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:03.464785    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:03.748629 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:03.748539    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49" event={"ID":"82e995ba-71e5-4466-873b-e94402391a32","Type":"ContainerStarted","Data":"2bf1df2953b3619166960f5858d726511892198d47722de28f6fc9f19cf8ce4b"}
Jul 16 09:10:03.748629 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:03.748596    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49" event={"ID":"82e995ba-71e5-4466-873b-e94402391a32","Type":"ContainerStarted","Data":"de79e49adf158f73557232733bec2b8cff12ef25ea68d5ec23ed550f7ec28361"}
Jul 16 09:10:03.766721 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:03.766674    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-q4s49" podStartSLOduration=2.274550999 podStartE2EDuration="3.766659296s" totalImagesPullingTime="1.492108297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:10:03.766449988 +0000 UTC m=+311.590301578" watchObservedRunningTime="2026-07-16 09:10:03.766659296 +0000 UTC m=+311.590510865"
Jul 16 09:10:05.768610 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:05.768573    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:05.970526 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:05.970495    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:06.000739 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.000709    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"]
Jul 16 09:10:06.004026 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.004010    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"
Jul 16 09:10:06.007229 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.007206    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 16 09:10:06.007363 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.007294    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 16 09:10:06.007363 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.007324    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-z9lbt\""
Jul 16 09:10:06.016244 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.016222    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"]
Jul 16 09:10:06.024737 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.024681    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"]
Jul 16 09:10:06.027714 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.027699    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.033593 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.033572    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 16 09:10:06.034152 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.034135    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 16 09:10:06.034444 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.034431    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 16 09:10:06.035427 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.035411    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rbbgl\""
Jul 16 09:10:06.046065 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.046038    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"]
Jul 16 09:10:06.053596 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.053572    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p42cn"]
Jul 16 09:10:06.057301 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.057283    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.061004 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.060980    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 09:10:06.061116 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.061014    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 09:10:06.061253 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.061239    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tg9vk\""
Jul 16 09:10:06.061578 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.061561    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 09:10:06.085403 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.085376    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:06.094197 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.094169    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2757296-21d1-41e8-87df-8a91675ac30e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.094306 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.094202    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9531550f-e7e9-45b1-9150-4cfcbd7c9c58-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-2rkf4\" (UID: \"9531550f-e7e9-45b1-9150-4cfcbd7c9c58\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"
Jul 16 09:10:06.094306 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.094228    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e2757296-21d1-41e8-87df-8a91675ac30e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.094306 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.094276    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e2757296-21d1-41e8-87df-8a91675ac30e-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.094446 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.094306    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2757296-21d1-41e8-87df-8a91675ac30e-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.094446 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.094337    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnpzs\" (UniqueName: \"kubernetes.io/projected/e2757296-21d1-41e8-87df-8a91675ac30e-kube-api-access-vnpzs\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.094446 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.094386    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2757296-21d1-41e8-87df-8a91675ac30e-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.094446 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.094424    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9531550f-e7e9-45b1-9150-4cfcbd7c9c58-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-2rkf4\" (UID: \"9531550f-e7e9-45b1-9150-4cfcbd7c9c58\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"
Jul 16 09:10:06.094561 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.094460    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9531550f-e7e9-45b1-9150-4cfcbd7c9c58-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-2rkf4\" (UID: \"9531550f-e7e9-45b1-9150-4cfcbd7c9c58\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"
Jul 16 09:10:06.094561 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.094490    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtmts\" (UniqueName: \"kubernetes.io/projected/9531550f-e7e9-45b1-9150-4cfcbd7c9c58-kube-api-access-xtmts\") pod \"openshift-state-metrics-84bd68b896-2rkf4\" (UID: \"9531550f-e7e9-45b1-9150-4cfcbd7c9c58\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"
Jul 16 09:10:06.178077 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.178044    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:06.195146 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195119    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e2757296-21d1-41e8-87df-8a91675ac30e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.195293 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195156    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e2757296-21d1-41e8-87df-8a91675ac30e-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.195293 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195185    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2757296-21d1-41e8-87df-8a91675ac30e-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.195293 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195214    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.195293 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195239    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-textfile\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.195293 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195267    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnpzs\" (UniqueName: \"kubernetes.io/projected/e2757296-21d1-41e8-87df-8a91675ac30e-kube-api-access-vnpzs\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.195569 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195336    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2757296-21d1-41e8-87df-8a91675ac30e-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.195569 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:10:06.195387    2556 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 16 09:10:06.195569 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195388    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-wtmp\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.195569 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:10:06.195463    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2757296-21d1-41e8-87df-8a91675ac30e-kube-state-metrics-tls podName:e2757296-21d1-41e8-87df-8a91675ac30e nodeName:}" failed. No retries permitted until 2026-07-16 09:10:06.695442959 +0000 UTC m=+314.519294511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e2757296-21d1-41e8-87df-8a91675ac30e-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-9vsfg" (UID: "e2757296-21d1-41e8-87df-8a91675ac30e") : secret "kube-state-metrics-tls" not found
Jul 16 09:10:06.195569 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195496    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-tls\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.195569 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195552    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5gm5\" (UniqueName: \"kubernetes.io/projected/88d752ab-85cf-45db-a183-69b7fe7dba91-kube-api-access-z5gm5\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.195816 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195571    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e2757296-21d1-41e8-87df-8a91675ac30e-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.195816 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195619    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9531550f-e7e9-45b1-9150-4cfcbd7c9c58-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-2rkf4\" (UID: \"9531550f-e7e9-45b1-9150-4cfcbd7c9c58\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"
Jul 16 09:10:06.195816 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195676    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9531550f-e7e9-45b1-9150-4cfcbd7c9c58-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-2rkf4\" (UID: \"9531550f-e7e9-45b1-9150-4cfcbd7c9c58\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"
Jul 16 09:10:06.195816 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195715    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtmts\" (UniqueName: \"kubernetes.io/projected/9531550f-e7e9-45b1-9150-4cfcbd7c9c58-kube-api-access-xtmts\") pod \"openshift-state-metrics-84bd68b896-2rkf4\" (UID: \"9531550f-e7e9-45b1-9150-4cfcbd7c9c58\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"
Jul 16 09:10:06.195816 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195754    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88d752ab-85cf-45db-a183-69b7fe7dba91-sys\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.195816 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195783    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-accelerators-collector-config\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.196113 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195836    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2757296-21d1-41e8-87df-8a91675ac30e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.196113 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195970    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2757296-21d1-41e8-87df-8a91675ac30e-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.196113 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.195972    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e2757296-21d1-41e8-87df-8a91675ac30e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.196113 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.196026    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88d752ab-85cf-45db-a183-69b7fe7dba91-metrics-client-ca\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.196113 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.196077    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9531550f-e7e9-45b1-9150-4cfcbd7c9c58-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-2rkf4\" (UID: \"9531550f-e7e9-45b1-9150-4cfcbd7c9c58\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"
Jul 16 09:10:06.196383 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.196128    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/88d752ab-85cf-45db-a183-69b7fe7dba91-root\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.196492 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.196472    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9531550f-e7e9-45b1-9150-4cfcbd7c9c58-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-2rkf4\" (UID: \"9531550f-e7e9-45b1-9150-4cfcbd7c9c58\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"
Jul 16 09:10:06.198268 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.198241    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2757296-21d1-41e8-87df-8a91675ac30e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.198392 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.198250    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9531550f-e7e9-45b1-9150-4cfcbd7c9c58-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-2rkf4\" (UID: \"9531550f-e7e9-45b1-9150-4cfcbd7c9c58\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"
Jul 16 09:10:06.198392 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.198277    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9531550f-e7e9-45b1-9150-4cfcbd7c9c58-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-2rkf4\" (UID: \"9531550f-e7e9-45b1-9150-4cfcbd7c9c58\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"
Jul 16 09:10:06.209985 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.209961    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnpzs\" (UniqueName: \"kubernetes.io/projected/e2757296-21d1-41e8-87df-8a91675ac30e-kube-api-access-vnpzs\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.210114 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.209991    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtmts\" (UniqueName: \"kubernetes.io/projected/9531550f-e7e9-45b1-9150-4cfcbd7c9c58-kube-api-access-xtmts\") pod \"openshift-state-metrics-84bd68b896-2rkf4\" (UID: \"9531550f-e7e9-45b1-9150-4cfcbd7c9c58\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"
Jul 16 09:10:06.297277 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297193    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88d752ab-85cf-45db-a183-69b7fe7dba91-sys\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.297277 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297228    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-accelerators-collector-config\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.297277 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297247    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88d752ab-85cf-45db-a183-69b7fe7dba91-metrics-client-ca\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.297277 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297272    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/88d752ab-85cf-45db-a183-69b7fe7dba91-root\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.297630 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297309    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88d752ab-85cf-45db-a183-69b7fe7dba91-sys\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.297630 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297312    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.297630 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297375    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/88d752ab-85cf-45db-a183-69b7fe7dba91-root\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.297630 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297402    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-textfile\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.297630 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297431    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-wtmp\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.297630 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297449    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-tls\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.297630 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297483    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5gm5\" (UniqueName: \"kubernetes.io/projected/88d752ab-85cf-45db-a183-69b7fe7dba91-kube-api-access-z5gm5\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.297630 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297599    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-wtmp\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.297938 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297733    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-textfile\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.298005 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297984    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-accelerators-collector-config\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.298038 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.297986    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88d752ab-85cf-45db-a183-69b7fe7dba91-metrics-client-ca\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.299658 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.299640    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.299749 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.299738    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/88d752ab-85cf-45db-a183-69b7fe7dba91-node-exporter-tls\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.306574 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.306554    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5gm5\" (UniqueName: \"kubernetes.io/projected/88d752ab-85cf-45db-a183-69b7fe7dba91-kube-api-access-z5gm5\") pod \"node-exporter-p42cn\" (UID: \"88d752ab-85cf-45db-a183-69b7fe7dba91\") " pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.312440 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.312423    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"
Jul 16 09:10:06.367032 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.366983    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p42cn"
Jul 16 09:10:06.379606 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:10:06.379583    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d752ab_85cf_45db_a183_69b7fe7dba91.slice/crio-3c16307bb5e18f7fe3f086be0403e6469cda944a5f663e19b9cfeb0804ccc5f8 WatchSource:0}: Error finding container 3c16307bb5e18f7fe3f086be0403e6469cda944a5f663e19b9cfeb0804ccc5f8: Status 404 returned error can't find the container with id 3c16307bb5e18f7fe3f086be0403e6469cda944a5f663e19b9cfeb0804ccc5f8
Jul 16 09:10:06.444776 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.444732    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:06.446525 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.446493    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4"]
Jul 16 09:10:06.448991 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:10:06.448967    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9531550f_e7e9_45b1_9150_4cfcbd7c9c58.slice/crio-a5347fe692c0699a83764a016c28f2b042b2a0b532b721a7947c4d55f7dbae4d WatchSource:0}: Error finding container a5347fe692c0699a83764a016c28f2b042b2a0b532b721a7947c4d55f7dbae4d: Status 404 returned error can't find the container with id a5347fe692c0699a83764a016c28f2b042b2a0b532b721a7947c4d55f7dbae4d
Jul 16 09:10:06.544190 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.544166    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:06.700714 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.700684    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2757296-21d1-41e8-87df-8a91675ac30e-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.702957 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.702936    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2757296-21d1-41e8-87df-8a91675ac30e-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9vsfg\" (UID: \"e2757296-21d1-41e8-87df-8a91675ac30e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:06.758310 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.758281    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p42cn" event={"ID":"88d752ab-85cf-45db-a183-69b7fe7dba91","Type":"ContainerStarted","Data":"3c16307bb5e18f7fe3f086be0403e6469cda944a5f663e19b9cfeb0804ccc5f8"}
Jul 16 09:10:06.760148 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.760125    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4" event={"ID":"9531550f-e7e9-45b1-9150-4cfcbd7c9c58","Type":"ContainerStarted","Data":"3bfc85763ad8061f17e36403c1ba570ea9baabf400fd984e8bbab23030a3a84b"}
Jul 16 09:10:06.760263 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.760183    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4" event={"ID":"9531550f-e7e9-45b1-9150-4cfcbd7c9c58","Type":"ContainerStarted","Data":"cfa6835980771aea4c98f6f2b56ea09ecc7d35995d5b17e20d25ed8d48adebcf"}
Jul 16 09:10:06.760263 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.760214    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4" event={"ID":"9531550f-e7e9-45b1-9150-4cfcbd7c9c58","Type":"ContainerStarted","Data":"a5347fe692c0699a83764a016c28f2b042b2a0b532b721a7947c4d55f7dbae4d"}
Jul 16 09:10:06.793261 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.793239    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:06.936034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:06.936004    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"
Jul 16 09:10:07.030330 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:07.030246    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:07.079041 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:07.079016    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9vsfg"]
Jul 16 09:10:07.080310 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:10:07.080284    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2757296_21d1_41e8_87df_8a91675ac30e.slice/crio-c5e17793140bb1c9febd730c80f61a54c472ca57885774f6ca6249cf977faf3e WatchSource:0}: Error finding container c5e17793140bb1c9febd730c80f61a54c472ca57885774f6ca6249cf977faf3e: Status 404 returned error can't find the container with id c5e17793140bb1c9febd730c80f61a54c472ca57885774f6ca6249cf977faf3e
Jul 16 09:10:07.327261 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:07.327187    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:07.628419 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:07.628318    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:07.761183 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:07.761152    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:10:07.761375 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:07.761219    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:10:07.766892 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:07.766862    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg" event={"ID":"e2757296-21d1-41e8-87df-8a91675ac30e","Type":"ContainerStarted","Data":"c5e17793140bb1c9febd730c80f61a54c472ca57885774f6ca6249cf977faf3e"}
Jul 16 09:10:07.767961 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:07.767934    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:10:07.837808 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:07.837777    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:08.442498 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:08.442451    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:08.541314 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:08.541290    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:08.772177 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:08.772152    2556 generic.go:356] "Generic (PLEG): container finished" podID="88d752ab-85cf-45db-a183-69b7fe7dba91" containerID="39eefe7103aa0780adab0f8e3955e314eedd95087f4a9eb87c373a9845000bdd" exitCode=0
Jul 16 09:10:08.772276 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:08.772236    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p42cn" event={"ID":"88d752ab-85cf-45db-a183-69b7fe7dba91","Type":"ContainerDied","Data":"39eefe7103aa0780adab0f8e3955e314eedd95087f4a9eb87c373a9845000bdd"}
Jul 16 09:10:08.774798 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:08.774743    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4" event={"ID":"9531550f-e7e9-45b1-9150-4cfcbd7c9c58","Type":"ContainerStarted","Data":"1f8fc023632c37e5c2b7d04d7b58a4bce44a92f68082a2942cccbbf73d5eb4d3"}
Jul 16 09:10:08.777128 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:08.777107    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg" event={"ID":"e2757296-21d1-41e8-87df-8a91675ac30e","Type":"ContainerStarted","Data":"a826c62846d0413ad8ad74cdfd9e413ce973c28e34de8873f43fb2d629876eb0"}
Jul 16 09:10:08.777236 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:08.777151    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg" event={"ID":"e2757296-21d1-41e8-87df-8a91675ac30e","Type":"ContainerStarted","Data":"4d27e1fc4e3070af4e2b41a9f524cc2c91dd847e615e163f1f9b412e3164e8a5"}
Jul 16 09:10:08.777236 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:08.777169    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg" event={"ID":"e2757296-21d1-41e8-87df-8a91675ac30e","Type":"ContainerStarted","Data":"5a2b3f65938fde1c13eb0b4287a4265cac92cbcd37e8ead91b3260873a44ae8d"}
Jul 16 09:10:08.781254 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:08.781234    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:10:08.840447 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:08.840029    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-2rkf4" podStartSLOduration=1.8890926879999999 podStartE2EDuration="3.840009513s" totalImagesPullingTime="1.950916825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:10:08.838990847 +0000 UTC m=+316.662842417" watchObservedRunningTime="2026-07-16 09:10:08.840009513 +0000 UTC m=+316.663861085"
Jul 16 09:10:08.861084 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:08.861036    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-9vsfg" podStartSLOduration=2.4326068960000002 podStartE2EDuration="3.861015681s" totalImagesPullingTime="1.428408785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:10:08.860814122 +0000 UTC m=+316.684665703" watchObservedRunningTime="2026-07-16 09:10:08.861015681 +0000 UTC m=+316.684867250"
Jul 16 09:10:09.091865 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:09.091789    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:09.161305 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:09.161273    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:09.489555 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:09.489525    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:09.675398 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:09.675365    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:09.786547 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:09.786459    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p42cn" event={"ID":"88d752ab-85cf-45db-a183-69b7fe7dba91","Type":"ContainerStarted","Data":"f4696aeaf4f4c902d61a91422444541f644421d0bb637b37b640f5077b2f72a6"}
Jul 16 09:10:09.786689 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:09.786555    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p42cn" event={"ID":"88d752ab-85cf-45db-a183-69b7fe7dba91","Type":"ContainerStarted","Data":"fd504e60559e4e62f2f5dbe1e6d0a30d7f2a5ad4f2c96d9f39c4a4b9cec66814"}
Jul 16 09:10:09.808808 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:09.808766    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p42cn" podStartSLOduration=1.605531705 podStartE2EDuration="3.808725688s" totalImagesPullingTime="2.120855463s" totalInitContainerRuntime="82.33852ms" isStatefulPod=true podCreationTimestamp="2026-07-16 09:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:10:09.807408084 +0000 UTC m=+317.631259654" watchObservedRunningTime="2026-07-16 09:10:09.808725688 +0000 UTC m=+317.632577256"
Jul 16 09:10:10.164956 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:10.164922    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:10.452468 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:10.452384    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:10.712729 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:10.712667    2556 scope.go:117] "RemoveContainer" containerID="0025bdd841f1f494e09a93c0df9c0f34874bc811ed49be309824ce819f6ebdad"
Jul 16 09:10:10.791684 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:10.791655    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c" event={"ID":"03e234ed-9742-403c-a4ec-dc65282f7ba4","Type":"ContainerStarted","Data":"a090d5399537327b1794598da28105636dbb0a42bdac3ac62b1e7fe45fbe7216"}
Jul 16 09:10:10.792019 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:10.791994    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:10:10.792933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:10.792907    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c" podUID="03e234ed-9742-403c-a4ec-dc65282f7ba4" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused"
Jul 16 09:10:10.800434 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:10.800407    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:10.868803 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:10.868763    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:11.063723 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:11.063651    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:11.797138 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:11.797104    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g8rpt" event={"ID":"3d0169f2-e8bd-4351-936c-f387521d6175","Type":"ContainerStarted","Data":"f7bd38f58907868ce812883d24e931bf3587f208f345fa07420d39e95ff229f2"}
Jul 16 09:10:11.798264 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:11.798239    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bf77557-k4z8c"
Jul 16 09:10:11.817786 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:11.817746    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g8rpt" podStartSLOduration=16.781749534 podStartE2EDuration="45.817733783s" totalImagesPullingTime="29.035984249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:09:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-16 09:10:11.816659857 +0000 UTC m=+319.640511453" watchObservedRunningTime="2026-07-16 09:10:11.817733783 +0000 UTC m=+319.641585353"
Jul 16 09:10:12.059420 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:12.059286    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:12.162277 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:12.162245    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:12.487705 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:12.487671    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:13.796848 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:13.796817    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cdf5748c-ndjml"]
Jul 16 09:10:13.870609 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:13.870569    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:15.078416 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:15.078376    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:15.162565 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:15.162532    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:15.222157 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:15.222122    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:19.198029 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:19.198003    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:19.257839 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:19.257814    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:25.920614 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:25.920580    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f74f96f5c-cnvgq"]
Jul 16 09:10:26.053116 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:26.053085    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:26.153993 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:26.153967    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:26.253894 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:26.253824    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:26.321989 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:26.321964    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:29.345762 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:29.345733    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:29.410526 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:29.410496    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:32.045328 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:32.045300    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67bcfd8b64-c689b_bfa44217-2dd9-4774-8030-59a4a3754b6c/router/0.log"
Jul 16 09:10:32.065135 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:32.065110    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r4nxb_364f1f1a-63c3-4132-a787-1d516c2ee60a/serve-healthcheck-canary/0.log"
Jul 16 09:10:34.365976 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:34.365945    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:34.431982 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:34.431954    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:38.817367 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:38.817304    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml" podUID="fca9065a-bd2e-4622-a18e-8a126ad46f57" containerName="registry" containerID="cri-o://c9b22898c248d9183693ace67c5c1c5519f49d862a324723ae9161b2cc8fa8a6" gracePeriod=30
Jul 16 09:10:39.057561 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.057536    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:10:39.250740 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.250716    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-bound-sa-token\") pod \"fca9065a-bd2e-4622-a18e-8a126ad46f57\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") "
Jul 16 09:10:39.250883 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.250774    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls\") pod \"fca9065a-bd2e-4622-a18e-8a126ad46f57\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") "
Jul 16 09:10:39.250883 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.250803    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fca9065a-bd2e-4622-a18e-8a126ad46f57-trusted-ca\") pod \"fca9065a-bd2e-4622-a18e-8a126ad46f57\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") "
Jul 16 09:10:39.250883 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.250830    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hltbm\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-kube-api-access-hltbm\") pod \"fca9065a-bd2e-4622-a18e-8a126ad46f57\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") "
Jul 16 09:10:39.250883 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.250855    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fca9065a-bd2e-4622-a18e-8a126ad46f57-ca-trust-extracted\") pod \"fca9065a-bd2e-4622-a18e-8a126ad46f57\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") "
Jul 16 09:10:39.251085 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.251015    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fca9065a-bd2e-4622-a18e-8a126ad46f57-installation-pull-secrets\") pod \"fca9065a-bd2e-4622-a18e-8a126ad46f57\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") "
Jul 16 09:10:39.251132 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.251096    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fca9065a-bd2e-4622-a18e-8a126ad46f57-image-registry-private-configuration\") pod \"fca9065a-bd2e-4622-a18e-8a126ad46f57\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") "
Jul 16 09:10:39.251132 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.251125    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-certificates\") pod \"fca9065a-bd2e-4622-a18e-8a126ad46f57\" (UID: \"fca9065a-bd2e-4622-a18e-8a126ad46f57\") "
Jul 16 09:10:39.251712 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.251493    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fca9065a-bd2e-4622-a18e-8a126ad46f57-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fca9065a-bd2e-4622-a18e-8a126ad46f57" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:10:39.251712 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.251682    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fca9065a-bd2e-4622-a18e-8a126ad46f57" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:10:39.253751 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.253711    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fca9065a-bd2e-4622-a18e-8a126ad46f57-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fca9065a-bd2e-4622-a18e-8a126ad46f57" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:10:39.253875 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.253780    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-kube-api-access-hltbm" (OuterVolumeSpecName: "kube-api-access-hltbm") pod "fca9065a-bd2e-4622-a18e-8a126ad46f57" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57"). InnerVolumeSpecName "kube-api-access-hltbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:10:39.253875 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.253818    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fca9065a-bd2e-4622-a18e-8a126ad46f57-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fca9065a-bd2e-4622-a18e-8a126ad46f57" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:10:39.253875 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.253859    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fca9065a-bd2e-4622-a18e-8a126ad46f57" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:10:39.254032 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.253860    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fca9065a-bd2e-4622-a18e-8a126ad46f57" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:10:39.259626 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.259605    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca9065a-bd2e-4622-a18e-8a126ad46f57-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fca9065a-bd2e-4622-a18e-8a126ad46f57" (UID: "fca9065a-bd2e-4622-a18e-8a126ad46f57"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:10:39.352248 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.352226    2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fca9065a-bd2e-4622-a18e-8a126ad46f57-image-registry-private-configuration\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:10:39.352248 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.352245    2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-certificates\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:10:39.352388 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.352256    2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-bound-sa-token\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:10:39.352388 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.352267    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-registry-tls\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:10:39.352388 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.352275    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fca9065a-bd2e-4622-a18e-8a126ad46f57-trusted-ca\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:10:39.352388 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.352282    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hltbm\" (UniqueName: \"kubernetes.io/projected/fca9065a-bd2e-4622-a18e-8a126ad46f57-kube-api-access-hltbm\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:10:39.352388 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.352290    2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fca9065a-bd2e-4622-a18e-8a126ad46f57-ca-trust-extracted\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:10:39.352388 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.352299    2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fca9065a-bd2e-4622-a18e-8a126ad46f57-installation-pull-secrets\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:10:39.899226 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.899195    2556 generic.go:356] "Generic (PLEG): container finished" podID="fca9065a-bd2e-4622-a18e-8a126ad46f57" containerID="c9b22898c248d9183693ace67c5c1c5519f49d862a324723ae9161b2cc8fa8a6" exitCode=0
Jul 16 09:10:39.899625 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.899237    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml"
Jul 16 09:10:39.899625 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.899266    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml" event={"ID":"fca9065a-bd2e-4622-a18e-8a126ad46f57","Type":"ContainerDied","Data":"c9b22898c248d9183693ace67c5c1c5519f49d862a324723ae9161b2cc8fa8a6"}
Jul 16 09:10:39.899625 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.899312    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cdf5748c-ndjml" event={"ID":"fca9065a-bd2e-4622-a18e-8a126ad46f57","Type":"ContainerDied","Data":"aeda5851925c0bc1fb611d2c8aa63c180bff0d5e3cb50155c2e581e8bc5bb619"}
Jul 16 09:10:39.899625 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.899334    2556 scope.go:117] "RemoveContainer" containerID="c9b22898c248d9183693ace67c5c1c5519f49d862a324723ae9161b2cc8fa8a6"
Jul 16 09:10:39.907674 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.907657    2556 scope.go:117] "RemoveContainer" containerID="c9b22898c248d9183693ace67c5c1c5519f49d862a324723ae9161b2cc8fa8a6"
Jul 16 09:10:39.907907 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:10:39.907887    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b22898c248d9183693ace67c5c1c5519f49d862a324723ae9161b2cc8fa8a6\": container with ID starting with c9b22898c248d9183693ace67c5c1c5519f49d862a324723ae9161b2cc8fa8a6 not found: ID does not exist" containerID="c9b22898c248d9183693ace67c5c1c5519f49d862a324723ae9161b2cc8fa8a6"
Jul 16 09:10:39.907965 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.907918    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b22898c248d9183693ace67c5c1c5519f49d862a324723ae9161b2cc8fa8a6"} err="failed to get container status \"c9b22898c248d9183693ace67c5c1c5519f49d862a324723ae9161b2cc8fa8a6\": rpc error: code = NotFound desc = could not find container \"c9b22898c248d9183693ace67c5c1c5519f49d862a324723ae9161b2cc8fa8a6\": container with ID starting with c9b22898c248d9183693ace67c5c1c5519f49d862a324723ae9161b2cc8fa8a6 not found: ID does not exist"
Jul 16 09:10:39.920985 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.920963    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cdf5748c-ndjml"]
Jul 16 09:10:39.926105 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:39.926087    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cdf5748c-ndjml"]
Jul 16 09:10:40.716904 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:40.716873    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fca9065a-bd2e-4622-a18e-8a126ad46f57" path="/var/lib/kubelet/pods/fca9065a-bd2e-4622-a18e-8a126ad46f57/volumes"
Jul 16 09:10:45.922625 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:45.922592    2556 generic.go:356] "Generic (PLEG): container finished" podID="a8c3e4dc-5cd5-4ee5-98df-312d867b3933" containerID="26f212d931649b782c11812c5950923d082a411b1c0c5fd7cdf7fd5f33e58549" exitCode=0
Jul 16 09:10:45.922973 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:45.922649    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp" event={"ID":"a8c3e4dc-5cd5-4ee5-98df-312d867b3933","Type":"ContainerDied","Data":"26f212d931649b782c11812c5950923d082a411b1c0c5fd7cdf7fd5f33e58549"}
Jul 16 09:10:45.922973 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:45.922921    2556 scope.go:117] "RemoveContainer" containerID="26f212d931649b782c11812c5950923d082a411b1c0c5fd7cdf7fd5f33e58549"
Jul 16 09:10:46.927697 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:46.927665    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7h5tp" event={"ID":"a8c3e4dc-5cd5-4ee5-98df-312d867b3933","Type":"ContainerStarted","Data":"3cccca292d53ddc7e0a0aae7a887c734bf7b93d8673ac9754715e3a59c038a1e"}
Jul 16 09:10:50.940259 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:50.940203    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f74f96f5c-cnvgq" podUID="16581f4e-613e-44da-a399-08d4f6d5e157" containerName="console" containerID="cri-o://a8aac055ec6ce8bb3cd9673aa5535d0f2c71b7e41c4661be5bc1cef9b319bb62" gracePeriod=15
Jul 16 09:10:51.179451 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.179429    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:10:51.240877 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.240817    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16581f4e-613e-44da-a399-08d4f6d5e157-console-oauth-config\") pod \"16581f4e-613e-44da-a399-08d4f6d5e157\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") "
Jul 16 09:10:51.240877 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.240857    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16581f4e-613e-44da-a399-08d4f6d5e157-console-serving-cert\") pod \"16581f4e-613e-44da-a399-08d4f6d5e157\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") "
Jul 16 09:10:51.241134 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.240890    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-service-ca\") pod \"16581f4e-613e-44da-a399-08d4f6d5e157\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") "
Jul 16 09:10:51.241134 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.240907    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-oauth-serving-cert\") pod \"16581f4e-613e-44da-a399-08d4f6d5e157\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") "
Jul 16 09:10:51.241134 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.240945    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvgmk\" (UniqueName: \"kubernetes.io/projected/16581f4e-613e-44da-a399-08d4f6d5e157-kube-api-access-lvgmk\") pod \"16581f4e-613e-44da-a399-08d4f6d5e157\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") "
Jul 16 09:10:51.241134 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.240968    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-console-config\") pod \"16581f4e-613e-44da-a399-08d4f6d5e157\" (UID: \"16581f4e-613e-44da-a399-08d4f6d5e157\") "
Jul 16 09:10:51.241412 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.241375    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-service-ca" (OuterVolumeSpecName: "service-ca") pod "16581f4e-613e-44da-a399-08d4f6d5e157" (UID: "16581f4e-613e-44da-a399-08d4f6d5e157"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:10:51.241412 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.241401    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "16581f4e-613e-44da-a399-08d4f6d5e157" (UID: "16581f4e-613e-44da-a399-08d4f6d5e157"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:10:51.241519 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.241490    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-console-config" (OuterVolumeSpecName: "console-config") pod "16581f4e-613e-44da-a399-08d4f6d5e157" (UID: "16581f4e-613e-44da-a399-08d4f6d5e157"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:10:51.243014 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.242992    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16581f4e-613e-44da-a399-08d4f6d5e157-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "16581f4e-613e-44da-a399-08d4f6d5e157" (UID: "16581f4e-613e-44da-a399-08d4f6d5e157"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:10:51.243459 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.243437    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16581f4e-613e-44da-a399-08d4f6d5e157-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "16581f4e-613e-44da-a399-08d4f6d5e157" (UID: "16581f4e-613e-44da-a399-08d4f6d5e157"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:10:51.243552 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.243469    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16581f4e-613e-44da-a399-08d4f6d5e157-kube-api-access-lvgmk" (OuterVolumeSpecName: "kube-api-access-lvgmk") pod "16581f4e-613e-44da-a399-08d4f6d5e157" (UID: "16581f4e-613e-44da-a399-08d4f6d5e157"). InnerVolumeSpecName "kube-api-access-lvgmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:10:51.341955 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.341916    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16581f4e-613e-44da-a399-08d4f6d5e157-console-oauth-config\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:10:51.341955 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.341951    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16581f4e-613e-44da-a399-08d4f6d5e157-console-serving-cert\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:10:51.341955 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.341964    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-service-ca\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:10:51.342143 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.341977    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-oauth-serving-cert\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:10:51.342143 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.341989    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvgmk\" (UniqueName: \"kubernetes.io/projected/16581f4e-613e-44da-a399-08d4f6d5e157-kube-api-access-lvgmk\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:10:51.342143 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.342001    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16581f4e-613e-44da-a399-08d4f6d5e157-console-config\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:10:51.524674 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.524607    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:51.624824 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.624794    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:10:51.945471 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.945444    2556 generic.go:356] "Generic (PLEG): container finished" podID="16581f4e-613e-44da-a399-08d4f6d5e157" containerID="a8aac055ec6ce8bb3cd9673aa5535d0f2c71b7e41c4661be5bc1cef9b319bb62" exitCode=0
Jul 16 09:10:51.945826 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.945490    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f74f96f5c-cnvgq"
Jul 16 09:10:51.945826 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.945518    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f74f96f5c-cnvgq" event={"ID":"16581f4e-613e-44da-a399-08d4f6d5e157","Type":"ContainerDied","Data":"a8aac055ec6ce8bb3cd9673aa5535d0f2c71b7e41c4661be5bc1cef9b319bb62"}
Jul 16 09:10:51.945826 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.945563    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f74f96f5c-cnvgq" event={"ID":"16581f4e-613e-44da-a399-08d4f6d5e157","Type":"ContainerDied","Data":"cfb051ee3cc0a3c7f0b7f59ca1be71a7efdaf0d59dbbbc3f169a2361056fde6b"}
Jul 16 09:10:51.945826 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.945583    2556 scope.go:117] "RemoveContainer" containerID="a8aac055ec6ce8bb3cd9673aa5535d0f2c71b7e41c4661be5bc1cef9b319bb62"
Jul 16 09:10:51.953111 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.953092    2556 scope.go:117] "RemoveContainer" containerID="a8aac055ec6ce8bb3cd9673aa5535d0f2c71b7e41c4661be5bc1cef9b319bb62"
Jul 16 09:10:51.953400 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:10:51.953374    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8aac055ec6ce8bb3cd9673aa5535d0f2c71b7e41c4661be5bc1cef9b319bb62\": container with ID starting with a8aac055ec6ce8bb3cd9673aa5535d0f2c71b7e41c4661be5bc1cef9b319bb62 not found: ID does not exist" containerID="a8aac055ec6ce8bb3cd9673aa5535d0f2c71b7e41c4661be5bc1cef9b319bb62"
Jul 16 09:10:51.953496 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.953411    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8aac055ec6ce8bb3cd9673aa5535d0f2c71b7e41c4661be5bc1cef9b319bb62"} err="failed to get container status \"a8aac055ec6ce8bb3cd9673aa5535d0f2c71b7e41c4661be5bc1cef9b319bb62\": rpc error: code = NotFound desc = could not find container \"a8aac055ec6ce8bb3cd9673aa5535d0f2c71b7e41c4661be5bc1cef9b319bb62\": container with ID starting with a8aac055ec6ce8bb3cd9673aa5535d0f2c71b7e41c4661be5bc1cef9b319bb62 not found: ID does not exist"
Jul 16 09:10:51.967312 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.967292    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f74f96f5c-cnvgq"]
Jul 16 09:10:51.971156 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:51.971136    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f74f96f5c-cnvgq"]
Jul 16 09:10:52.717071 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:10:52.717037    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16581f4e-613e-44da-a399-08d4f6d5e157" path="/var/lib/kubelet/pods/16581f4e-613e-44da-a399-08d4f6d5e157/volumes"
Jul 16 09:11:06.450201 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:06.450165    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:11:06.452412 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:06.452395    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690-metrics-certs\") pod \"network-metrics-daemon-sbf5q\" (UID: \"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690\") " pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:11:06.617412 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:06.617388    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h777f\""
Jul 16 09:11:06.625270 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:06.625247    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbf5q"
Jul 16 09:11:06.751905 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:06.751881    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sbf5q"]
Jul 16 09:11:06.754295 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:11:06.754260    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda30f0ab4_d635_4c98_b9f2_a4d2a2cf6690.slice/crio-d1e762c61315872ed791e59d23ee7907f4eec3e6f793e2ac0fabd643dde517b8 WatchSource:0}: Error finding container d1e762c61315872ed791e59d23ee7907f4eec3e6f793e2ac0fabd643dde517b8: Status 404 returned error can't find the container with id d1e762c61315872ed791e59d23ee7907f4eec3e6f793e2ac0fabd643dde517b8
Jul 16 09:11:06.997776 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:06.997689    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sbf5q" event={"ID":"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690","Type":"ContainerStarted","Data":"d1e762c61315872ed791e59d23ee7907f4eec3e6f793e2ac0fabd643dde517b8"}
Jul 16 09:11:08.002770 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:08.002698    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sbf5q" event={"ID":"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690","Type":"ContainerStarted","Data":"a49ea74f4f130d5079d3664a32ace86553e2bec7d0ffa5b9c85d962a30abf49d"}
Jul 16 09:11:08.002770 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:08.002761    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sbf5q" event={"ID":"a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690","Type":"ContainerStarted","Data":"9de408f924907a0fad67e74a3284ee70821cbb7a062fe7e3e23becf0213c617e"}
Jul 16 09:11:08.020129 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:08.020088    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sbf5q" podStartSLOduration=374.039699713 podStartE2EDuration="6m15.020073307s" totalImagesPullingTime="980.373594ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:11:08.018853471 +0000 UTC m=+375.842705051" watchObservedRunningTime="2026-07-16 09:11:08.020073307 +0000 UTC m=+375.843924875"
Jul 16 09:11:08.115402 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:08.115376    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:11:08.214135 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:08.214113    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:11:18.365825 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:18.365790    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:11:18.427112 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:18.427086    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:11:25.438664 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:25.438633    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:11:25.538845 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:25.538812    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:11:30.523669 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.523640    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"]
Jul 16 09:11:30.524041 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.523932    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca9065a-bd2e-4622-a18e-8a126ad46f57" containerName="registry"
Jul 16 09:11:30.524041 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.523945    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca9065a-bd2e-4622-a18e-8a126ad46f57" containerName="registry"
Jul 16 09:11:30.524041 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.523967    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16581f4e-613e-44da-a399-08d4f6d5e157" containerName="console"
Jul 16 09:11:30.524041 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.523972    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="16581f4e-613e-44da-a399-08d4f6d5e157" containerName="console"
Jul 16 09:11:30.524041 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.524018    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fca9065a-bd2e-4622-a18e-8a126ad46f57" containerName="registry"
Jul 16 09:11:30.524041 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.524026    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="16581f4e-613e-44da-a399-08d4f6d5e157" containerName="console"
Jul 16 09:11:30.527815 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.527792    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.530150 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.530127    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 16 09:11:30.530773 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.530750    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 16 09:11:30.530875 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.530813    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 16 09:11:30.531195 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.531177    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 16 09:11:30.531361 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.531330    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 16 09:11:30.533680 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.533658    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2jvb9\""
Jul 16 09:11:30.537414 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.537395    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 16 09:11:30.542795 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.542761    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"]
Jul 16 09:11:30.611022 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.610991    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd51500e-ae0a-4796-b497-5da8825a2640-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.611022 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.611023    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd259\" (UniqueName: \"kubernetes.io/projected/fd51500e-ae0a-4796-b497-5da8825a2640-kube-api-access-sd259\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.611205 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.611045    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fd51500e-ae0a-4796-b497-5da8825a2640-telemeter-client-tls\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.611205 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.611063    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd51500e-ae0a-4796-b497-5da8825a2640-serving-certs-ca-bundle\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.611205 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.611086    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fd51500e-ae0a-4796-b497-5da8825a2640-federate-client-tls\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.611205 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.611117    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fd51500e-ae0a-4796-b497-5da8825a2640-secret-telemeter-client\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.611205 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.611139    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd51500e-ae0a-4796-b497-5da8825a2640-metrics-client-ca\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.611205 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.611158    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd51500e-ae0a-4796-b497-5da8825a2640-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.712180 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.712152    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd51500e-ae0a-4796-b497-5da8825a2640-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.712372 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.712184    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd259\" (UniqueName: \"kubernetes.io/projected/fd51500e-ae0a-4796-b497-5da8825a2640-kube-api-access-sd259\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.712372 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.712206    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fd51500e-ae0a-4796-b497-5da8825a2640-telemeter-client-tls\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.712372 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.712226    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd51500e-ae0a-4796-b497-5da8825a2640-serving-certs-ca-bundle\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.712372 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.712247    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fd51500e-ae0a-4796-b497-5da8825a2640-federate-client-tls\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.712372 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.712271    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fd51500e-ae0a-4796-b497-5da8825a2640-secret-telemeter-client\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.712372 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.712296    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd51500e-ae0a-4796-b497-5da8825a2640-metrics-client-ca\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.712372 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.712325    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd51500e-ae0a-4796-b497-5da8825a2640-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.713283 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.713212    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd51500e-ae0a-4796-b497-5da8825a2640-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.713412 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.713305    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd51500e-ae0a-4796-b497-5da8825a2640-metrics-client-ca\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.713412 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.713318    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd51500e-ae0a-4796-b497-5da8825a2640-serving-certs-ca-bundle\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.715087 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.715065    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fd51500e-ae0a-4796-b497-5da8825a2640-telemeter-client-tls\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.715243 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.715215    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fd51500e-ae0a-4796-b497-5da8825a2640-federate-client-tls\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.715505 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.715480    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd51500e-ae0a-4796-b497-5da8825a2640-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.715585 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.715503    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fd51500e-ae0a-4796-b497-5da8825a2640-secret-telemeter-client\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.722459 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.722413    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd259\" (UniqueName: \"kubernetes.io/projected/fd51500e-ae0a-4796-b497-5da8825a2640-kube-api-access-sd259\") pod \"telemeter-client-5dfb8c8f9c-tp6kn\" (UID: \"fd51500e-ae0a-4796-b497-5da8825a2640\") " pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.838623 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.838333    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"
Jul 16 09:11:30.992575 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:30.992549    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn"]
Jul 16 09:11:30.995011 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:11:30.994981    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd51500e_ae0a_4796_b497_5da8825a2640.slice/crio-1d2be08ea0fd131fded49792358faf54d6a6923e9967bd570f6ab19e91b62468 WatchSource:0}: Error finding container 1d2be08ea0fd131fded49792358faf54d6a6923e9967bd570f6ab19e91b62468: Status 404 returned error can't find the container with id 1d2be08ea0fd131fded49792358faf54d6a6923e9967bd570f6ab19e91b62468
Jul 16 09:11:31.089397 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:31.089295    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn" event={"ID":"fd51500e-ae0a-4796-b497-5da8825a2640","Type":"ContainerStarted","Data":"1d2be08ea0fd131fded49792358faf54d6a6923e9967bd570f6ab19e91b62468"}
Jul 16 09:11:33.098191 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:33.098156    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn" event={"ID":"fd51500e-ae0a-4796-b497-5da8825a2640","Type":"ContainerStarted","Data":"f935aa34105ae1f477cd9d38e1ed3c6a891c833616b55cc90e00da328d81cf61"}
Jul 16 09:11:34.104148 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.104114    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn" event={"ID":"fd51500e-ae0a-4796-b497-5da8825a2640","Type":"ContainerStarted","Data":"2795da47257ed0d03af58cf09e096d7aa75750b8de08e67e8ee8db641498192b"}
Jul 16 09:11:34.104498 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.104200    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn" event={"ID":"fd51500e-ae0a-4796-b497-5da8825a2640","Type":"ContainerStarted","Data":"d83f4560835b4b7404bc8d53a6e5510b63c67f591d7595a399a0a8599a5bbd4c"}
Jul 16 09:11:34.127165 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.127118    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5dfb8c8f9c-tp6kn" podStartSLOduration=1.261713056 podStartE2EDuration="4.127098692s" totalImagesPullingTime="2.865385636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:11:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:11:34.125766048 +0000 UTC m=+401.949617618" watchObservedRunningTime="2026-07-16 09:11:34.127098692 +0000 UTC m=+401.950950263"
Jul 16 09:11:34.843581 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.843551    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bc545998c-t2wkw"]
Jul 16 09:11:34.846832 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.846810    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:34.849778 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.849754    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 09:11:34.850495 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.850476    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 09:11:34.850615 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.850597    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 09:11:34.850706 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.850690    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 09:11:34.850765 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.850711    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 09:11:34.850946 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.850929    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 09:11:34.851016 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.850951    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mzcd6\""
Jul 16 09:11:34.851016 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.850934    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 09:11:34.856800 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.856784    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 16 09:11:34.859891 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.859873    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc545998c-t2wkw"]
Jul 16 09:11:34.947333 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.947303    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-oauth-config\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:34.947333 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.947334    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-serving-cert\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:34.947518 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.947371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-trusted-ca-bundle\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:34.947518 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.947441    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-oauth-serving-cert\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:34.947518 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.947486    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-service-ca\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:34.947518 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.947506    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf7kz\" (UniqueName: \"kubernetes.io/projected/834997c8-94f1-4a78-a5ed-06cd48cfecdd-kube-api-access-wf7kz\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:34.947681 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.947537    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-config\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:34.991932 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:34.991896    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:11:35.048708 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.048679    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-oauth-config\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.048708 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.048710    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-serving-cert\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.048895 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.048727    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-trusted-ca-bundle\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.048895 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.048744    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-oauth-serving-cert\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.048895 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.048767    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-service-ca\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.048895 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.048790    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf7kz\" (UniqueName: \"kubernetes.io/projected/834997c8-94f1-4a78-a5ed-06cd48cfecdd-kube-api-access-wf7kz\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.049073 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.048928    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-config\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.049582 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.049558    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-service-ca\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.049666 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.049607    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-oauth-serving-cert\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.049666 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.049610    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-config\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.049666 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.049661    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-trusted-ca-bundle\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.051411 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.051389    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-serving-cert\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.051498 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.051392    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-oauth-config\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.057051 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.057018    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf7kz\" (UniqueName: \"kubernetes.io/projected/834997c8-94f1-4a78-a5ed-06cd48cfecdd-kube-api-access-wf7kz\") pod \"console-6bc545998c-t2wkw\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") " pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.092175 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.092153    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:11:35.157069 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.157013    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:35.281146 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.281117    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc545998c-t2wkw"]
Jul 16 09:11:35.285509 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:11:35.285486    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834997c8_94f1_4a78_a5ed_06cd48cfecdd.slice/crio-e332df40beebc524f977ea9aa6b6ad4f76f83dd9701b9a64fb17249eb7eb2da5 WatchSource:0}: Error finding container e332df40beebc524f977ea9aa6b6ad4f76f83dd9701b9a64fb17249eb7eb2da5: Status 404 returned error can't find the container with id e332df40beebc524f977ea9aa6b6ad4f76f83dd9701b9a64fb17249eb7eb2da5
Jul 16 09:11:35.645372 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.645325    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:11:35.747935 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:35.747910    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:11:36.113392 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:36.113361    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc545998c-t2wkw" event={"ID":"834997c8-94f1-4a78-a5ed-06cd48cfecdd","Type":"ContainerStarted","Data":"e56d78946a76c4dd82535d0b8e01bc8c49100c4aa0b2b2156583077a8c338b64"}
Jul 16 09:11:36.113528 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:36.113413    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc545998c-t2wkw" event={"ID":"834997c8-94f1-4a78-a5ed-06cd48cfecdd","Type":"ContainerStarted","Data":"e332df40beebc524f977ea9aa6b6ad4f76f83dd9701b9a64fb17249eb7eb2da5"}
Jul 16 09:11:36.130804 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:36.130736    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bc545998c-t2wkw" podStartSLOduration=2.130718463 podStartE2EDuration="2.130718463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:11:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:11:36.129889773 +0000 UTC m=+403.953741353" watchObservedRunningTime="2026-07-16 09:11:36.130718463 +0000 UTC m=+403.954570071"
Jul 16 09:11:40.739509 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:40.739477    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:11:40.842061 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:40.842027    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:11:45.158101 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:45.158064    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:45.158567 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:45.158129    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:45.163685 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:45.163662    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:46.151715 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:46.151680    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:11:46.310207 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:46.310145    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:11:46.411512 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:46.411487    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:11:46.465649 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:11:46.465626    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:02.230555 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:02.230482    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:02.292085 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:02.292056    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:38.084155 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:38.084122    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:40.710554 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:40.710499    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:40.810683 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:40.810655    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:41.693405 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.693370    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57fdc5767f-snltt"]
Jul 16 09:12:41.695479 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.695456    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.711874 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.711851    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fdc5767f-snltt"]
Jul 16 09:12:41.734099 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.734071    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-trusted-ca-bundle\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.734223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.734110    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-config\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.734223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.734137    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-oauth-serving-cert\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.734223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.734203    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-oauth-config\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.734333 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.734269    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-serving-cert\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.734333 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.734316    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-service-ca\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.734463 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.734382    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzfvt\" (UniqueName: \"kubernetes.io/projected/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-kube-api-access-zzfvt\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.760699 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.760674    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:41.823522 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.823494    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:41.835106 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.835085    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-service-ca\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.835199 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.835112    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzfvt\" (UniqueName: \"kubernetes.io/projected/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-kube-api-access-zzfvt\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.835199 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.835136    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-trusted-ca-bundle\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.835199 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.835186    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-config\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.835313 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.835228    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-oauth-serving-cert\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.835313 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.835274    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-oauth-config\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.835434 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.835315    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-serving-cert\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.836098 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.836073    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-service-ca\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.836179 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.836073    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-config\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.836179 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.836082    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-trusted-ca-bundle\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.836179 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.836114    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-oauth-serving-cert\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.837722 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.837703    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-oauth-config\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.837813 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.837799    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-serving-cert\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:41.842676 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:41.842649    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzfvt\" (UniqueName: \"kubernetes.io/projected/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-kube-api-access-zzfvt\") pod \"console-57fdc5767f-snltt\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") " pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:42.005145 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:42.005061    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:42.131926 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:42.131899    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fdc5767f-snltt"]
Jul 16 09:12:42.134272 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:12:42.134238    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f15fe4_5866_4b3b_91ad_3c33e72dd32a.slice/crio-b1b22d19ca6a7043dc85878bdd38ed5a51ee2369ae287c5fe67b3b5c34ea24cb WatchSource:0}: Error finding container b1b22d19ca6a7043dc85878bdd38ed5a51ee2369ae287c5fe67b3b5c34ea24cb: Status 404 returned error can't find the container with id b1b22d19ca6a7043dc85878bdd38ed5a51ee2369ae287c5fe67b3b5c34ea24cb
Jul 16 09:12:42.350729 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:42.350639    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fdc5767f-snltt" event={"ID":"68f15fe4-5866-4b3b-91ad-3c33e72dd32a","Type":"ContainerStarted","Data":"997d03c1f9e810274454849c01aa0a60e03e86b60aa2c35aa846144d1dd8cf14"}
Jul 16 09:12:42.350729 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:42.350696    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fdc5767f-snltt" event={"ID":"68f15fe4-5866-4b3b-91ad-3c33e72dd32a","Type":"ContainerStarted","Data":"b1b22d19ca6a7043dc85878bdd38ed5a51ee2369ae287c5fe67b3b5c34ea24cb"}
Jul 16 09:12:42.370250 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:42.370190    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57fdc5767f-snltt" podStartSLOduration=1.370170412 podStartE2EDuration="1.370170412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:12:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:12:42.368427242 +0000 UTC m=+470.192278804" watchObservedRunningTime="2026-07-16 09:12:42.370170412 +0000 UTC m=+470.194021982"
Jul 16 09:12:49.362162 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:49.362126    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:52.005208 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:52.005165    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:52.005607 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:52.005239    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:52.010016 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:52.009996    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:52.390325 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:52.390243    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:12:52.463739 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:52.463703    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bc545998c-t2wkw"]
Jul 16 09:12:52.571286 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:52.571260    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:52.630536 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:52.630492    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:52.689547 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:52.689526    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:58.958775 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:58.958731    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:59.056999 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:59.056971    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:12:59.164195 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:12:59.164166    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:13:17.487427 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.487391    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bc545998c-t2wkw" podUID="834997c8-94f1-4a78-a5ed-06cd48cfecdd" containerName="console" containerID="cri-o://e56d78946a76c4dd82535d0b8e01bc8c49100c4aa0b2b2156583077a8c338b64" gracePeriod=15
Jul 16 09:13:17.725904 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.725880    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:13:17.886859 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.886777    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-serving-cert\") pod \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") "
Jul 16 09:13:17.886859 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.886827    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-oauth-config\") pod \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") "
Jul 16 09:13:17.886859 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.886851    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf7kz\" (UniqueName: \"kubernetes.io/projected/834997c8-94f1-4a78-a5ed-06cd48cfecdd-kube-api-access-wf7kz\") pod \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") "
Jul 16 09:13:17.887078 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.886877    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-config\") pod \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") "
Jul 16 09:13:17.887078 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.886918    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-oauth-serving-cert\") pod \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") "
Jul 16 09:13:17.887078 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.887055    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-trusted-ca-bundle\") pod \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") "
Jul 16 09:13:17.887225 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.887140    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-service-ca\") pod \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\" (UID: \"834997c8-94f1-4a78-a5ed-06cd48cfecdd\") "
Jul 16 09:13:17.887425 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.887399    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-config" (OuterVolumeSpecName: "console-config") pod "834997c8-94f1-4a78-a5ed-06cd48cfecdd" (UID: "834997c8-94f1-4a78-a5ed-06cd48cfecdd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:13:17.887425 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.887406    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "834997c8-94f1-4a78-a5ed-06cd48cfecdd" (UID: "834997c8-94f1-4a78-a5ed-06cd48cfecdd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:13:17.887649 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.887620    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "834997c8-94f1-4a78-a5ed-06cd48cfecdd" (UID: "834997c8-94f1-4a78-a5ed-06cd48cfecdd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:13:17.887696 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.887673    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-service-ca" (OuterVolumeSpecName: "service-ca") pod "834997c8-94f1-4a78-a5ed-06cd48cfecdd" (UID: "834997c8-94f1-4a78-a5ed-06cd48cfecdd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:13:17.889027 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.888990    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "834997c8-94f1-4a78-a5ed-06cd48cfecdd" (UID: "834997c8-94f1-4a78-a5ed-06cd48cfecdd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:13:17.889424 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.889404    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "834997c8-94f1-4a78-a5ed-06cd48cfecdd" (UID: "834997c8-94f1-4a78-a5ed-06cd48cfecdd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:13:17.889479 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.889421    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/834997c8-94f1-4a78-a5ed-06cd48cfecdd-kube-api-access-wf7kz" (OuterVolumeSpecName: "kube-api-access-wf7kz") pod "834997c8-94f1-4a78-a5ed-06cd48cfecdd" (UID: "834997c8-94f1-4a78-a5ed-06cd48cfecdd"). InnerVolumeSpecName "kube-api-access-wf7kz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:13:17.988220 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.988192    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-oauth-config\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:13:17.988220 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.988214    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf7kz\" (UniqueName: \"kubernetes.io/projected/834997c8-94f1-4a78-a5ed-06cd48cfecdd-kube-api-access-wf7kz\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:13:17.988220 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.988224    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-config\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:13:17.988441 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.988233    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-oauth-serving-cert\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:13:17.988441 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.988243    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-trusted-ca-bundle\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:13:17.988441 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.988250    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834997c8-94f1-4a78-a5ed-06cd48cfecdd-service-ca\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:13:17.988441 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:17.988258    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834997c8-94f1-4a78-a5ed-06cd48cfecdd-console-serving-cert\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:13:18.486007 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:18.485972    2556 generic.go:356] "Generic (PLEG): container finished" podID="834997c8-94f1-4a78-a5ed-06cd48cfecdd" containerID="e56d78946a76c4dd82535d0b8e01bc8c49100c4aa0b2b2156583077a8c338b64" exitCode=0
Jul 16 09:13:18.486191 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:18.486022    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc545998c-t2wkw"
Jul 16 09:13:18.486191 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:18.486065    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc545998c-t2wkw" event={"ID":"834997c8-94f1-4a78-a5ed-06cd48cfecdd","Type":"ContainerDied","Data":"e56d78946a76c4dd82535d0b8e01bc8c49100c4aa0b2b2156583077a8c338b64"}
Jul 16 09:13:18.486191 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:18.486126    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc545998c-t2wkw" event={"ID":"834997c8-94f1-4a78-a5ed-06cd48cfecdd","Type":"ContainerDied","Data":"e332df40beebc524f977ea9aa6b6ad4f76f83dd9701b9a64fb17249eb7eb2da5"}
Jul 16 09:13:18.486191 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:18.486153    2556 scope.go:117] "RemoveContainer" containerID="e56d78946a76c4dd82535d0b8e01bc8c49100c4aa0b2b2156583077a8c338b64"
Jul 16 09:13:18.494856 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:18.494683    2556 scope.go:117] "RemoveContainer" containerID="e56d78946a76c4dd82535d0b8e01bc8c49100c4aa0b2b2156583077a8c338b64"
Jul 16 09:13:18.495071 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:13:18.494921    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e56d78946a76c4dd82535d0b8e01bc8c49100c4aa0b2b2156583077a8c338b64\": container with ID starting with e56d78946a76c4dd82535d0b8e01bc8c49100c4aa0b2b2156583077a8c338b64 not found: ID does not exist" containerID="e56d78946a76c4dd82535d0b8e01bc8c49100c4aa0b2b2156583077a8c338b64"
Jul 16 09:13:18.495071 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:18.494944    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56d78946a76c4dd82535d0b8e01bc8c49100c4aa0b2b2156583077a8c338b64"} err="failed to get container status \"e56d78946a76c4dd82535d0b8e01bc8c49100c4aa0b2b2156583077a8c338b64\": rpc error: code = NotFound desc = could not find container \"e56d78946a76c4dd82535d0b8e01bc8c49100c4aa0b2b2156583077a8c338b64\": container with ID starting with e56d78946a76c4dd82535d0b8e01bc8c49100c4aa0b2b2156583077a8c338b64 not found: ID does not exist"
Jul 16 09:13:18.510502 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:18.510474    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bc545998c-t2wkw"]
Jul 16 09:13:18.515102 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:18.515085    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bc545998c-t2wkw"]
Jul 16 09:13:18.716880 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:13:18.716845    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="834997c8-94f1-4a78-a5ed-06cd48cfecdd" path="/var/lib/kubelet/pods/834997c8-94f1-4a78-a5ed-06cd48cfecdd/volumes"
Jul 16 09:14:01.942127 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:01.942055    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:02.076703 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:02.076669    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:02.733885 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:02.733856    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"]
Jul 16 09:14:02.734139 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:02.734128    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="834997c8-94f1-4a78-a5ed-06cd48cfecdd" containerName="console"
Jul 16 09:14:02.734192 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:02.734141    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="834997c8-94f1-4a78-a5ed-06cd48cfecdd" containerName="console"
Jul 16 09:14:02.734192 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:02.734186    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="834997c8-94f1-4a78-a5ed-06cd48cfecdd" containerName="console"
Jul 16 09:14:02.737414 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:02.737398    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"
Jul 16 09:14:02.740753 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:02.740733    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 09:14:02.741057 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:02.741042    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n6855\""
Jul 16 09:14:02.741117 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:02.741102    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 09:14:02.749129 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:02.749105    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"]
Jul 16 09:14:02.900781 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:02.900746    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07d713c2-2295-4409-b2fe-8f70cc3ff6af-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh\" (UID: \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"
Jul 16 09:14:02.900966 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:02.900792    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07d713c2-2295-4409-b2fe-8f70cc3ff6af-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh\" (UID: \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"
Jul 16 09:14:02.900966 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:02.900822    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbmtr\" (UniqueName: \"kubernetes.io/projected/07d713c2-2295-4409-b2fe-8f70cc3ff6af-kube-api-access-pbmtr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh\" (UID: \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"
Jul 16 09:14:03.002123 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:03.002032    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbmtr\" (UniqueName: \"kubernetes.io/projected/07d713c2-2295-4409-b2fe-8f70cc3ff6af-kube-api-access-pbmtr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh\" (UID: \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"
Jul 16 09:14:03.002123 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:03.002097    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07d713c2-2295-4409-b2fe-8f70cc3ff6af-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh\" (UID: \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"
Jul 16 09:14:03.002604 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:03.002128    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07d713c2-2295-4409-b2fe-8f70cc3ff6af-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh\" (UID: \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"
Jul 16 09:14:03.002604 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:03.002443    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07d713c2-2295-4409-b2fe-8f70cc3ff6af-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh\" (UID: \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"
Jul 16 09:14:03.002604 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:03.002477    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07d713c2-2295-4409-b2fe-8f70cc3ff6af-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh\" (UID: \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"
Jul 16 09:14:03.010693 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:03.010667    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbmtr\" (UniqueName: \"kubernetes.io/projected/07d713c2-2295-4409-b2fe-8f70cc3ff6af-kube-api-access-pbmtr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh\" (UID: \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"
Jul 16 09:14:03.046502 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:03.046472    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"
Jul 16 09:14:03.174942 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:03.174919    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"]
Jul 16 09:14:03.177320 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:14:03.177296    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d713c2_2295_4409_b2fe_8f70cc3ff6af.slice/crio-781bfd8ee23b92ac506ba1a843af94ce7d65e3f640163a62788b038659d1b353 WatchSource:0}: Error finding container 781bfd8ee23b92ac506ba1a843af94ce7d65e3f640163a62788b038659d1b353: Status 404 returned error can't find the container with id 781bfd8ee23b92ac506ba1a843af94ce7d65e3f640163a62788b038659d1b353
Jul 16 09:14:03.649613 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:03.649570    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh" event={"ID":"07d713c2-2295-4409-b2fe-8f70cc3ff6af","Type":"ContainerStarted","Data":"781bfd8ee23b92ac506ba1a843af94ce7d65e3f640163a62788b038659d1b353"}
Jul 16 09:14:10.679817 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:10.679779    2556 generic.go:356] "Generic (PLEG): container finished" podID="07d713c2-2295-4409-b2fe-8f70cc3ff6af" containerID="fd02a9334a306d04b622c1c6db12feb662063005947ad91adaf7bdaf609977f4" exitCode=0
Jul 16 09:14:10.680255 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:10.679843    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh" event={"ID":"07d713c2-2295-4409-b2fe-8f70cc3ff6af","Type":"ContainerDied","Data":"fd02a9334a306d04b622c1c6db12feb662063005947ad91adaf7bdaf609977f4"}
Jul 16 09:14:12.689198 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:12.689169    2556 generic.go:356] "Generic (PLEG): container finished" podID="07d713c2-2295-4409-b2fe-8f70cc3ff6af" containerID="20c3e79ee58920ebc66aecf21d88dbcad3a5b004876a526e52e54a2c66eb4bd4" exitCode=0
Jul 16 09:14:12.689519 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:12.689255    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh" event={"ID":"07d713c2-2295-4409-b2fe-8f70cc3ff6af","Type":"ContainerDied","Data":"20c3e79ee58920ebc66aecf21d88dbcad3a5b004876a526e52e54a2c66eb4bd4"}
Jul 16 09:14:19.719898 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:19.719871    2556 generic.go:356] "Generic (PLEG): container finished" podID="07d713c2-2295-4409-b2fe-8f70cc3ff6af" containerID="552f89337484ebef64546680978cfc2479570a5b25ad16fb247f000727426c28" exitCode=0
Jul 16 09:14:19.720189 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:19.719961    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh" event={"ID":"07d713c2-2295-4409-b2fe-8f70cc3ff6af","Type":"ContainerDied","Data":"552f89337484ebef64546680978cfc2479570a5b25ad16fb247f000727426c28"}
Jul 16 09:14:20.844144 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:20.844123    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"
Jul 16 09:14:20.946768 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:20.946743    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07d713c2-2295-4409-b2fe-8f70cc3ff6af-util\") pod \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\" (UID: \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\") "
Jul 16 09:14:20.946890 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:20.946781    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07d713c2-2295-4409-b2fe-8f70cc3ff6af-bundle\") pod \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\" (UID: \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\") "
Jul 16 09:14:20.946890 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:20.946811    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbmtr\" (UniqueName: \"kubernetes.io/projected/07d713c2-2295-4409-b2fe-8f70cc3ff6af-kube-api-access-pbmtr\") pod \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\" (UID: \"07d713c2-2295-4409-b2fe-8f70cc3ff6af\") "
Jul 16 09:14:20.947426 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:20.947402    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07d713c2-2295-4409-b2fe-8f70cc3ff6af-bundle" (OuterVolumeSpecName: "bundle") pod "07d713c2-2295-4409-b2fe-8f70cc3ff6af" (UID: "07d713c2-2295-4409-b2fe-8f70cc3ff6af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:14:20.948864 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:20.948837    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07d713c2-2295-4409-b2fe-8f70cc3ff6af-kube-api-access-pbmtr" (OuterVolumeSpecName: "kube-api-access-pbmtr") pod "07d713c2-2295-4409-b2fe-8f70cc3ff6af" (UID: "07d713c2-2295-4409-b2fe-8f70cc3ff6af"). InnerVolumeSpecName "kube-api-access-pbmtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:14:20.951037 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:20.951017    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07d713c2-2295-4409-b2fe-8f70cc3ff6af-util" (OuterVolumeSpecName: "util") pod "07d713c2-2295-4409-b2fe-8f70cc3ff6af" (UID: "07d713c2-2295-4409-b2fe-8f70cc3ff6af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:14:21.047703 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:21.047654    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07d713c2-2295-4409-b2fe-8f70cc3ff6af-util\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:14:21.047703 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:21.047674    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07d713c2-2295-4409-b2fe-8f70cc3ff6af-bundle\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:14:21.047703 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:21.047683    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbmtr\" (UniqueName: \"kubernetes.io/projected/07d713c2-2295-4409-b2fe-8f70cc3ff6af-kube-api-access-pbmtr\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:14:21.728560 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:21.728533    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh"
Jul 16 09:14:21.728707 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:21.728532    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hcqgh" event={"ID":"07d713c2-2295-4409-b2fe-8f70cc3ff6af","Type":"ContainerDied","Data":"781bfd8ee23b92ac506ba1a843af94ce7d65e3f640163a62788b038659d1b353"}
Jul 16 09:14:21.728707 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:21.728656    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="781bfd8ee23b92ac506ba1a843af94ce7d65e3f640163a62788b038659d1b353"
Jul 16 09:14:23.946141 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:23.946102    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:25.310909 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.310872    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:25.886722 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.886690    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxkmc"]
Jul 16 09:14:25.886972 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.886959    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07d713c2-2295-4409-b2fe-8f70cc3ff6af" containerName="pull"
Jul 16 09:14:25.887015 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.886974    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="07d713c2-2295-4409-b2fe-8f70cc3ff6af" containerName="pull"
Jul 16 09:14:25.887015 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.886994    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07d713c2-2295-4409-b2fe-8f70cc3ff6af" containerName="extract"
Jul 16 09:14:25.887015 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.887011    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="07d713c2-2295-4409-b2fe-8f70cc3ff6af" containerName="extract"
Jul 16 09:14:25.887107 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.887029    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07d713c2-2295-4409-b2fe-8f70cc3ff6af" containerName="util"
Jul 16 09:14:25.887107 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.887037    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="07d713c2-2295-4409-b2fe-8f70cc3ff6af" containerName="util"
Jul 16 09:14:25.887107 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.887102    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="07d713c2-2295-4409-b2fe-8f70cc3ff6af" containerName="extract"
Jul 16 09:14:25.930159 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.930131    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxkmc"]
Jul 16 09:14:25.930295 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.930225    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxkmc"
Jul 16 09:14:25.932833 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.932809    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-thfss\""
Jul 16 09:14:25.932964 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.932852    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 16 09:14:25.932964 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.932856    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 16 09:14:25.981418 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.981393    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/262ebcb5-ab70-4762-a5d2-3e415076273b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vxkmc\" (UID: \"262ebcb5-ab70-4762-a5d2-3e415076273b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxkmc"
Jul 16 09:14:25.981519 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:25.981450    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4jdq\" (UniqueName: \"kubernetes.io/projected/262ebcb5-ab70-4762-a5d2-3e415076273b-kube-api-access-r4jdq\") pod \"cert-manager-operator-controller-manager-55c444bf86-vxkmc\" (UID: \"262ebcb5-ab70-4762-a5d2-3e415076273b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxkmc"
Jul 16 09:14:26.082330 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:26.082307    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4jdq\" (UniqueName: \"kubernetes.io/projected/262ebcb5-ab70-4762-a5d2-3e415076273b-kube-api-access-r4jdq\") pod \"cert-manager-operator-controller-manager-55c444bf86-vxkmc\" (UID: \"262ebcb5-ab70-4762-a5d2-3e415076273b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxkmc"
Jul 16 09:14:26.082463 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:26.082369    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/262ebcb5-ab70-4762-a5d2-3e415076273b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vxkmc\" (UID: \"262ebcb5-ab70-4762-a5d2-3e415076273b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxkmc"
Jul 16 09:14:26.082689 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:26.082674    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/262ebcb5-ab70-4762-a5d2-3e415076273b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vxkmc\" (UID: \"262ebcb5-ab70-4762-a5d2-3e415076273b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxkmc"
Jul 16 09:14:26.092315 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:26.092290    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4jdq\" (UniqueName: \"kubernetes.io/projected/262ebcb5-ab70-4762-a5d2-3e415076273b-kube-api-access-r4jdq\") pod \"cert-manager-operator-controller-manager-55c444bf86-vxkmc\" (UID: \"262ebcb5-ab70-4762-a5d2-3e415076273b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxkmc"
Jul 16 09:14:26.239435 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:26.239407    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxkmc"
Jul 16 09:14:26.387730 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:26.387706    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxkmc"]
Jul 16 09:14:26.390547 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:14:26.390526    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod262ebcb5_ab70_4762_a5d2_3e415076273b.slice/crio-7466bb0390c61edf10aafaf8dfe50fd9d657063152b6d2c0425ce56fa957e809 WatchSource:0}: Error finding container 7466bb0390c61edf10aafaf8dfe50fd9d657063152b6d2c0425ce56fa957e809: Status 404 returned error can't find the container with id 7466bb0390c61edf10aafaf8dfe50fd9d657063152b6d2c0425ce56fa957e809
Jul 16 09:14:26.749271 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:26.749238    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxkmc" event={"ID":"262ebcb5-ab70-4762-a5d2-3e415076273b","Type":"ContainerStarted","Data":"7466bb0390c61edf10aafaf8dfe50fd9d657063152b6d2c0425ce56fa957e809"}
Jul 16 09:14:27.556642 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:27.556607    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:27.655620 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:27.655585    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:28.759508 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:28.759467    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxkmc" event={"ID":"262ebcb5-ab70-4762-a5d2-3e415076273b","Type":"ContainerStarted","Data":"fe780eecfa9fe910ca90d7544bf0f91a12f449474006b1c171234dc42b21a8b3"}
Jul 16 09:14:28.780424 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:28.780376    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vxkmc" podStartSLOduration=1.541866129 podStartE2EDuration="3.780360282s" totalImagesPullingTime="2.238494153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:14:28.778757787 +0000 UTC m=+576.602609369" watchObservedRunningTime="2026-07-16 09:14:28.780360282 +0000 UTC m=+576.604211843"
Jul 16 09:14:29.201881 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:29.201845    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:29.303336 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:29.303308    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:29.708523 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:29.708494    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:29.804001 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:29.803967    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:30.021791 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.021712    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"]
Jul 16 09:14:30.039120 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.039096    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"]
Jul 16 09:14:30.039243 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.039186    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"
Jul 16 09:14:30.041962 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.041938    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n6855\""
Jul 16 09:14:30.042065 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.041940    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 09:14:30.042574 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.042558    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 09:14:30.114039 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.114013    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729\" (UID: \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"
Jul 16 09:14:30.114153 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.114045    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729\" (UID: \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"
Jul 16 09:14:30.114153 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.114064    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmvlf\" (UniqueName: \"kubernetes.io/projected/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-kube-api-access-fmvlf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729\" (UID: \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"
Jul 16 09:14:30.215006 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.214978    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729\" (UID: \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"
Jul 16 09:14:30.215146 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.215009    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729\" (UID: \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"
Jul 16 09:14:30.215146 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.215030    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmvlf\" (UniqueName: \"kubernetes.io/projected/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-kube-api-access-fmvlf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729\" (UID: \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"
Jul 16 09:14:30.215454 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.215433    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729\" (UID: \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"
Jul 16 09:14:30.215493 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.215443    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729\" (UID: \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"
Jul 16 09:14:30.223414 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.223388    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmvlf\" (UniqueName: \"kubernetes.io/projected/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-kube-api-access-fmvlf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729\" (UID: \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"
Jul 16 09:14:30.348051 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.347993    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"
Jul 16 09:14:30.496864 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.496843    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"]
Jul 16 09:14:30.499181 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:14:30.499153    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fcc5db1_6459_4fcb_84a9_88d920dd51ab.slice/crio-3410ab8c562ae85add08166063eb0ed3b8e29f860abea7a51ded808f132a73d7 WatchSource:0}: Error finding container 3410ab8c562ae85add08166063eb0ed3b8e29f860abea7a51ded808f132a73d7: Status 404 returned error can't find the container with id 3410ab8c562ae85add08166063eb0ed3b8e29f860abea7a51ded808f132a73d7
Jul 16 09:14:30.768954 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.768921    2556 generic.go:356] "Generic (PLEG): container finished" podID="7fcc5db1-6459-4fcb-84a9-88d920dd51ab" containerID="a2b87aff5b796419c199b0f2ab06bf9f6600df48fa96721dd2ce733b3f911466" exitCode=0
Jul 16 09:14:30.769062 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.769003    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729" event={"ID":"7fcc5db1-6459-4fcb-84a9-88d920dd51ab","Type":"ContainerDied","Data":"a2b87aff5b796419c199b0f2ab06bf9f6600df48fa96721dd2ce733b3f911466"}
Jul 16 09:14:30.769062 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:30.769049    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729" event={"ID":"7fcc5db1-6459-4fcb-84a9-88d920dd51ab","Type":"ContainerStarted","Data":"3410ab8c562ae85add08166063eb0ed3b8e29f860abea7a51ded808f132a73d7"}
Jul 16 09:14:31.170492 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.170461    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j2h77"]
Jul 16 09:14:31.190487 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.190462    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j2h77"]
Jul 16 09:14:31.190622 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.190566    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-j2h77"
Jul 16 09:14:31.192853 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.192834    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 16 09:14:31.192853 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.192846    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 16 09:14:31.193613 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.193598    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zxt7q\""
Jul 16 09:14:31.322949 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.322923    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b838b5c4-8d23-4e37-8a0a-6a4eb32c196b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j2h77\" (UID: \"b838b5c4-8d23-4e37-8a0a-6a4eb32c196b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j2h77"
Jul 16 09:14:31.323044 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.322970    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xqb4\" (UniqueName: \"kubernetes.io/projected/b838b5c4-8d23-4e37-8a0a-6a4eb32c196b-kube-api-access-8xqb4\") pod \"cert-manager-webhook-6486ffd997-j2h77\" (UID: \"b838b5c4-8d23-4e37-8a0a-6a4eb32c196b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j2h77"
Jul 16 09:14:31.423752 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.423696    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b838b5c4-8d23-4e37-8a0a-6a4eb32c196b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j2h77\" (UID: \"b838b5c4-8d23-4e37-8a0a-6a4eb32c196b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j2h77"
Jul 16 09:14:31.423841 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.423747    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xqb4\" (UniqueName: \"kubernetes.io/projected/b838b5c4-8d23-4e37-8a0a-6a4eb32c196b-kube-api-access-8xqb4\") pod \"cert-manager-webhook-6486ffd997-j2h77\" (UID: \"b838b5c4-8d23-4e37-8a0a-6a4eb32c196b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j2h77"
Jul 16 09:14:31.432698 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.432675    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b838b5c4-8d23-4e37-8a0a-6a4eb32c196b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j2h77\" (UID: \"b838b5c4-8d23-4e37-8a0a-6a4eb32c196b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j2h77"
Jul 16 09:14:31.432859 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.432677    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xqb4\" (UniqueName: \"kubernetes.io/projected/b838b5c4-8d23-4e37-8a0a-6a4eb32c196b-kube-api-access-8xqb4\") pod \"cert-manager-webhook-6486ffd997-j2h77\" (UID: \"b838b5c4-8d23-4e37-8a0a-6a4eb32c196b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j2h77"
Jul 16 09:14:31.519467 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.519438    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-j2h77"
Jul 16 09:14:31.651961 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.651928    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j2h77"]
Jul 16 09:14:31.654718 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:14:31.654672    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb838b5c4_8d23_4e37_8a0a_6a4eb32c196b.slice/crio-69d0f42649eec8b7dc0d35ae612291ae4bec0d2c6b2657d58b07dbf8872c5b99 WatchSource:0}: Error finding container 69d0f42649eec8b7dc0d35ae612291ae4bec0d2c6b2657d58b07dbf8872c5b99: Status 404 returned error can't find the container with id 69d0f42649eec8b7dc0d35ae612291ae4bec0d2c6b2657d58b07dbf8872c5b99
Jul 16 09:14:31.745568 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.745470    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:31.779999 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:31.779963    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-j2h77" event={"ID":"b838b5c4-8d23-4e37-8a0a-6a4eb32c196b","Type":"ContainerStarted","Data":"69d0f42649eec8b7dc0d35ae612291ae4bec0d2c6b2657d58b07dbf8872c5b99"}
Jul 16 09:14:32.082461 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:32.082382    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:32.790133 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:32.790099    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q6slf"]
Jul 16 09:14:32.795331 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:32.795305    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q6slf"
Jul 16 09:14:32.797814 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:32.797630    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zsmkq\""
Jul 16 09:14:32.802406 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:32.802378    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q6slf"]
Jul 16 09:14:32.838512 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:32.838476    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tprw4\" (UniqueName: \"kubernetes.io/projected/c5548293-5572-464e-b406-5c5a2e6f9cf2-kube-api-access-tprw4\") pod \"cert-manager-cainjector-559cdd8c87-q6slf\" (UID: \"c5548293-5572-464e-b406-5c5a2e6f9cf2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q6slf"
Jul 16 09:14:32.838673 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:32.838604    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5548293-5572-464e-b406-5c5a2e6f9cf2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q6slf\" (UID: \"c5548293-5572-464e-b406-5c5a2e6f9cf2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q6slf"
Jul 16 09:14:32.939595 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:32.939564    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5548293-5572-464e-b406-5c5a2e6f9cf2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q6slf\" (UID: \"c5548293-5572-464e-b406-5c5a2e6f9cf2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q6slf"
Jul 16 09:14:32.939792 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:32.939625    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tprw4\" (UniqueName: \"kubernetes.io/projected/c5548293-5572-464e-b406-5c5a2e6f9cf2-kube-api-access-tprw4\") pod \"cert-manager-cainjector-559cdd8c87-q6slf\" (UID: \"c5548293-5572-464e-b406-5c5a2e6f9cf2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q6slf"
Jul 16 09:14:32.948604 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:32.948575    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5548293-5572-464e-b406-5c5a2e6f9cf2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q6slf\" (UID: \"c5548293-5572-464e-b406-5c5a2e6f9cf2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q6slf"
Jul 16 09:14:32.948861 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:32.948835    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tprw4\" (UniqueName: \"kubernetes.io/projected/c5548293-5572-464e-b406-5c5a2e6f9cf2-kube-api-access-tprw4\") pod \"cert-manager-cainjector-559cdd8c87-q6slf\" (UID: \"c5548293-5572-464e-b406-5c5a2e6f9cf2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q6slf"
Jul 16 09:14:33.110525 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:33.110452    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q6slf"
Jul 16 09:14:33.264210 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:33.264178    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q6slf"]
Jul 16 09:14:33.267993 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:14:33.267963    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5548293_5572_464e_b406_5c5a2e6f9cf2.slice/crio-78234920acf975fd027a5ffecddabde01e90e6533f6ceb480eda3e80652dea96 WatchSource:0}: Error finding container 78234920acf975fd027a5ffecddabde01e90e6533f6ceb480eda3e80652dea96: Status 404 returned error can't find the container with id 78234920acf975fd027a5ffecddabde01e90e6533f6ceb480eda3e80652dea96
Jul 16 09:14:33.792242 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:33.792208    2556 generic.go:356] "Generic (PLEG): container finished" podID="7fcc5db1-6459-4fcb-84a9-88d920dd51ab" containerID="a06789b19edacdc3a821ea53296ce0b4f25c5953e88977de4febe79c4bf3cf3b" exitCode=0
Jul 16 09:14:33.792682 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:33.792292    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729" event={"ID":"7fcc5db1-6459-4fcb-84a9-88d920dd51ab","Type":"ContainerDied","Data":"a06789b19edacdc3a821ea53296ce0b4f25c5953e88977de4febe79c4bf3cf3b"}
Jul 16 09:14:33.793661 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:33.793641    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q6slf" event={"ID":"c5548293-5572-464e-b406-5c5a2e6f9cf2","Type":"ContainerStarted","Data":"78234920acf975fd027a5ffecddabde01e90e6533f6ceb480eda3e80652dea96"}
Jul 16 09:14:34.596743 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:34.596708    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:34.664025 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:34.663981    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:34.801464 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:34.801434    2556 generic.go:356] "Generic (PLEG): container finished" podID="7fcc5db1-6459-4fcb-84a9-88d920dd51ab" containerID="75f73343da2553c028c8748c3d6b282285f0d135ff6cc7e1bb07b77d49f68995" exitCode=0
Jul 16 09:14:34.801865 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:34.801491    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729" event={"ID":"7fcc5db1-6459-4fcb-84a9-88d920dd51ab","Type":"ContainerDied","Data":"75f73343da2553c028c8748c3d6b282285f0d135ff6cc7e1bb07b77d49f68995"}
Jul 16 09:14:34.803134 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:34.803109    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-j2h77" event={"ID":"b838b5c4-8d23-4e37-8a0a-6a4eb32c196b","Type":"ContainerStarted","Data":"3b4d9488a5848dc2449e84ba57d9275869b4a64fe7f4154d18e572c5c8c68fd8"}
Jul 16 09:14:34.803280 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:34.803224    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-j2h77"
Jul 16 09:14:34.804539 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:34.804514    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q6slf" event={"ID":"c5548293-5572-464e-b406-5c5a2e6f9cf2","Type":"ContainerStarted","Data":"4d11b40855c7351e77d2d7d23d3988b905846cd4704d7950ce2f2289f7f124e7"}
Jul 16 09:14:34.836248 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:34.836204    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-j2h77" podStartSLOduration=1.047936623 podStartE2EDuration="3.836190876s" totalImagesPullingTime="2.788254253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:14:34.834986401 +0000 UTC m=+582.658837972" watchObservedRunningTime="2026-07-16 09:14:34.836190876 +0000 UTC m=+582.660042445"
Jul 16 09:14:34.852418 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:34.852384    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q6slf" podStartSLOduration=1.677030509 podStartE2EDuration="2.852372542s" totalImagesPullingTime="1.175342033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:14:34.85202636 +0000 UTC m=+582.675877930" watchObservedRunningTime="2026-07-16 09:14:34.852372542 +0000 UTC m=+582.676224108"
Jul 16 09:14:35.933249 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:35.933228    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"
Jul 16 09:14:36.067246 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:36.067175    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-util\") pod \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\" (UID: \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\") "
Jul 16 09:14:36.067246 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:36.067218    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmvlf\" (UniqueName: \"kubernetes.io/projected/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-kube-api-access-fmvlf\") pod \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\" (UID: \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\") "
Jul 16 09:14:36.067438 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:36.067279    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-bundle\") pod \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\" (UID: \"7fcc5db1-6459-4fcb-84a9-88d920dd51ab\") "
Jul 16 09:14:36.067702 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:36.067667    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-bundle" (OuterVolumeSpecName: "bundle") pod "7fcc5db1-6459-4fcb-84a9-88d920dd51ab" (UID: "7fcc5db1-6459-4fcb-84a9-88d920dd51ab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:14:36.069300 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:36.069278    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-kube-api-access-fmvlf" (OuterVolumeSpecName: "kube-api-access-fmvlf") pod "7fcc5db1-6459-4fcb-84a9-88d920dd51ab" (UID: "7fcc5db1-6459-4fcb-84a9-88d920dd51ab"). InnerVolumeSpecName "kube-api-access-fmvlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:14:36.071323 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:36.071297    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-util" (OuterVolumeSpecName: "util") pod "7fcc5db1-6459-4fcb-84a9-88d920dd51ab" (UID: "7fcc5db1-6459-4fcb-84a9-88d920dd51ab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:14:36.168748 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:36.168725    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-util\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:14:36.168748 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:36.168748    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmvlf\" (UniqueName: \"kubernetes.io/projected/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-kube-api-access-fmvlf\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:14:36.168869 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:36.168759    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fcc5db1-6459-4fcb-84a9-88d920dd51ab-bundle\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:14:36.815528 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:36.815494    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729"
Jul 16 09:14:36.815528 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:36.815515    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8h729" event={"ID":"7fcc5db1-6459-4fcb-84a9-88d920dd51ab","Type":"ContainerDied","Data":"3410ab8c562ae85add08166063eb0ed3b8e29f860abea7a51ded808f132a73d7"}
Jul 16 09:14:36.815753 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:36.815564    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3410ab8c562ae85add08166063eb0ed3b8e29f860abea7a51ded808f132a73d7"
Jul 16 09:14:40.295336 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:40.295307    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:40.810846 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:40.810816    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-j2h77"
Jul 16 09:14:40.958278 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:40.958236    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:41.058160 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:41.058130    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:42.975307 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:42.975279    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjf2p"]
Jul 16 09:14:42.975694 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:42.975580    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fcc5db1-6459-4fcb-84a9-88d920dd51ab" containerName="pull"
Jul 16 09:14:42.975694 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:42.975591    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fcc5db1-6459-4fcb-84a9-88d920dd51ab" containerName="pull"
Jul 16 09:14:42.975694 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:42.975603    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fcc5db1-6459-4fcb-84a9-88d920dd51ab" containerName="util"
Jul 16 09:14:42.975694 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:42.975608    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fcc5db1-6459-4fcb-84a9-88d920dd51ab" containerName="util"
Jul 16 09:14:42.975694 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:42.975619    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fcc5db1-6459-4fcb-84a9-88d920dd51ab" containerName="extract"
Jul 16 09:14:42.975694 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:42.975625    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fcc5db1-6459-4fcb-84a9-88d920dd51ab" containerName="extract"
Jul 16 09:14:42.975694 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:42.975676    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fcc5db1-6459-4fcb-84a9-88d920dd51ab" containerName="extract"
Jul 16 09:14:42.979006 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:42.978990    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjf2p"
Jul 16 09:14:42.981361 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:42.981332    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 09:14:42.982230 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:42.982215    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-6h546\""
Jul 16 09:14:42.982317 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:42.982214    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 09:14:42.986320 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:42.986302    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjf2p"]
Jul 16 09:14:43.120108 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:43.120080    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhqmz\" (UniqueName: \"kubernetes.io/projected/c261b85e-4f4c-45af-9310-dcd689a29a04-kube-api-access-lhqmz\") pod \"openshift-lws-operator-fd8ccff4c-rjf2p\" (UID: \"c261b85e-4f4c-45af-9310-dcd689a29a04\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjf2p"
Jul 16 09:14:43.120254 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:43.120135    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c261b85e-4f4c-45af-9310-dcd689a29a04-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rjf2p\" (UID: \"c261b85e-4f4c-45af-9310-dcd689a29a04\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjf2p"
Jul 16 09:14:43.220843 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:43.220814    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhqmz\" (UniqueName: \"kubernetes.io/projected/c261b85e-4f4c-45af-9310-dcd689a29a04-kube-api-access-lhqmz\") pod \"openshift-lws-operator-fd8ccff4c-rjf2p\" (UID: \"c261b85e-4f4c-45af-9310-dcd689a29a04\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjf2p"
Jul 16 09:14:43.220972 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:43.220856    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c261b85e-4f4c-45af-9310-dcd689a29a04-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rjf2p\" (UID: \"c261b85e-4f4c-45af-9310-dcd689a29a04\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjf2p"
Jul 16 09:14:43.221166 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:43.221149    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c261b85e-4f4c-45af-9310-dcd689a29a04-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rjf2p\" (UID: \"c261b85e-4f4c-45af-9310-dcd689a29a04\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjf2p"
Jul 16 09:14:43.229664 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:43.229605    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhqmz\" (UniqueName: \"kubernetes.io/projected/c261b85e-4f4c-45af-9310-dcd689a29a04-kube-api-access-lhqmz\") pod \"openshift-lws-operator-fd8ccff4c-rjf2p\" (UID: \"c261b85e-4f4c-45af-9310-dcd689a29a04\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjf2p"
Jul 16 09:14:43.288053 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:43.288031    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjf2p"
Jul 16 09:14:43.415819 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:43.415788    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjf2p"]
Jul 16 09:14:43.418200 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:14:43.418175    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc261b85e_4f4c_45af_9310_dcd689a29a04.slice/crio-911c80ce19ee51049c13bf568954871ecfb5fa814000aa4345fb55f72338f60b WatchSource:0}: Error finding container 911c80ce19ee51049c13bf568954871ecfb5fa814000aa4345fb55f72338f60b: Status 404 returned error can't find the container with id 911c80ce19ee51049c13bf568954871ecfb5fa814000aa4345fb55f72338f60b
Jul 16 09:14:43.845104 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:43.845067    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjf2p" event={"ID":"c261b85e-4f4c-45af-9310-dcd689a29a04","Type":"ContainerStarted","Data":"911c80ce19ee51049c13bf568954871ecfb5fa814000aa4345fb55f72338f60b"}
Jul 16 09:14:48.869845 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:48.869804    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjf2p" event={"ID":"c261b85e-4f4c-45af-9310-dcd689a29a04","Type":"ContainerStarted","Data":"eb57d3edc2e3a9b526fd6e37b4e66ccb18895d30c97990c5233148c9a325298f"}
Jul 16 09:14:48.886570 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:48.886526    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rjf2p" podStartSLOduration=2.36765171 podStartE2EDuration="6.88651078s" totalImagesPullingTime="4.51885907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:14:48.885877064 +0000 UTC m=+596.709728633" watchObservedRunningTime="2026-07-16 09:14:48.88651078 +0000 UTC m=+596.710362349"
Jul 16 09:14:49.609995 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:49.609961    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:51.447895 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.447857    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"]
Jul 16 09:14:51.451609 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.451589    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"
Jul 16 09:14:51.454060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.454039    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 09:14:51.454166 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.454039    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 09:14:51.454166 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.454042    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n6855\""
Jul 16 09:14:51.463809 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.463786    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"]
Jul 16 09:14:51.587372 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.587316    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5478bc92-99c0-4bd2-8ed9-9adec871fd59-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll\" (UID: \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"
Jul 16 09:14:51.587508 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.587386    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj49b\" (UniqueName: \"kubernetes.io/projected/5478bc92-99c0-4bd2-8ed9-9adec871fd59-kube-api-access-cj49b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll\" (UID: \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"
Jul 16 09:14:51.587508 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.587427    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5478bc92-99c0-4bd2-8ed9-9adec871fd59-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll\" (UID: \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"
Jul 16 09:14:51.688110 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.688081    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5478bc92-99c0-4bd2-8ed9-9adec871fd59-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll\" (UID: \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"
Jul 16 09:14:51.688226 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.688115    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj49b\" (UniqueName: \"kubernetes.io/projected/5478bc92-99c0-4bd2-8ed9-9adec871fd59-kube-api-access-cj49b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll\" (UID: \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"
Jul 16 09:14:51.688226 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.688141    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5478bc92-99c0-4bd2-8ed9-9adec871fd59-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll\" (UID: \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"
Jul 16 09:14:51.688456 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.688438    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5478bc92-99c0-4bd2-8ed9-9adec871fd59-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll\" (UID: \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"
Jul 16 09:14:51.688565 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.688549    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5478bc92-99c0-4bd2-8ed9-9adec871fd59-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll\" (UID: \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"
Jul 16 09:14:51.698208 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.698154    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj49b\" (UniqueName: \"kubernetes.io/projected/5478bc92-99c0-4bd2-8ed9-9adec871fd59-kube-api-access-cj49b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll\" (UID: \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"
Jul 16 09:14:51.760988 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.760963    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"
Jul 16 09:14:51.913974 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:51.913945    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"]
Jul 16 09:14:51.917418 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:14:51.917389    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5478bc92_99c0_4bd2_8ed9_9adec871fd59.slice/crio-f4ec60b07d4a680f02fa481483f11ad6341ffd74aa9b9eea6c2cb29df29dcbf5 WatchSource:0}: Error finding container f4ec60b07d4a680f02fa481483f11ad6341ffd74aa9b9eea6c2cb29df29dcbf5: Status 404 returned error can't find the container with id f4ec60b07d4a680f02fa481483f11ad6341ffd74aa9b9eea6c2cb29df29dcbf5
Jul 16 09:14:52.225390 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:52.225279    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:14:52.623869 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:52.623792    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:14:52.624648 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:52.624628    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:14:52.887761 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:52.887694    2556 generic.go:356] "Generic (PLEG): container finished" podID="5478bc92-99c0-4bd2-8ed9-9adec871fd59" containerID="bc47a237262c4891cfc2d20cf71dcae428d1ce59cca5740f6c38836c1c0fd773" exitCode=0
Jul 16 09:14:52.887761 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:52.887736    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll" event={"ID":"5478bc92-99c0-4bd2-8ed9-9adec871fd59","Type":"ContainerDied","Data":"bc47a237262c4891cfc2d20cf71dcae428d1ce59cca5740f6c38836c1c0fd773"}
Jul 16 09:14:52.887910 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:52.887769    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll" event={"ID":"5478bc92-99c0-4bd2-8ed9-9adec871fd59","Type":"ContainerStarted","Data":"f4ec60b07d4a680f02fa481483f11ad6341ffd74aa9b9eea6c2cb29df29dcbf5"}
Jul 16 09:14:53.895001 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:53.894967    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll" event={"ID":"5478bc92-99c0-4bd2-8ed9-9adec871fd59","Type":"ContainerStarted","Data":"b92192a8fb058d8aad46c88076812229986355f044205dbed9ce1bd13332121a"}
Jul 16 09:14:54.901152 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:54.901117    2556 generic.go:356] "Generic (PLEG): container finished" podID="5478bc92-99c0-4bd2-8ed9-9adec871fd59" containerID="b92192a8fb058d8aad46c88076812229986355f044205dbed9ce1bd13332121a" exitCode=0
Jul 16 09:14:54.901586 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:54.901195    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll" event={"ID":"5478bc92-99c0-4bd2-8ed9-9adec871fd59","Type":"ContainerDied","Data":"b92192a8fb058d8aad46c88076812229986355f044205dbed9ce1bd13332121a"}
Jul 16 09:14:55.908002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:55.907969    2556 generic.go:356] "Generic (PLEG): container finished" podID="5478bc92-99c0-4bd2-8ed9-9adec871fd59" containerID="d2b0da261362a775139f0ed8b1ab993a46a2a286104c780bd2ab49e4e5cac77e" exitCode=0
Jul 16 09:14:55.908414 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:55.908012    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll" event={"ID":"5478bc92-99c0-4bd2-8ed9-9adec871fd59","Type":"ContainerDied","Data":"d2b0da261362a775139f0ed8b1ab993a46a2a286104c780bd2ab49e4e5cac77e"}
Jul 16 09:14:57.042462 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:57.042441    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"
Jul 16 09:14:57.129994 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:57.129971    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj49b\" (UniqueName: \"kubernetes.io/projected/5478bc92-99c0-4bd2-8ed9-9adec871fd59-kube-api-access-cj49b\") pod \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\" (UID: \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\") "
Jul 16 09:14:57.130110 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:57.130015    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5478bc92-99c0-4bd2-8ed9-9adec871fd59-util\") pod \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\" (UID: \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\") "
Jul 16 09:14:57.130110 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:57.130055    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5478bc92-99c0-4bd2-8ed9-9adec871fd59-bundle\") pod \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\" (UID: \"5478bc92-99c0-4bd2-8ed9-9adec871fd59\") "
Jul 16 09:14:57.130833 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:57.130800    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5478bc92-99c0-4bd2-8ed9-9adec871fd59-bundle" (OuterVolumeSpecName: "bundle") pod "5478bc92-99c0-4bd2-8ed9-9adec871fd59" (UID: "5478bc92-99c0-4bd2-8ed9-9adec871fd59"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:14:57.131988 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:57.131967    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5478bc92-99c0-4bd2-8ed9-9adec871fd59-kube-api-access-cj49b" (OuterVolumeSpecName: "kube-api-access-cj49b") pod "5478bc92-99c0-4bd2-8ed9-9adec871fd59" (UID: "5478bc92-99c0-4bd2-8ed9-9adec871fd59"). InnerVolumeSpecName "kube-api-access-cj49b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:14:57.135382 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:57.135361    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5478bc92-99c0-4bd2-8ed9-9adec871fd59-util" (OuterVolumeSpecName: "util") pod "5478bc92-99c0-4bd2-8ed9-9adec871fd59" (UID: "5478bc92-99c0-4bd2-8ed9-9adec871fd59"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:14:57.230900 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:57.230829    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5478bc92-99c0-4bd2-8ed9-9adec871fd59-util\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:14:57.230900 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:57.230852    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5478bc92-99c0-4bd2-8ed9-9adec871fd59-bundle\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:14:57.230900 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:57.230863    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj49b\" (UniqueName: \"kubernetes.io/projected/5478bc92-99c0-4bd2-8ed9-9adec871fd59-kube-api-access-cj49b\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:14:57.918213 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:57.918178    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll" event={"ID":"5478bc92-99c0-4bd2-8ed9-9adec871fd59","Type":"ContainerDied","Data":"f4ec60b07d4a680f02fa481483f11ad6341ffd74aa9b9eea6c2cb29df29dcbf5"}
Jul 16 09:14:57.918423 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:57.918233    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4ec60b07d4a680f02fa481483f11ad6341ffd74aa9b9eea6c2cb29df29dcbf5"
Jul 16 09:14:57.918423 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:14:57.918193    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjcll"
Jul 16 09:15:03.368788 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:03.368754    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:03.467172 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:03.467134    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:04.003873 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.003828    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:04.474721 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.474682    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"]
Jul 16 09:15:04.475646 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.475625    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5478bc92-99c0-4bd2-8ed9-9adec871fd59" containerName="extract"
Jul 16 09:15:04.475762 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.475752    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5478bc92-99c0-4bd2-8ed9-9adec871fd59" containerName="extract"
Jul 16 09:15:04.475839 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.475831    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5478bc92-99c0-4bd2-8ed9-9adec871fd59" containerName="util"
Jul 16 09:15:04.475909 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.475902    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5478bc92-99c0-4bd2-8ed9-9adec871fd59" containerName="util"
Jul 16 09:15:04.475985 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.475977    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5478bc92-99c0-4bd2-8ed9-9adec871fd59" containerName="pull"
Jul 16 09:15:04.476046 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.476039    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5478bc92-99c0-4bd2-8ed9-9adec871fd59" containerName="pull"
Jul 16 09:15:04.476215 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.476205    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5478bc92-99c0-4bd2-8ed9-9adec871fd59" containerName="extract"
Jul 16 09:15:04.483759 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.483738    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.486690 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.486617    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 09:15:04.486812 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.486771    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 09:15:04.487335 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.487316    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 09:15:04.487467 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.487410    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m6hkx\""
Jul 16 09:15:04.496233 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.496215    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 09:15:04.501535 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.501513    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"]
Jul 16 09:15:04.585511 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.585479    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:04.587566 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.587533    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4189701-b40d-4f00-b8dd-4415a6d53e6e-tmp\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.587684 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.587620    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4189701-b40d-4f00-b8dd-4415a6d53e6e-manifests\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.587684 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.587669    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f4189701-b40d-4f00-b8dd-4415a6d53e6e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.587804 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.587705    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4189701-b40d-4f00-b8dd-4415a6d53e6e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.587804 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.587746    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q24lc\" (UniqueName: \"kubernetes.io/projected/f4189701-b40d-4f00-b8dd-4415a6d53e6e-kube-api-access-q24lc\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.685178 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.685144    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:04.688296 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.688277    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4189701-b40d-4f00-b8dd-4415a6d53e6e-manifests\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.688379 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.688321    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f4189701-b40d-4f00-b8dd-4415a6d53e6e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.688474 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.688456    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4189701-b40d-4f00-b8dd-4415a6d53e6e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.688535 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.688510    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q24lc\" (UniqueName: \"kubernetes.io/projected/f4189701-b40d-4f00-b8dd-4415a6d53e6e-kube-api-access-q24lc\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.688602 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.688589    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4189701-b40d-4f00-b8dd-4415a6d53e6e-tmp\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.688719 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.688699    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4189701-b40d-4f00-b8dd-4415a6d53e6e-manifests\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.690761 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.690736    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4189701-b40d-4f00-b8dd-4415a6d53e6e-tmp\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.690905 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.690888    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f4189701-b40d-4f00-b8dd-4415a6d53e6e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.690954 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.690941    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4189701-b40d-4f00-b8dd-4415a6d53e6e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.696826 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.696808    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q24lc\" (UniqueName: \"kubernetes.io/projected/f4189701-b40d-4f00-b8dd-4415a6d53e6e-kube-api-access-q24lc\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mqf2j\" (UID: \"f4189701-b40d-4f00-b8dd-4415a6d53e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.796039 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.795945    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:04.800237 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.800184    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:04.954994 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.954972    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"]
Jul 16 09:15:04.957031 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:15:04.957007    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4189701_b40d_4f00_b8dd_4415a6d53e6e.slice/crio-8e6086822dbeed5c757dd18676602136264e90a6e6f14a3cb5b4aa462502b9c5 WatchSource:0}: Error finding container 8e6086822dbeed5c757dd18676602136264e90a6e6f14a3cb5b4aa462502b9c5: Status 404 returned error can't find the container with id 8e6086822dbeed5c757dd18676602136264e90a6e6f14a3cb5b4aa462502b9c5
Jul 16 09:15:04.958868 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:04.958848    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:15:05.047733 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:05.047657    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:05.149390 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:05.149339    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:05.958992 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:05.958954    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j" event={"ID":"f4189701-b40d-4f00-b8dd-4415a6d53e6e","Type":"ContainerStarted","Data":"8e6086822dbeed5c757dd18676602136264e90a6e6f14a3cb5b4aa462502b9c5"}
Jul 16 09:15:08.975567 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:08.975531    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j" event={"ID":"f4189701-b40d-4f00-b8dd-4415a6d53e6e","Type":"ContainerStarted","Data":"09b5ee7d660eb2c012cc7cd0b9d82e6e02d7c741cb3c28c18b2054e613c4b1d0"}
Jul 16 09:15:09.282949 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:09.282876    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:09.981914 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:09.981877    2556 generic.go:356] "Generic (PLEG): container finished" podID="f4189701-b40d-4f00-b8dd-4415a6d53e6e" containerID="09b5ee7d660eb2c012cc7cd0b9d82e6e02d7c741cb3c28c18b2054e613c4b1d0" exitCode=0
Jul 16 09:15:09.982258 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:09.981963    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j" event={"ID":"f4189701-b40d-4f00-b8dd-4415a6d53e6e","Type":"ContainerDied","Data":"09b5ee7d660eb2c012cc7cd0b9d82e6e02d7c741cb3c28c18b2054e613c4b1d0"}
Jul 16 09:15:10.987891 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:10.987855    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j" event={"ID":"f4189701-b40d-4f00-b8dd-4415a6d53e6e","Type":"ContainerStarted","Data":"a902fad27350e57a5a0506ec9c090584114aecc1ff98b7a272be3a27daf629af"}
Jul 16 09:15:10.988280 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:10.988077    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:11.010704 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:11.010630    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j" podStartSLOduration=2.289947842 podStartE2EDuration="7.010618051s" totalImagesPullingTime="3.683975429s" totalInitContainerRuntime="1.03669478s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:15:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:15:11.009038785 +0000 UTC m=+618.832890355" watchObservedRunningTime="2026-07-16 09:15:11.010618051 +0000 UTC m=+618.834469620"
Jul 16 09:15:11.545885 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:11.545852    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:11.620734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:11.620704    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:21.994076 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:21.994009    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mqf2j"
Jul 16 09:15:25.135378 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.135284    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:25.348486 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.348454    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:25.733661 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.733631    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:25.745713 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.745680    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d"]
Jul 16 09:15:25.749259 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.749239    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d"
Jul 16 09:15:25.751683 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.751654    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 09:15:25.751683 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.751654    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 09:15:25.777418 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.777398    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d"]
Jul 16 09:15:25.846481 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.846453    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f18adc4-a5df-41b4-a39d-c38a0c3365af-tls-certs\") pod \"kube-auth-proxy-86ccb4d5cb-4ht5d\" (UID: \"1f18adc4-a5df-41b4-a39d-c38a0c3365af\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d"
Jul 16 09:15:25.846621 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.846520    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgczp\" (UniqueName: \"kubernetes.io/projected/1f18adc4-a5df-41b4-a39d-c38a0c3365af-kube-api-access-qgczp\") pod \"kube-auth-proxy-86ccb4d5cb-4ht5d\" (UID: \"1f18adc4-a5df-41b4-a39d-c38a0c3365af\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d"
Jul 16 09:15:25.846621 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.846564    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f18adc4-a5df-41b4-a39d-c38a0c3365af-tmp\") pod \"kube-auth-proxy-86ccb4d5cb-4ht5d\" (UID: \"1f18adc4-a5df-41b4-a39d-c38a0c3365af\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d"
Jul 16 09:15:25.946918 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.946883    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f18adc4-a5df-41b4-a39d-c38a0c3365af-tmp\") pod \"kube-auth-proxy-86ccb4d5cb-4ht5d\" (UID: \"1f18adc4-a5df-41b4-a39d-c38a0c3365af\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d"
Jul 16 09:15:25.947060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.946951    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f18adc4-a5df-41b4-a39d-c38a0c3365af-tls-certs\") pod \"kube-auth-proxy-86ccb4d5cb-4ht5d\" (UID: \"1f18adc4-a5df-41b4-a39d-c38a0c3365af\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d"
Jul 16 09:15:25.947060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.947010    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgczp\" (UniqueName: \"kubernetes.io/projected/1f18adc4-a5df-41b4-a39d-c38a0c3365af-kube-api-access-qgczp\") pod \"kube-auth-proxy-86ccb4d5cb-4ht5d\" (UID: \"1f18adc4-a5df-41b4-a39d-c38a0c3365af\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d"
Jul 16 09:15:25.949285 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.949262    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f18adc4-a5df-41b4-a39d-c38a0c3365af-tmp\") pod \"kube-auth-proxy-86ccb4d5cb-4ht5d\" (UID: \"1f18adc4-a5df-41b4-a39d-c38a0c3365af\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d"
Jul 16 09:15:25.949550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.949527    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f18adc4-a5df-41b4-a39d-c38a0c3365af-tls-certs\") pod \"kube-auth-proxy-86ccb4d5cb-4ht5d\" (UID: \"1f18adc4-a5df-41b4-a39d-c38a0c3365af\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d"
Jul 16 09:15:25.972682 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:25.972649    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgczp\" (UniqueName: \"kubernetes.io/projected/1f18adc4-a5df-41b4-a39d-c38a0c3365af-kube-api-access-qgczp\") pod \"kube-auth-proxy-86ccb4d5cb-4ht5d\" (UID: \"1f18adc4-a5df-41b4-a39d-c38a0c3365af\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d"
Jul 16 09:15:26.002995 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.002927    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:26.055677 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.055647    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-98swb"]
Jul 16 09:15:26.059496 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.059465    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d"
Jul 16 09:15:26.059726 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.059703    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-98swb"
Jul 16 09:15:26.077725 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.077541    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dkddv\""
Jul 16 09:15:26.077725 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.077609    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 16 09:15:26.088075 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.088048    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-98swb"]
Jul 16 09:15:26.147967 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.147896    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8212d9f4-fa08-4b40-b085-83a5eec26f92-cert\") pod \"odh-model-controller-7998c67dc4-98swb\" (UID: \"8212d9f4-fa08-4b40-b085-83a5eec26f92\") " pod="opendatahub/odh-model-controller-7998c67dc4-98swb"
Jul 16 09:15:26.147967 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.147963    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tww6\" (UniqueName: \"kubernetes.io/projected/8212d9f4-fa08-4b40-b085-83a5eec26f92-kube-api-access-6tww6\") pod \"odh-model-controller-7998c67dc4-98swb\" (UID: \"8212d9f4-fa08-4b40-b085-83a5eec26f92\") " pod="opendatahub/odh-model-controller-7998c67dc4-98swb"
Jul 16 09:15:26.171491 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.171441    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:26.222724 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.222699    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d"]
Jul 16 09:15:26.225612 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:15:26.225578    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f18adc4_a5df_41b4_a39d_c38a0c3365af.slice/crio-631bd981b604fb3a45a19298e4f9c9b2d5893a97073eb55ad6f01030eeb06d0d WatchSource:0}: Error finding container 631bd981b604fb3a45a19298e4f9c9b2d5893a97073eb55ad6f01030eeb06d0d: Status 404 returned error can't find the container with id 631bd981b604fb3a45a19298e4f9c9b2d5893a97073eb55ad6f01030eeb06d0d
Jul 16 09:15:26.248950 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.248920    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8212d9f4-fa08-4b40-b085-83a5eec26f92-cert\") pod \"odh-model-controller-7998c67dc4-98swb\" (UID: \"8212d9f4-fa08-4b40-b085-83a5eec26f92\") " pod="opendatahub/odh-model-controller-7998c67dc4-98swb"
Jul 16 09:15:26.249062 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.249033    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tww6\" (UniqueName: \"kubernetes.io/projected/8212d9f4-fa08-4b40-b085-83a5eec26f92-kube-api-access-6tww6\") pod \"odh-model-controller-7998c67dc4-98swb\" (UID: \"8212d9f4-fa08-4b40-b085-83a5eec26f92\") " pod="opendatahub/odh-model-controller-7998c67dc4-98swb"
Jul 16 09:15:26.251292 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.251270    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8212d9f4-fa08-4b40-b085-83a5eec26f92-cert\") pod \"odh-model-controller-7998c67dc4-98swb\" (UID: \"8212d9f4-fa08-4b40-b085-83a5eec26f92\") " pod="opendatahub/odh-model-controller-7998c67dc4-98swb"
Jul 16 09:15:26.263224 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.263156    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tww6\" (UniqueName: \"kubernetes.io/projected/8212d9f4-fa08-4b40-b085-83a5eec26f92-kube-api-access-6tww6\") pod \"odh-model-controller-7998c67dc4-98swb\" (UID: \"8212d9f4-fa08-4b40-b085-83a5eec26f92\") " pod="opendatahub/odh-model-controller-7998c67dc4-98swb"
Jul 16 09:15:26.286923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.286893    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:26.385026 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.384992    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-98swb"
Jul 16 09:15:26.396186 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.396158    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:26.530243 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:26.530216    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-98swb"]
Jul 16 09:15:26.532190 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:15:26.532160    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8212d9f4_fa08_4b40_b085_83a5eec26f92.slice/crio-114938a9c9e10a9f97ded375cafcac9ef8e747d03d9ab5a86974f848bbdc441e WatchSource:0}: Error finding container 114938a9c9e10a9f97ded375cafcac9ef8e747d03d9ab5a86974f848bbdc441e: Status 404 returned error can't find the container with id 114938a9c9e10a9f97ded375cafcac9ef8e747d03d9ab5a86974f848bbdc441e
Jul 16 09:15:27.060334 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.060299    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-98swb" event={"ID":"8212d9f4-fa08-4b40-b085-83a5eec26f92","Type":"ContainerStarted","Data":"114938a9c9e10a9f97ded375cafcac9ef8e747d03d9ab5a86974f848bbdc441e"}
Jul 16 09:15:27.061718 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.061687    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d" event={"ID":"1f18adc4-a5df-41b4-a39d-c38a0c3365af","Type":"ContainerStarted","Data":"631bd981b604fb3a45a19298e4f9c9b2d5893a97073eb55ad6f01030eeb06d0d"}
Jul 16 09:15:27.235079 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.235043    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:27.642936 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.642870    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:27.660528 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.659619    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"]
Jul 16 09:15:27.663301 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.663211    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.665023 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.664993    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-token\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.665145 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.665051    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.665145 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.665090    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twrbn\" (UniqueName: \"kubernetes.io/projected/f7c58087-d483-42ee-80bd-5cbca290ec82-kube-api-access-twrbn\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.665145 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.665126    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.665300 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.665165    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7c58087-d483-42ee-80bd-5cbca290ec82-local-certs\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.665300 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.665195    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.665300 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.665240    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-cacerts\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.666557 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.666532    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 09:15:27.667241 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.667177    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8frkp\""
Jul 16 09:15:27.668043 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.668012    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 09:15:27.670064 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.669673    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 09:15:27.670064 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.669916    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 09:15:27.671700 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.671016    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"]
Jul 16 09:15:27.743337 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.743298    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:27.766550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.765824    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-token\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.766550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.765976    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.766550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.766034    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twrbn\" (UniqueName: \"kubernetes.io/projected/f7c58087-d483-42ee-80bd-5cbca290ec82-kube-api-access-twrbn\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.766550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.766082    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.766550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.766133    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7c58087-d483-42ee-80bd-5cbca290ec82-local-certs\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.766550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.766281    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.766550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.766332    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-cacerts\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.767383 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.767318    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.769367 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.769328    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-cacerts\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.775203 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.772035    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7c58087-d483-42ee-80bd-5cbca290ec82-local-certs\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.775789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.775678    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.776340 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.776296    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.776787 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.776653    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-token\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.779118 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.778956    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twrbn\" (UniqueName: \"kubernetes.io/projected/f7c58087-d483-42ee-80bd-5cbca290ec82-kube-api-access-twrbn\") pod \"istiod-openshift-gateway-7574459656-rm59q\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:27.827717 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.827640    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:27.983441 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:27.983406    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:28.172062 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:28.171926    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"]
Jul 16 09:15:28.854710 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:28.854670    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:29.082174 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:29.082140    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q" event={"ID":"f7c58087-d483-42ee-80bd-5cbca290ec82","Type":"ContainerStarted","Data":"28a9bf25a2d30f225f7407729f6640d3b411c43f36615de51f8a47598461c693"}
Jul 16 09:15:31.095360 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:31.095311    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-98swb" event={"ID":"8212d9f4-fa08-4b40-b085-83a5eec26f92","Type":"ContainerStarted","Data":"8369ed1da552117f5c8a82d9132e3feb891137af4aaee749cd251efd1e17c4c1"}
Jul 16 09:15:31.095831 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:31.095414    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-98swb"
Jul 16 09:15:31.097118 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:31.097095    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d" event={"ID":"1f18adc4-a5df-41b4-a39d-c38a0c3365af","Type":"ContainerStarted","Data":"88cd6371b2d97c4f272c6a7019c4847f610b23d32d8e9777209bdcbcb1df2abc"}
Jul 16 09:15:31.111421 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:31.111371    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-98swb" podStartSLOduration=1.114215161 podStartE2EDuration="5.111335297s" totalImagesPullingTime="3.997120136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:15:31.110859424 +0000 UTC m=+638.934710998" watchObservedRunningTime="2026-07-16 09:15:31.111335297 +0000 UTC m=+638.935186869"
Jul 16 09:15:31.130225 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:31.130171    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-4ht5d" podStartSLOduration=1.870699325 podStartE2EDuration="6.130153698s" totalImagesPullingTime="4.259454373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:15:31.127384345 +0000 UTC m=+638.951235915" watchObservedRunningTime="2026-07-16 09:15:31.130153698 +0000 UTC m=+638.954005268"
Jul 16 09:15:31.961824 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:31.961786    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:15:31.961947 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:31.961858    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:15:32.103308 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:32.103268    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q" event={"ID":"f7c58087-d483-42ee-80bd-5cbca290ec82","Type":"ContainerStarted","Data":"40e640ac5823cfd5511e076990f11825b7968e0364a1809ebe46303af78673d0"}
Jul 16 09:15:32.103761 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:32.103445    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:32.123255 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:32.123199    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q" podStartSLOduration=1.339240362 podStartE2EDuration="5.123182336s" totalImagesPullingTime="3.783941974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:15:32.122404548 +0000 UTC m=+639.946256139" watchObservedRunningTime="2026-07-16 09:15:32.123182336 +0000 UTC m=+639.947033904"
Jul 16 09:15:32.401886 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:32.401801    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:32.499573 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:32.499536    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:32.918552 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:32.918516    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:33.109591 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:33.109560    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:33.201327 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:33.201256    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:33.301779 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:33.301746    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:37.772057 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.772016    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:37.834529 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.834498    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-429pl"]
Jul 16 09:15:37.840605 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.840583    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl"
Jul 16 09:15:37.842963 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.842943    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rjjjz\""
Jul 16 09:15:37.842963 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.842952    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 16 09:15:37.851061 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.851037    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp"]
Jul 16 09:15:37.854837 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.854817    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-429pl"]
Jul 16 09:15:37.854951 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.854928    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp"
Jul 16 09:15:37.857319 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.857304    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 16 09:15:37.857583 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.857560    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qs9cn\""
Jul 16 09:15:37.872184 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.872162    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp"]
Jul 16 09:15:37.872615 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.872587    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:37.973956 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.973919    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/492ca2c5-62be-4a5d-99cd-e2446d9a8e4a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wkcpp\" (UID: \"492ca2c5-62be-4a5d-99cd-e2446d9a8e4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp"
Jul 16 09:15:37.974136 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.973992    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kvz5\" (UniqueName: \"kubernetes.io/projected/e39d1c52-32ee-4793-91b9-8ceaba429e5b-kube-api-access-9kvz5\") pod \"kserve-controller-manager-d6f4b65b8-429pl\" (UID: \"e39d1c52-32ee-4793-91b9-8ceaba429e5b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl"
Jul 16 09:15:37.974136 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.974021    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xtwt\" (UniqueName: \"kubernetes.io/projected/492ca2c5-62be-4a5d-99cd-e2446d9a8e4a-kube-api-access-2xtwt\") pod \"llmisvc-controller-manager-777c6bd7d5-wkcpp\" (UID: \"492ca2c5-62be-4a5d-99cd-e2446d9a8e4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp"
Jul 16 09:15:37.974136 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:37.974053    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e39d1c52-32ee-4793-91b9-8ceaba429e5b-cert\") pod \"kserve-controller-manager-d6f4b65b8-429pl\" (UID: \"e39d1c52-32ee-4793-91b9-8ceaba429e5b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl"
Jul 16 09:15:38.074861 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:38.074769    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/492ca2c5-62be-4a5d-99cd-e2446d9a8e4a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wkcpp\" (UID: \"492ca2c5-62be-4a5d-99cd-e2446d9a8e4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp"
Jul 16 09:15:38.074861 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:38.074830    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kvz5\" (UniqueName: \"kubernetes.io/projected/e39d1c52-32ee-4793-91b9-8ceaba429e5b-kube-api-access-9kvz5\") pod \"kserve-controller-manager-d6f4b65b8-429pl\" (UID: \"e39d1c52-32ee-4793-91b9-8ceaba429e5b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl"
Jul 16 09:15:38.074861 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:38.074859    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xtwt\" (UniqueName: \"kubernetes.io/projected/492ca2c5-62be-4a5d-99cd-e2446d9a8e4a-kube-api-access-2xtwt\") pod \"llmisvc-controller-manager-777c6bd7d5-wkcpp\" (UID: \"492ca2c5-62be-4a5d-99cd-e2446d9a8e4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp"
Jul 16 09:15:38.075147 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:38.074890    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e39d1c52-32ee-4793-91b9-8ceaba429e5b-cert\") pod \"kserve-controller-manager-d6f4b65b8-429pl\" (UID: \"e39d1c52-32ee-4793-91b9-8ceaba429e5b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl"
Jul 16 09:15:38.075147 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:15:38.074928    2556 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 16 09:15:38.075147 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:15:38.075008    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/492ca2c5-62be-4a5d-99cd-e2446d9a8e4a-cert podName:492ca2c5-62be-4a5d-99cd-e2446d9a8e4a nodeName:}" failed. No retries permitted until 2026-07-16 09:15:38.574985682 +0000 UTC m=+646.398837234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/492ca2c5-62be-4a5d-99cd-e2446d9a8e4a-cert") pod "llmisvc-controller-manager-777c6bd7d5-wkcpp" (UID: "492ca2c5-62be-4a5d-99cd-e2446d9a8e4a") : secret "llmisvc-webhook-server-cert" not found
Jul 16 09:15:38.075147 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:15:38.075019    2556 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 16 09:15:38.075147 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:15:38.075064    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e39d1c52-32ee-4793-91b9-8ceaba429e5b-cert podName:e39d1c52-32ee-4793-91b9-8ceaba429e5b nodeName:}" failed. No retries permitted until 2026-07-16 09:15:38.575047281 +0000 UTC m=+646.398898829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e39d1c52-32ee-4793-91b9-8ceaba429e5b-cert") pod "kserve-controller-manager-d6f4b65b8-429pl" (UID: "e39d1c52-32ee-4793-91b9-8ceaba429e5b") : secret "kserve-webhook-server-cert" not found
Jul 16 09:15:38.084803 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:38.084777    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kvz5\" (UniqueName: \"kubernetes.io/projected/e39d1c52-32ee-4793-91b9-8ceaba429e5b-kube-api-access-9kvz5\") pod \"kserve-controller-manager-d6f4b65b8-429pl\" (UID: \"e39d1c52-32ee-4793-91b9-8ceaba429e5b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl"
Jul 16 09:15:38.086325 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:38.086303    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xtwt\" (UniqueName: \"kubernetes.io/projected/492ca2c5-62be-4a5d-99cd-e2446d9a8e4a-kube-api-access-2xtwt\") pod \"llmisvc-controller-manager-777c6bd7d5-wkcpp\" (UID: \"492ca2c5-62be-4a5d-99cd-e2446d9a8e4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp"
Jul 16 09:15:38.236231 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:38.236191    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:38.579835 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:38.579799    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/492ca2c5-62be-4a5d-99cd-e2446d9a8e4a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wkcpp\" (UID: \"492ca2c5-62be-4a5d-99cd-e2446d9a8e4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp"
Jul 16 09:15:38.580040 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:38.579874    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e39d1c52-32ee-4793-91b9-8ceaba429e5b-cert\") pod \"kserve-controller-manager-d6f4b65b8-429pl\" (UID: \"e39d1c52-32ee-4793-91b9-8ceaba429e5b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl"
Jul 16 09:15:38.580040 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:15:38.580005    2556 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 16 09:15:38.580210 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:15:38.580061    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e39d1c52-32ee-4793-91b9-8ceaba429e5b-cert podName:e39d1c52-32ee-4793-91b9-8ceaba429e5b nodeName:}" failed. No retries permitted until 2026-07-16 09:15:39.580047539 +0000 UTC m=+647.403899085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e39d1c52-32ee-4793-91b9-8ceaba429e5b-cert") pod "kserve-controller-manager-d6f4b65b8-429pl" (UID: "e39d1c52-32ee-4793-91b9-8ceaba429e5b") : secret "kserve-webhook-server-cert" not found
Jul 16 09:15:38.582254 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:38.582216    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/492ca2c5-62be-4a5d-99cd-e2446d9a8e4a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wkcpp\" (UID: \"492ca2c5-62be-4a5d-99cd-e2446d9a8e4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp"
Jul 16 09:15:38.760165 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:38.760131    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:38.764644 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:38.764610    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp"
Jul 16 09:15:38.923321 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:38.923291    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp"]
Jul 16 09:15:38.926001 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:15:38.925975    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod492ca2c5_62be_4a5d_99cd_e2446d9a8e4a.slice/crio-483939cd9d94750b02246dd761fccfd25f219ff36e76b9c82cf497c0c88ecf5c WatchSource:0}: Error finding container 483939cd9d94750b02246dd761fccfd25f219ff36e76b9c82cf497c0c88ecf5c: Status 404 returned error can't find the container with id 483939cd9d94750b02246dd761fccfd25f219ff36e76b9c82cf497c0c88ecf5c
Jul 16 09:15:39.037798 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:39.037770    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:39.137135 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:39.137062    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:39.141048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:39.141020    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp" event={"ID":"492ca2c5-62be-4a5d-99cd-e2446d9a8e4a","Type":"ContainerStarted","Data":"483939cd9d94750b02246dd761fccfd25f219ff36e76b9c82cf497c0c88ecf5c"}
Jul 16 09:15:39.288830 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:39.288802    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:15:39.587116 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:39.587088    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e39d1c52-32ee-4793-91b9-8ceaba429e5b-cert\") pod \"kserve-controller-manager-d6f4b65b8-429pl\" (UID: \"e39d1c52-32ee-4793-91b9-8ceaba429e5b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl"
Jul 16 09:15:39.589161 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:39.589142    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e39d1c52-32ee-4793-91b9-8ceaba429e5b-cert\") pod \"kserve-controller-manager-d6f4b65b8-429pl\" (UID: \"e39d1c52-32ee-4793-91b9-8ceaba429e5b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl"
Jul 16 09:15:39.652931 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:39.652902    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl"
Jul 16 09:15:39.821125 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:39.821077    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-429pl"]
Jul 16 09:15:39.824650 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:15:39.824624    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode39d1c52_32ee_4793_91b9_8ceaba429e5b.slice/crio-5aa578e375924db902a259393f5ec470077a78a22e4c1cf67e2d11a683b88df4 WatchSource:0}: Error finding container 5aa578e375924db902a259393f5ec470077a78a22e4c1cf67e2d11a683b88df4: Status 404 returned error can't find the container with id 5aa578e375924db902a259393f5ec470077a78a22e4c1cf67e2d11a683b88df4
Jul 16 09:15:40.148663 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:40.148629    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl" event={"ID":"e39d1c52-32ee-4793-91b9-8ceaba429e5b","Type":"ContainerStarted","Data":"5aa578e375924db902a259393f5ec470077a78a22e4c1cf67e2d11a683b88df4"}
Jul 16 09:15:40.771869 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:40.771831    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"]
Jul 16 09:15:40.772061 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:40.772037    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q" podUID="f7c58087-d483-42ee-80bd-5cbca290ec82" containerName="discovery" containerID="cri-o://40e640ac5823cfd5511e076990f11825b7968e0364a1809ebe46303af78673d0" gracePeriod=30
Jul 16 09:15:41.063673 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.063645    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:41.157856 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.157819    2556 generic.go:356] "Generic (PLEG): container finished" podID="f7c58087-d483-42ee-80bd-5cbca290ec82" containerID="40e640ac5823cfd5511e076990f11825b7968e0364a1809ebe46303af78673d0" exitCode=0
Jul 16 09:15:41.158325 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.157878    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q" event={"ID":"f7c58087-d483-42ee-80bd-5cbca290ec82","Type":"ContainerDied","Data":"40e640ac5823cfd5511e076990f11825b7968e0364a1809ebe46303af78673d0"}
Jul 16 09:15:41.158325 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.157922    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q" event={"ID":"f7c58087-d483-42ee-80bd-5cbca290ec82","Type":"ContainerDied","Data":"28a9bf25a2d30f225f7407729f6640d3b411c43f36615de51f8a47598461c693"}
Jul 16 09:15:41.158325 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.157947    2556 scope.go:117] "RemoveContainer" containerID="40e640ac5823cfd5511e076990f11825b7968e0364a1809ebe46303af78673d0"
Jul 16 09:15:41.158325 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.158100    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"
Jul 16 09:15:41.201571 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.201540    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-kubeconfig\") pod \"f7c58087-d483-42ee-80bd-5cbca290ec82\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") "
Jul 16 09:15:41.201731 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.201588    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-cacerts\") pod \"f7c58087-d483-42ee-80bd-5cbca290ec82\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") "
Jul 16 09:15:41.201731 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.201629    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-token\") pod \"f7c58087-d483-42ee-80bd-5cbca290ec82\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") "
Jul 16 09:15:41.201731 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.201695    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-csr-dns-cert\") pod \"f7c58087-d483-42ee-80bd-5cbca290ec82\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") "
Jul 16 09:15:41.201731 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.201716    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7c58087-d483-42ee-80bd-5cbca290ec82-local-certs\") pod \"f7c58087-d483-42ee-80bd-5cbca290ec82\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") "
Jul 16 09:15:41.201942 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.201753    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twrbn\" (UniqueName: \"kubernetes.io/projected/f7c58087-d483-42ee-80bd-5cbca290ec82-kube-api-access-twrbn\") pod \"f7c58087-d483-42ee-80bd-5cbca290ec82\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") "
Jul 16 09:15:41.201942 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.201780    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-csr-ca-configmap\") pod \"f7c58087-d483-42ee-80bd-5cbca290ec82\" (UID: \"f7c58087-d483-42ee-80bd-5cbca290ec82\") "
Jul 16 09:15:41.202339 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.202294    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f7c58087-d483-42ee-80bd-5cbca290ec82" (UID: "f7c58087-d483-42ee-80bd-5cbca290ec82"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:15:41.205381 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.205319    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-token" (OuterVolumeSpecName: "istio-token") pod "f7c58087-d483-42ee-80bd-5cbca290ec82" (UID: "f7c58087-d483-42ee-80bd-5cbca290ec82"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:15:41.206377 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.206214    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f7c58087-d483-42ee-80bd-5cbca290ec82" (UID: "f7c58087-d483-42ee-80bd-5cbca290ec82"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:15:41.206377 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.206326    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7c58087-d483-42ee-80bd-5cbca290ec82-kube-api-access-twrbn" (OuterVolumeSpecName: "kube-api-access-twrbn") pod "f7c58087-d483-42ee-80bd-5cbca290ec82" (UID: "f7c58087-d483-42ee-80bd-5cbca290ec82"). InnerVolumeSpecName "kube-api-access-twrbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:15:41.206377 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.206329    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f7c58087-d483-42ee-80bd-5cbca290ec82" (UID: "f7c58087-d483-42ee-80bd-5cbca290ec82"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:15:41.206602 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.206478    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-cacerts" (OuterVolumeSpecName: "cacerts") pod "f7c58087-d483-42ee-80bd-5cbca290ec82" (UID: "f7c58087-d483-42ee-80bd-5cbca290ec82"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:15:41.206831 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.206805    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7c58087-d483-42ee-80bd-5cbca290ec82-local-certs" (OuterVolumeSpecName: "local-certs") pod "f7c58087-d483-42ee-80bd-5cbca290ec82" (UID: "f7c58087-d483-42ee-80bd-5cbca290ec82"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:15:41.302701 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.302633    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-token\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:15:41.302701 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.302660    2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-csr-dns-cert\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:15:41.302701 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.302672    2556 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7c58087-d483-42ee-80bd-5cbca290ec82-local-certs\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:15:41.302701 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.302687    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twrbn\" (UniqueName: \"kubernetes.io/projected/f7c58087-d483-42ee-80bd-5cbca290ec82-kube-api-access-twrbn\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:15:41.302701 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.302700    2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-csr-ca-configmap\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:15:41.302981 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.302713    2556 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-istio-kubeconfig\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:15:41.302981 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.302727    2556 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7c58087-d483-42ee-80bd-5cbca290ec82-cacerts\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:15:41.485235 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.485185    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"]
Jul 16 09:15:41.491588 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.491560    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rm59q"]
Jul 16 09:15:41.670267 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.670244    2556 scope.go:117] "RemoveContainer" containerID="40e640ac5823cfd5511e076990f11825b7968e0364a1809ebe46303af78673d0"
Jul 16 09:15:41.670595 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:15:41.670566    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40e640ac5823cfd5511e076990f11825b7968e0364a1809ebe46303af78673d0\": container with ID starting with 40e640ac5823cfd5511e076990f11825b7968e0364a1809ebe46303af78673d0 not found: ID does not exist" containerID="40e640ac5823cfd5511e076990f11825b7968e0364a1809ebe46303af78673d0"
Jul 16 09:15:41.670705 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:41.670599    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40e640ac5823cfd5511e076990f11825b7968e0364a1809ebe46303af78673d0"} err="failed to get container status \"40e640ac5823cfd5511e076990f11825b7968e0364a1809ebe46303af78673d0\": rpc error: code = NotFound desc = could not find container \"40e640ac5823cfd5511e076990f11825b7968e0364a1809ebe46303af78673d0\": container with ID starting with 40e640ac5823cfd5511e076990f11825b7968e0364a1809ebe46303af78673d0 not found: ID does not exist"
Jul 16 09:15:42.106299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:42.106218    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-98swb"
Jul 16 09:15:42.166715 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:42.166672    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp" event={"ID":"492ca2c5-62be-4a5d-99cd-e2446d9a8e4a","Type":"ContainerStarted","Data":"af41794ef38a72aee97359eb4eeb3efb9f874a2a25bc177af7753eefaca6b97d"}
Jul 16 09:15:42.167204 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:42.166752    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp"
Jul 16 09:15:42.189004 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:42.188949    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp" podStartSLOduration=2.395080271 podStartE2EDuration="5.188928226s" totalImagesPullingTime="2.793847955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:15:42.185669219 +0000 UTC m=+650.009520813" watchObservedRunningTime="2026-07-16 09:15:42.188928226 +0000 UTC m=+650.012779798"
Jul 16 09:15:42.720331 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:42.720290    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7c58087-d483-42ee-80bd-5cbca290ec82" path="/var/lib/kubelet/pods/f7c58087-d483-42ee-80bd-5cbca290ec82/volumes"
Jul 16 09:15:43.174677 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:43.174646    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl" event={"ID":"e39d1c52-32ee-4793-91b9-8ceaba429e5b","Type":"ContainerStarted","Data":"d7a233647eeadf12a9e5580dae3c09bf2d1cdf039d0f8907497e826b9b16ae69"}
Jul 16 09:15:43.175062 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:43.174838    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl"
Jul 16 09:15:43.194829 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:15:43.194771    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl" podStartSLOduration=3.16423462 podStartE2EDuration="6.194753467s" totalImagesPullingTime="3.030518847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:15:43.193801714 +0000 UTC m=+651.017653283" watchObservedRunningTime="2026-07-16 09:15:43.194753467 +0000 UTC m=+651.018605036"
Jul 16 09:16:06.205213 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:06.205174    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:10.809133 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:10.809096    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:10.873386 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:10.873339    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:13.177713 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:13.177685    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wkcpp"
Jul 16 09:16:14.185932 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:14.185901    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-429pl"
Jul 16 09:16:26.717552 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.717517    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:26.816576 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.816537    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:26.823241 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.823216    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrfsg"]
Jul 16 09:16:26.823555 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.823543    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7c58087-d483-42ee-80bd-5cbca290ec82" containerName="discovery"
Jul 16 09:16:26.823601 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.823557    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7c58087-d483-42ee-80bd-5cbca290ec82" containerName="discovery"
Jul 16 09:16:26.823635 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.823615    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7c58087-d483-42ee-80bd-5cbca290ec82" containerName="discovery"
Jul 16 09:16:26.826184 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.826166    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zrfsg"
Jul 16 09:16:26.829693 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.829674    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 09:16:26.830401 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.830379    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zdghw\""
Jul 16 09:16:26.830521 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.830407    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 09:16:26.837997 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.837973    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrfsg"]
Jul 16 09:16:26.860082 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.860055    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs5f7\" (UniqueName: \"kubernetes.io/projected/9c013604-1fd2-4424-b571-c375293d9734-kube-api-access-hs5f7\") pod \"kuadrant-operator-catalog-zrfsg\" (UID: \"9c013604-1fd2-4424-b571-c375293d9734\") " pod="kuadrant-system/kuadrant-operator-catalog-zrfsg"
Jul 16 09:16:26.916070 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.916035    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:26.961248 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.961219    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs5f7\" (UniqueName: \"kubernetes.io/projected/9c013604-1fd2-4424-b571-c375293d9734-kube-api-access-hs5f7\") pod \"kuadrant-operator-catalog-zrfsg\" (UID: \"9c013604-1fd2-4424-b571-c375293d9734\") " pod="kuadrant-system/kuadrant-operator-catalog-zrfsg"
Jul 16 09:16:26.969342 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:26.969289    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs5f7\" (UniqueName: \"kubernetes.io/projected/9c013604-1fd2-4424-b571-c375293d9734-kube-api-access-hs5f7\") pod \"kuadrant-operator-catalog-zrfsg\" (UID: \"9c013604-1fd2-4424-b571-c375293d9734\") " pod="kuadrant-system/kuadrant-operator-catalog-zrfsg"
Jul 16 09:16:27.137752 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:27.137724    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zrfsg"
Jul 16 09:16:27.187415 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:27.187382    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrfsg"]
Jul 16 09:16:27.272835 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:27.272811    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrfsg"]
Jul 16 09:16:27.274973 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:16:27.274937    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c013604_1fd2_4424_b571_c375293d9734.slice/crio-3e725f94d37b645b19054e2047ea2010854ccb416028b5296251e27a442ddab6 WatchSource:0}: Error finding container 3e725f94d37b645b19054e2047ea2010854ccb416028b5296251e27a442ddab6: Status 404 returned error can't find the container with id 3e725f94d37b645b19054e2047ea2010854ccb416028b5296251e27a442ddab6
Jul 16 09:16:27.383138 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:27.383107    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zrfsg" event={"ID":"9c013604-1fd2-4424-b571-c375293d9734","Type":"ContainerStarted","Data":"3e725f94d37b645b19054e2047ea2010854ccb416028b5296251e27a442ddab6"}
Jul 16 09:16:27.428728 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:27.428692    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bgsjn"]
Jul 16 09:16:27.433088 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:27.433065    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bgsjn"
Jul 16 09:16:27.454423 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:27.453213    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bgsjn"]
Jul 16 09:16:27.464855 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:27.464820    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tg74\" (UniqueName: \"kubernetes.io/projected/b078d349-85dd-4b86-942b-f082811ed203-kube-api-access-5tg74\") pod \"kuadrant-operator-catalog-bgsjn\" (UID: \"b078d349-85dd-4b86-942b-f082811ed203\") " pod="kuadrant-system/kuadrant-operator-catalog-bgsjn"
Jul 16 09:16:27.566029 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:27.565970    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tg74\" (UniqueName: \"kubernetes.io/projected/b078d349-85dd-4b86-942b-f082811ed203-kube-api-access-5tg74\") pod \"kuadrant-operator-catalog-bgsjn\" (UID: \"b078d349-85dd-4b86-942b-f082811ed203\") " pod="kuadrant-system/kuadrant-operator-catalog-bgsjn"
Jul 16 09:16:27.574962 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:27.574934    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tg74\" (UniqueName: \"kubernetes.io/projected/b078d349-85dd-4b86-942b-f082811ed203-kube-api-access-5tg74\") pod \"kuadrant-operator-catalog-bgsjn\" (UID: \"b078d349-85dd-4b86-942b-f082811ed203\") " pod="kuadrant-system/kuadrant-operator-catalog-bgsjn"
Jul 16 09:16:27.742410 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:27.742388    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bgsjn"
Jul 16 09:16:27.868822 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:27.868797    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bgsjn"]
Jul 16 09:16:27.870482 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:16:27.870451    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb078d349_85dd_4b86_942b_f082811ed203.slice/crio-128cc55df33476ef036d86fc53150a995cf82e029047adf3627d4dd2feeb09c0 WatchSource:0}: Error finding container 128cc55df33476ef036d86fc53150a995cf82e029047adf3627d4dd2feeb09c0: Status 404 returned error can't find the container with id 128cc55df33476ef036d86fc53150a995cf82e029047adf3627d4dd2feeb09c0
Jul 16 09:16:28.390017 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:28.389983    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bgsjn" event={"ID":"b078d349-85dd-4b86-942b-f082811ed203","Type":"ContainerStarted","Data":"128cc55df33476ef036d86fc53150a995cf82e029047adf3627d4dd2feeb09c0"}
Jul 16 09:16:30.402256 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:30.402160    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bgsjn" event={"ID":"b078d349-85dd-4b86-942b-f082811ed203","Type":"ContainerStarted","Data":"688eb157e2c85af7c7c669c104a2414ced0aa5af5321ef56065b3c575509bcc5"}
Jul 16 09:16:30.403669 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:30.403644    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zrfsg" event={"ID":"9c013604-1fd2-4424-b571-c375293d9734","Type":"ContainerStarted","Data":"a1def9676c684ef8f56e662eabeaae74be407149dc7c19b13ea2fccd3120b9d3"}
Jul 16 09:16:30.403785 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:30.403683    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zrfsg" podUID="9c013604-1fd2-4424-b571-c375293d9734" containerName="registry-server" containerID="cri-o://a1def9676c684ef8f56e662eabeaae74be407149dc7c19b13ea2fccd3120b9d3" gracePeriod=2
Jul 16 09:16:30.421223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:30.421180    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bgsjn" podStartSLOduration=1.169776636 podStartE2EDuration="3.421162178s" totalImagesPullingTime="2.251385542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:16:30.419175425 +0000 UTC m=+698.243027007" watchObservedRunningTime="2026-07-16 09:16:30.421162178 +0000 UTC m=+698.245013748"
Jul 16 09:16:30.438304 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:30.438262    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zrfsg" podStartSLOduration=1.594538724 podStartE2EDuration="4.438249499s" totalImagesPullingTime="2.843710775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:16:30.436326204 +0000 UTC m=+698.260177800" watchObservedRunningTime="2026-07-16 09:16:30.438249499 +0000 UTC m=+698.262101069"
Jul 16 09:16:30.442133 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:16:30.442112    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c013604_1fd2_4424_b571_c375293d9734.slice/crio-a1def9676c684ef8f56e662eabeaae74be407149dc7c19b13ea2fccd3120b9d3.scope\": RecentStats: unable to find data in memory cache]"
Jul 16 09:16:30.641100 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:30.641067    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zrfsg"
Jul 16 09:16:30.693387 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:30.693344    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs5f7\" (UniqueName: \"kubernetes.io/projected/9c013604-1fd2-4424-b571-c375293d9734-kube-api-access-hs5f7\") pod \"9c013604-1fd2-4424-b571-c375293d9734\" (UID: \"9c013604-1fd2-4424-b571-c375293d9734\") "
Jul 16 09:16:30.695336 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:30.695317    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c013604-1fd2-4424-b571-c375293d9734-kube-api-access-hs5f7" (OuterVolumeSpecName: "kube-api-access-hs5f7") pod "9c013604-1fd2-4424-b571-c375293d9734" (UID: "9c013604-1fd2-4424-b571-c375293d9734"). InnerVolumeSpecName "kube-api-access-hs5f7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:16:30.794493 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:30.794474    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs5f7\" (UniqueName: \"kubernetes.io/projected/9c013604-1fd2-4424-b571-c375293d9734-kube-api-access-hs5f7\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:16:31.409573 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:31.409495    2556 generic.go:356] "Generic (PLEG): container finished" podID="9c013604-1fd2-4424-b571-c375293d9734" containerID="a1def9676c684ef8f56e662eabeaae74be407149dc7c19b13ea2fccd3120b9d3" exitCode=0
Jul 16 09:16:31.409573 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:31.409535    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zrfsg"
Jul 16 09:16:31.409988 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:31.409569    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zrfsg" event={"ID":"9c013604-1fd2-4424-b571-c375293d9734","Type":"ContainerDied","Data":"a1def9676c684ef8f56e662eabeaae74be407149dc7c19b13ea2fccd3120b9d3"}
Jul 16 09:16:31.409988 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:31.409620    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zrfsg" event={"ID":"9c013604-1fd2-4424-b571-c375293d9734","Type":"ContainerDied","Data":"3e725f94d37b645b19054e2047ea2010854ccb416028b5296251e27a442ddab6"}
Jul 16 09:16:31.409988 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:31.409647    2556 scope.go:117] "RemoveContainer" containerID="a1def9676c684ef8f56e662eabeaae74be407149dc7c19b13ea2fccd3120b9d3"
Jul 16 09:16:31.418397 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:31.418380    2556 scope.go:117] "RemoveContainer" containerID="a1def9676c684ef8f56e662eabeaae74be407149dc7c19b13ea2fccd3120b9d3"
Jul 16 09:16:31.418646 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:16:31.418629    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1def9676c684ef8f56e662eabeaae74be407149dc7c19b13ea2fccd3120b9d3\": container with ID starting with a1def9676c684ef8f56e662eabeaae74be407149dc7c19b13ea2fccd3120b9d3 not found: ID does not exist" containerID="a1def9676c684ef8f56e662eabeaae74be407149dc7c19b13ea2fccd3120b9d3"
Jul 16 09:16:31.418692 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:31.418653    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1def9676c684ef8f56e662eabeaae74be407149dc7c19b13ea2fccd3120b9d3"} err="failed to get container status \"a1def9676c684ef8f56e662eabeaae74be407149dc7c19b13ea2fccd3120b9d3\": rpc error: code = NotFound desc = could not find container \"a1def9676c684ef8f56e662eabeaae74be407149dc7c19b13ea2fccd3120b9d3\": container with ID starting with a1def9676c684ef8f56e662eabeaae74be407149dc7c19b13ea2fccd3120b9d3 not found: ID does not exist"
Jul 16 09:16:31.428654 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:31.428632    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrfsg"]
Jul 16 09:16:31.432646 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:31.432627    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrfsg"]
Jul 16 09:16:32.717987 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:32.717955    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c013604-1fd2-4424-b571-c375293d9734" path="/var/lib/kubelet/pods/9c013604-1fd2-4424-b571-c375293d9734/volumes"
Jul 16 09:16:36.885637 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:36.885604    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dc7b8fc55-gmvtg"]
Jul 16 09:16:36.886025 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:36.885923    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c013604-1fd2-4424-b571-c375293d9734" containerName="registry-server"
Jul 16 09:16:36.886025 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:36.885934    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c013604-1fd2-4424-b571-c375293d9734" containerName="registry-server"
Jul 16 09:16:36.886025 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:36.885998    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c013604-1fd2-4424-b571-c375293d9734" containerName="registry-server"
Jul 16 09:16:36.889147 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:36.889127    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:36.901926 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:36.901903    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc7b8fc55-gmvtg"]
Jul 16 09:16:36.945463 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:36.945439    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-console-oauth-config\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:36.945565 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:36.945470    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-console-config\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:36.945565 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:36.945495    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-console-serving-cert\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:36.945565 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:36.945513    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-trusted-ca-bundle\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:36.945680 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:36.945579    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-service-ca\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:36.945680 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:36.945626    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-oauth-serving-cert\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:36.945680 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:36.945643    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7rpw\" (UniqueName: \"kubernetes.io/projected/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-kube-api-access-m7rpw\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:36.956088 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:36.956066    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:37.046169 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.046142    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-console-oauth-config\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.046312 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.046174    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-console-config\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.046312 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.046199    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-console-serving-cert\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.046312 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.046266    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-trusted-ca-bundle\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.046476 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.046313    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-service-ca\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.046476 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.046375    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-oauth-serving-cert\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.046476 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.046399    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7rpw\" (UniqueName: \"kubernetes.io/projected/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-kube-api-access-m7rpw\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.046981 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.046958    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-service-ca\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.046981 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.046968    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-console-config\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.047126 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.047067    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-oauth-serving-cert\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.047270 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.047248    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-trusted-ca-bundle\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.048659 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.048641    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-console-serving-cert\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.048852 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.048835    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-console-oauth-config\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.055012 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.054993    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7rpw\" (UniqueName: \"kubernetes.io/projected/6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc-kube-api-access-m7rpw\") pod \"console-dc7b8fc55-gmvtg\" (UID: \"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc\") " pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.060546 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.060525    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:37.198758 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.198730    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:37.201151 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.201115    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:37.339134 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.339109    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc7b8fc55-gmvtg"]
Jul 16 09:16:37.341116 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:16:37.341091    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6939bcb3_4e29_4d2e_a87c_5f6c5bf5b9fc.slice/crio-ba095238df6097762077a482aaf31fd85802fa4ca39c1b7da86efa4f89b465ee WatchSource:0}: Error finding container ba095238df6097762077a482aaf31fd85802fa4ca39c1b7da86efa4f89b465ee: Status 404 returned error can't find the container with id ba095238df6097762077a482aaf31fd85802fa4ca39c1b7da86efa4f89b465ee
Jul 16 09:16:37.440002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.439971    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc7b8fc55-gmvtg" event={"ID":"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc","Type":"ContainerStarted","Data":"0ff831bd740bf224c054c1fa2fcdb703b4b79152650db3671d1aa62c2df9db63"}
Jul 16 09:16:37.440002 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.440017    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc7b8fc55-gmvtg" event={"ID":"6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc","Type":"ContainerStarted","Data":"ba095238df6097762077a482aaf31fd85802fa4ca39c1b7da86efa4f89b465ee"}
Jul 16 09:16:37.464230 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.464122    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dc7b8fc55-gmvtg" podStartSLOduration=1.464105818 podStartE2EDuration="1.464105818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:16:37.462842326 +0000 UTC m=+705.286693897" watchObservedRunningTime="2026-07-16 09:16:37.464105818 +0000 UTC m=+705.287957387"
Jul 16 09:16:37.683855 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.683822    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:37.743467 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.743399    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-bgsjn"
Jul 16 09:16:37.743467 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.743463    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-bgsjn"
Jul 16 09:16:37.765469 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:37.765445    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-bgsjn"
Jul 16 09:16:38.467229 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:38.467203    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-bgsjn"
Jul 16 09:16:42.243611 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.243578    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"]
Jul 16 09:16:42.246930 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.246909    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"
Jul 16 09:16:42.249457 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.249439    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dnnrv\""
Jul 16 09:16:42.255970 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.255947    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"]
Jul 16 09:16:42.290138 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.290110    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf\" (UID: \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"
Jul 16 09:16:42.290250 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.290165    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf\" (UID: \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"
Jul 16 09:16:42.290311 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.290244    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-662xl\" (UniqueName: \"kubernetes.io/projected/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-kube-api-access-662xl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf\" (UID: \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"
Jul 16 09:16:42.391173 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.391142    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-662xl\" (UniqueName: \"kubernetes.io/projected/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-kube-api-access-662xl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf\" (UID: \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"
Jul 16 09:16:42.391315 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.391216    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf\" (UID: \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"
Jul 16 09:16:42.391421 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.391336    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf\" (UID: \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"
Jul 16 09:16:42.391571 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.391556    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf\" (UID: \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"
Jul 16 09:16:42.391636 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.391620    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf\" (UID: \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"
Jul 16 09:16:42.399828 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.399806    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-662xl\" (UniqueName: \"kubernetes.io/projected/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-kube-api-access-662xl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf\" (UID: \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"
Jul 16 09:16:42.556799 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.556719    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"
Jul 16 09:16:42.684684 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.684656    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"]
Jul 16 09:16:42.686381 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:16:42.686343    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd43e22e5_3903_4879_a8b8_25f7ccfd3f80.slice/crio-d55097713219c664f95e495928a89ae31c49d36ca1072dec7b86fdd10b5e2674 WatchSource:0}: Error finding container d55097713219c664f95e495928a89ae31c49d36ca1072dec7b86fdd10b5e2674: Status 404 returned error can't find the container with id d55097713219c664f95e495928a89ae31c49d36ca1072dec7b86fdd10b5e2674
Jul 16 09:16:42.838221 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.838137    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"]
Jul 16 09:16:42.841989 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.841967    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"
Jul 16 09:16:42.850738 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.850708    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"]
Jul 16 09:16:42.900215 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.895640    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p\" (UID: \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"
Jul 16 09:16:42.900215 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.895736    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p\" (UID: \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"
Jul 16 09:16:42.900215 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.895801    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sn8w\" (UniqueName: \"kubernetes.io/projected/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-kube-api-access-6sn8w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p\" (UID: \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"
Jul 16 09:16:42.996496 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.996461    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p\" (UID: \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"
Jul 16 09:16:42.996669 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.996523    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sn8w\" (UniqueName: \"kubernetes.io/projected/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-kube-api-access-6sn8w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p\" (UID: \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"
Jul 16 09:16:42.996669 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.996571    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p\" (UID: \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"
Jul 16 09:16:42.996950 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.996926    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p\" (UID: \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"
Jul 16 09:16:42.996991 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:42.996936    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p\" (UID: \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"
Jul 16 09:16:43.004529 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.004508    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sn8w\" (UniqueName: \"kubernetes.io/projected/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-kube-api-access-6sn8w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p\" (UID: \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"
Jul 16 09:16:43.157699 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.157617    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"
Jul 16 09:16:43.244554 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.244522    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"]
Jul 16 09:16:43.249610 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.249586    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"
Jul 16 09:16:43.255169 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.255142    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"]
Jul 16 09:16:43.292090 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.292069    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"]
Jul 16 09:16:43.293628 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:16:43.293602    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b87cf89_a5e5_43e9_a542_bc85c3af0d3a.slice/crio-7149f195366658a1455a29e7cccaaa1ca63545c7c32678c40f140f6afb1d5910 WatchSource:0}: Error finding container 7149f195366658a1455a29e7cccaaa1ca63545c7c32678c40f140f6afb1d5910: Status 404 returned error can't find the container with id 7149f195366658a1455a29e7cccaaa1ca63545c7c32678c40f140f6afb1d5910
Jul 16 09:16:43.299496 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.299452    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqcqs\" (UniqueName: \"kubernetes.io/projected/fb53d53e-8e13-4560-a62f-80c30f22950e-kube-api-access-tqcqs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks\" (UID: \"fb53d53e-8e13-4560-a62f-80c30f22950e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"
Jul 16 09:16:43.299496 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.299483    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb53d53e-8e13-4560-a62f-80c30f22950e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks\" (UID: \"fb53d53e-8e13-4560-a62f-80c30f22950e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"
Jul 16 09:16:43.299567 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.299526    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb53d53e-8e13-4560-a62f-80c30f22950e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks\" (UID: \"fb53d53e-8e13-4560-a62f-80c30f22950e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"
Jul 16 09:16:43.400706 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.400681    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqcqs\" (UniqueName: \"kubernetes.io/projected/fb53d53e-8e13-4560-a62f-80c30f22950e-kube-api-access-tqcqs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks\" (UID: \"fb53d53e-8e13-4560-a62f-80c30f22950e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"
Jul 16 09:16:43.400827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.400728    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb53d53e-8e13-4560-a62f-80c30f22950e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks\" (UID: \"fb53d53e-8e13-4560-a62f-80c30f22950e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"
Jul 16 09:16:43.400827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.400799    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb53d53e-8e13-4560-a62f-80c30f22950e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks\" (UID: \"fb53d53e-8e13-4560-a62f-80c30f22950e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"
Jul 16 09:16:43.401103 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.401082    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb53d53e-8e13-4560-a62f-80c30f22950e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks\" (UID: \"fb53d53e-8e13-4560-a62f-80c30f22950e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"
Jul 16 09:16:43.401180 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.401121    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb53d53e-8e13-4560-a62f-80c30f22950e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks\" (UID: \"fb53d53e-8e13-4560-a62f-80c30f22950e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"
Jul 16 09:16:43.408561 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.408510    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqcqs\" (UniqueName: \"kubernetes.io/projected/fb53d53e-8e13-4560-a62f-80c30f22950e-kube-api-access-tqcqs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks\" (UID: \"fb53d53e-8e13-4560-a62f-80c30f22950e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"
Jul 16 09:16:43.470672 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.470640    2556 generic.go:356] "Generic (PLEG): container finished" podID="3b87cf89-a5e5-43e9-a542-bc85c3af0d3a" containerID="b234c416885012b8ec4c9469816df0238a4649177fc32eaef3fab33c0208b46d" exitCode=0
Jul 16 09:16:43.470925 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.470705    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p" event={"ID":"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a","Type":"ContainerDied","Data":"b234c416885012b8ec4c9469816df0238a4649177fc32eaef3fab33c0208b46d"}
Jul 16 09:16:43.470925 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.470755    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p" event={"ID":"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a","Type":"ContainerStarted","Data":"7149f195366658a1455a29e7cccaaa1ca63545c7c32678c40f140f6afb1d5910"}
Jul 16 09:16:43.472379 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.472340    2556 generic.go:356] "Generic (PLEG): container finished" podID="d43e22e5-3903-4879-a8b8-25f7ccfd3f80" containerID="da872dee532c04b9af357cd2a275b8893981da858e4f1616b4f9fc6f2f152ebd" exitCode=0
Jul 16 09:16:43.472459 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.472407    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf" event={"ID":"d43e22e5-3903-4879-a8b8-25f7ccfd3f80","Type":"ContainerDied","Data":"da872dee532c04b9af357cd2a275b8893981da858e4f1616b4f9fc6f2f152ebd"}
Jul 16 09:16:43.472459 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.472436    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf" event={"ID":"d43e22e5-3903-4879-a8b8-25f7ccfd3f80","Type":"ContainerStarted","Data":"d55097713219c664f95e495928a89ae31c49d36ca1072dec7b86fdd10b5e2674"}
Jul 16 09:16:43.562161 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.562136    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"
Jul 16 09:16:43.650403 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.650375    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"]
Jul 16 09:16:43.656623 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.656601    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"
Jul 16 09:16:43.661105 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.661048    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"]
Jul 16 09:16:43.694828 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.694795    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"]
Jul 16 09:16:43.696273 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:16:43.696245    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb53d53e_8e13_4560_a62f_80c30f22950e.slice/crio-729c3cbf09ee9d0800f57e3e7a825639800e7ec68c627e73e4c80bc5e679c8f9 WatchSource:0}: Error finding container 729c3cbf09ee9d0800f57e3e7a825639800e7ec68c627e73e4c80bc5e679c8f9: Status 404 returned error can't find the container with id 729c3cbf09ee9d0800f57e3e7a825639800e7ec68c627e73e4c80bc5e679c8f9
Jul 16 09:16:43.704658 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.704636    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc1b602-ed45-4019-82bd-ae191e6a51c2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597\" (UID: \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"
Jul 16 09:16:43.704746 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.704675    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9x5k\" (UniqueName: \"kubernetes.io/projected/7fc1b602-ed45-4019-82bd-ae191e6a51c2-kube-api-access-h9x5k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597\" (UID: \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"
Jul 16 09:16:43.704746 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.704715    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc1b602-ed45-4019-82bd-ae191e6a51c2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597\" (UID: \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"
Jul 16 09:16:43.806019 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.805995    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc1b602-ed45-4019-82bd-ae191e6a51c2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597\" (UID: \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"
Jul 16 09:16:43.806107 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.806035    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9x5k\" (UniqueName: \"kubernetes.io/projected/7fc1b602-ed45-4019-82bd-ae191e6a51c2-kube-api-access-h9x5k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597\" (UID: \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"
Jul 16 09:16:43.806107 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.806072    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc1b602-ed45-4019-82bd-ae191e6a51c2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597\" (UID: \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"
Jul 16 09:16:43.806406 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.806389    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc1b602-ed45-4019-82bd-ae191e6a51c2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597\" (UID: \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"
Jul 16 09:16:43.806446 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.806391    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc1b602-ed45-4019-82bd-ae191e6a51c2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597\" (UID: \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"
Jul 16 09:16:43.814563 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.814542    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9x5k\" (UniqueName: \"kubernetes.io/projected/7fc1b602-ed45-4019-82bd-ae191e6a51c2-kube-api-access-h9x5k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597\" (UID: \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"
Jul 16 09:16:43.970855 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:43.970820    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"
Jul 16 09:16:44.102469 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:44.102447    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"]
Jul 16 09:16:44.123359 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:16:44.123323    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc1b602_ed45_4019_82bd_ae191e6a51c2.slice/crio-30e86bd4dc5d000ae3c11dc56271ac86888e702ecf81c55f2bfc7e04963077d6 WatchSource:0}: Error finding container 30e86bd4dc5d000ae3c11dc56271ac86888e702ecf81c55f2bfc7e04963077d6: Status 404 returned error can't find the container with id 30e86bd4dc5d000ae3c11dc56271ac86888e702ecf81c55f2bfc7e04963077d6
Jul 16 09:16:44.478906 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:44.478854    2556 generic.go:356] "Generic (PLEG): container finished" podID="3b87cf89-a5e5-43e9-a542-bc85c3af0d3a" containerID="81beb6f60b7291925d6631985c9353c44136657dd4343cc85e2516c213f9b723" exitCode=0
Jul 16 09:16:44.479239 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:44.478942    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p" event={"ID":"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a","Type":"ContainerDied","Data":"81beb6f60b7291925d6631985c9353c44136657dd4343cc85e2516c213f9b723"}
Jul 16 09:16:44.480483 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:44.480461    2556 generic.go:356] "Generic (PLEG): container finished" podID="7fc1b602-ed45-4019-82bd-ae191e6a51c2" containerID="6cc7936de1df15653151e0abed393796f6b8476895838f9a6c0de34b29b791a4" exitCode=0
Jul 16 09:16:44.480587 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:44.480521    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597" event={"ID":"7fc1b602-ed45-4019-82bd-ae191e6a51c2","Type":"ContainerDied","Data":"6cc7936de1df15653151e0abed393796f6b8476895838f9a6c0de34b29b791a4"}
Jul 16 09:16:44.480587 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:44.480567    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597" event={"ID":"7fc1b602-ed45-4019-82bd-ae191e6a51c2","Type":"ContainerStarted","Data":"30e86bd4dc5d000ae3c11dc56271ac86888e702ecf81c55f2bfc7e04963077d6"}
Jul 16 09:16:44.482110 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:44.482090    2556 generic.go:356] "Generic (PLEG): container finished" podID="fb53d53e-8e13-4560-a62f-80c30f22950e" containerID="8320a718febbf9d43da78c1c7786fa94f1bd8227935b9f534bf475fe4db1c23b" exitCode=0
Jul 16 09:16:44.482198 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:44.482175    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks" event={"ID":"fb53d53e-8e13-4560-a62f-80c30f22950e","Type":"ContainerDied","Data":"8320a718febbf9d43da78c1c7786fa94f1bd8227935b9f534bf475fe4db1c23b"}
Jul 16 09:16:44.482255 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:44.482222    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks" event={"ID":"fb53d53e-8e13-4560-a62f-80c30f22950e","Type":"ContainerStarted","Data":"729c3cbf09ee9d0800f57e3e7a825639800e7ec68c627e73e4c80bc5e679c8f9"}
Jul 16 09:16:44.484344 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:44.484324    2556 generic.go:356] "Generic (PLEG): container finished" podID="d43e22e5-3903-4879-a8b8-25f7ccfd3f80" containerID="a0d891899309674e5f38fc65da1c1aa2623e0db2461d8b759b23bb30f4e01521" exitCode=0
Jul 16 09:16:44.484485 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:44.484390    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf" event={"ID":"d43e22e5-3903-4879-a8b8-25f7ccfd3f80","Type":"ContainerDied","Data":"a0d891899309674e5f38fc65da1c1aa2623e0db2461d8b759b23bb30f4e01521"}
Jul 16 09:16:45.491837 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:45.491805    2556 generic.go:356] "Generic (PLEG): container finished" podID="d43e22e5-3903-4879-a8b8-25f7ccfd3f80" containerID="8ad02bea6b192871b5d0e7cc3caa0356cc2ac1be58a2d07cfdf44b06c709a9d1" exitCode=0
Jul 16 09:16:45.492146 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:45.491840    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf" event={"ID":"d43e22e5-3903-4879-a8b8-25f7ccfd3f80","Type":"ContainerDied","Data":"8ad02bea6b192871b5d0e7cc3caa0356cc2ac1be58a2d07cfdf44b06c709a9d1"}
Jul 16 09:16:45.493957 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:45.493932    2556 generic.go:356] "Generic (PLEG): container finished" podID="3b87cf89-a5e5-43e9-a542-bc85c3af0d3a" containerID="7b90aaca10914734ecb979c7f09795ca9c75a7d66ac4ece36fe2976edf66d59a" exitCode=0
Jul 16 09:16:45.494071 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:45.494003    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p" event={"ID":"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a","Type":"ContainerDied","Data":"7b90aaca10914734ecb979c7f09795ca9c75a7d66ac4ece36fe2976edf66d59a"}
Jul 16 09:16:45.495724 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:45.495704    2556 generic.go:356] "Generic (PLEG): container finished" podID="7fc1b602-ed45-4019-82bd-ae191e6a51c2" containerID="0419cdff456f1eac0542b52964a195f54e9b141834c025bcc4b957e1fed66d81" exitCode=0
Jul 16 09:16:45.495821 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:45.495768    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597" event={"ID":"7fc1b602-ed45-4019-82bd-ae191e6a51c2","Type":"ContainerDied","Data":"0419cdff456f1eac0542b52964a195f54e9b141834c025bcc4b957e1fed66d81"}
Jul 16 09:16:45.497681 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:45.497660    2556 generic.go:356] "Generic (PLEG): container finished" podID="fb53d53e-8e13-4560-a62f-80c30f22950e" containerID="a21549f5e2704b5b2095773338441f4a38731c56aefa07b4b67de496e11bb1fc" exitCode=0
Jul 16 09:16:45.497794 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:45.497705    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks" event={"ID":"fb53d53e-8e13-4560-a62f-80c30f22950e","Type":"ContainerDied","Data":"a21549f5e2704b5b2095773338441f4a38731c56aefa07b4b67de496e11bb1fc"}
Jul 16 09:16:46.505247 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.505215    2556 generic.go:356] "Generic (PLEG): container finished" podID="7fc1b602-ed45-4019-82bd-ae191e6a51c2" containerID="94163a0e155b43af41cc041c145ab9ae8cc3a8eb3e0853c14752c1944628c120" exitCode=0
Jul 16 09:16:46.505710 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.505282    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597" event={"ID":"7fc1b602-ed45-4019-82bd-ae191e6a51c2","Type":"ContainerDied","Data":"94163a0e155b43af41cc041c145ab9ae8cc3a8eb3e0853c14752c1944628c120"}
Jul 16 09:16:46.507398 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.507379    2556 generic.go:356] "Generic (PLEG): container finished" podID="fb53d53e-8e13-4560-a62f-80c30f22950e" containerID="31d7901f004a6b6598bf862f653d70edffb250fd1adad66da3afa3b0b3ff2744" exitCode=0
Jul 16 09:16:46.507503 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.507444    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks" event={"ID":"fb53d53e-8e13-4560-a62f-80c30f22950e","Type":"ContainerDied","Data":"31d7901f004a6b6598bf862f653d70edffb250fd1adad66da3afa3b0b3ff2744"}
Jul 16 09:16:46.643152 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.643128    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"
Jul 16 09:16:46.680858 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.680838    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"
Jul 16 09:16:46.731722 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.731653    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-bundle\") pod \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\" (UID: \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\") "
Jul 16 09:16:46.731722 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.731684    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-util\") pod \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\" (UID: \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\") "
Jul 16 09:16:46.731722 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.731705    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-util\") pod \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\" (UID: \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\") "
Jul 16 09:16:46.732328 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.731740    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-bundle\") pod \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\" (UID: \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\") "
Jul 16 09:16:46.732328 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.731818    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-662xl\" (UniqueName: \"kubernetes.io/projected/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-kube-api-access-662xl\") pod \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\" (UID: \"d43e22e5-3903-4879-a8b8-25f7ccfd3f80\") "
Jul 16 09:16:46.732328 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.731851    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sn8w\" (UniqueName: \"kubernetes.io/projected/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-kube-api-access-6sn8w\") pod \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\" (UID: \"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a\") "
Jul 16 09:16:46.732328 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.732235    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-bundle" (OuterVolumeSpecName: "bundle") pod "d43e22e5-3903-4879-a8b8-25f7ccfd3f80" (UID: "d43e22e5-3903-4879-a8b8-25f7ccfd3f80"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:16:46.732611 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.732500    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-bundle" (OuterVolumeSpecName: "bundle") pod "3b87cf89-a5e5-43e9-a542-bc85c3af0d3a" (UID: "3b87cf89-a5e5-43e9-a542-bc85c3af0d3a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:16:46.734540 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.734515    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-kube-api-access-662xl" (OuterVolumeSpecName: "kube-api-access-662xl") pod "d43e22e5-3903-4879-a8b8-25f7ccfd3f80" (UID: "d43e22e5-3903-4879-a8b8-25f7ccfd3f80"). InnerVolumeSpecName "kube-api-access-662xl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:16:46.734621 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.734569    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-kube-api-access-6sn8w" (OuterVolumeSpecName: "kube-api-access-6sn8w") pod "3b87cf89-a5e5-43e9-a542-bc85c3af0d3a" (UID: "3b87cf89-a5e5-43e9-a542-bc85c3af0d3a"). InnerVolumeSpecName "kube-api-access-6sn8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:16:46.737914 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.737884    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-util" (OuterVolumeSpecName: "util") pod "3b87cf89-a5e5-43e9-a542-bc85c3af0d3a" (UID: "3b87cf89-a5e5-43e9-a542-bc85c3af0d3a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:16:46.738420 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.738401    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-util" (OuterVolumeSpecName: "util") pod "d43e22e5-3903-4879-a8b8-25f7ccfd3f80" (UID: "d43e22e5-3903-4879-a8b8-25f7ccfd3f80"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:16:46.832721 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.832673    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-662xl\" (UniqueName: \"kubernetes.io/projected/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-kube-api-access-662xl\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:16:46.832721 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.832715    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sn8w\" (UniqueName: \"kubernetes.io/projected/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-kube-api-access-6sn8w\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:16:46.832721 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.832729    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-bundle\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:16:46.832936 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.832744    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-util\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:16:46.832936 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.832755    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d43e22e5-3903-4879-a8b8-25f7ccfd3f80-util\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:16:46.832936 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:46.832765    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b87cf89-a5e5-43e9-a542-bc85c3af0d3a-bundle\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:16:47.199582 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.199556    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:47.199770 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.199639    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:47.204488 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.204466    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:47.513877 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.513794    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p"
Jul 16 09:16:47.513877 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.513823    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p" event={"ID":"3b87cf89-a5e5-43e9-a542-bc85c3af0d3a","Type":"ContainerDied","Data":"7149f195366658a1455a29e7cccaaa1ca63545c7c32678c40f140f6afb1d5910"}
Jul 16 09:16:47.513877 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.513873    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7149f195366658a1455a29e7cccaaa1ca63545c7c32678c40f140f6afb1d5910"
Jul 16 09:16:47.515790 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.515772    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf"
Jul 16 09:16:47.515918 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.515821    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf" event={"ID":"d43e22e5-3903-4879-a8b8-25f7ccfd3f80","Type":"ContainerDied","Data":"d55097713219c664f95e495928a89ae31c49d36ca1072dec7b86fdd10b5e2674"}
Jul 16 09:16:47.515918 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.515866    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d55097713219c664f95e495928a89ae31c49d36ca1072dec7b86fdd10b5e2674"
Jul 16 09:16:47.522048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.522027    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dc7b8fc55-gmvtg"
Jul 16 09:16:47.571190 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.571144    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fdc5767f-snltt"]
Jul 16 09:16:47.672814 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.672785    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:47.691900 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.691877    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"
Jul 16 09:16:47.694921 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.694900    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"
Jul 16 09:16:47.740243 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.740217    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqcqs\" (UniqueName: \"kubernetes.io/projected/fb53d53e-8e13-4560-a62f-80c30f22950e-kube-api-access-tqcqs\") pod \"fb53d53e-8e13-4560-a62f-80c30f22950e\" (UID: \"fb53d53e-8e13-4560-a62f-80c30f22950e\") "
Jul 16 09:16:47.740398 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.740251    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb53d53e-8e13-4560-a62f-80c30f22950e-util\") pod \"fb53d53e-8e13-4560-a62f-80c30f22950e\" (UID: \"fb53d53e-8e13-4560-a62f-80c30f22950e\") "
Jul 16 09:16:47.740398 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.740288    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb53d53e-8e13-4560-a62f-80c30f22950e-bundle\") pod \"fb53d53e-8e13-4560-a62f-80c30f22950e\" (UID: \"fb53d53e-8e13-4560-a62f-80c30f22950e\") "
Jul 16 09:16:47.740520 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.740419    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9x5k\" (UniqueName: \"kubernetes.io/projected/7fc1b602-ed45-4019-82bd-ae191e6a51c2-kube-api-access-h9x5k\") pod \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\" (UID: \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\") "
Jul 16 09:16:47.740520 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.740458    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc1b602-ed45-4019-82bd-ae191e6a51c2-bundle\") pod \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\" (UID: \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\") "
Jul 16 09:16:47.740628 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.740521    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc1b602-ed45-4019-82bd-ae191e6a51c2-util\") pod \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\" (UID: \"7fc1b602-ed45-4019-82bd-ae191e6a51c2\") "
Jul 16 09:16:47.740920 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.740897    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb53d53e-8e13-4560-a62f-80c30f22950e-bundle" (OuterVolumeSpecName: "bundle") pod "fb53d53e-8e13-4560-a62f-80c30f22950e" (UID: "fb53d53e-8e13-4560-a62f-80c30f22950e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:16:47.740986 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.740966    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fc1b602-ed45-4019-82bd-ae191e6a51c2-bundle" (OuterVolumeSpecName: "bundle") pod "7fc1b602-ed45-4019-82bd-ae191e6a51c2" (UID: "7fc1b602-ed45-4019-82bd-ae191e6a51c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:16:47.742623 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.742592    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb53d53e-8e13-4560-a62f-80c30f22950e-kube-api-access-tqcqs" (OuterVolumeSpecName: "kube-api-access-tqcqs") pod "fb53d53e-8e13-4560-a62f-80c30f22950e" (UID: "fb53d53e-8e13-4560-a62f-80c30f22950e"). InnerVolumeSpecName "kube-api-access-tqcqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:16:47.743139 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.743119    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fc1b602-ed45-4019-82bd-ae191e6a51c2-kube-api-access-h9x5k" (OuterVolumeSpecName: "kube-api-access-h9x5k") pod "7fc1b602-ed45-4019-82bd-ae191e6a51c2" (UID: "7fc1b602-ed45-4019-82bd-ae191e6a51c2"). InnerVolumeSpecName "kube-api-access-h9x5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:16:47.746618 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.746596    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb53d53e-8e13-4560-a62f-80c30f22950e-util" (OuterVolumeSpecName: "util") pod "fb53d53e-8e13-4560-a62f-80c30f22950e" (UID: "fb53d53e-8e13-4560-a62f-80c30f22950e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:16:47.749817 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.749786    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fc1b602-ed45-4019-82bd-ae191e6a51c2-util" (OuterVolumeSpecName: "util") pod "7fc1b602-ed45-4019-82bd-ae191e6a51c2" (UID: "7fc1b602-ed45-4019-82bd-ae191e6a51c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:16:47.771057 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.771001    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:47.841744 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.841720    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc1b602-ed45-4019-82bd-ae191e6a51c2-util\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:16:47.841744 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.841743    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqcqs\" (UniqueName: \"kubernetes.io/projected/fb53d53e-8e13-4560-a62f-80c30f22950e-kube-api-access-tqcqs\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:16:47.841889 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.841754    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb53d53e-8e13-4560-a62f-80c30f22950e-util\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:16:47.841889 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.841763    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb53d53e-8e13-4560-a62f-80c30f22950e-bundle\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:16:47.841889 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.841772    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9x5k\" (UniqueName: \"kubernetes.io/projected/7fc1b602-ed45-4019-82bd-ae191e6a51c2-kube-api-access-h9x5k\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:16:47.841889 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.841780    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc1b602-ed45-4019-82bd-ae191e6a51c2-bundle\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:16:47.898473 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.898453    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:47.994779 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:47.994756    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:48.522686 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:48.522662    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597"
Jul 16 09:16:48.523072 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:48.522655    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597" event={"ID":"7fc1b602-ed45-4019-82bd-ae191e6a51c2","Type":"ContainerDied","Data":"30e86bd4dc5d000ae3c11dc56271ac86888e702ecf81c55f2bfc7e04963077d6"}
Jul 16 09:16:48.523072 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:48.522784    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30e86bd4dc5d000ae3c11dc56271ac86888e702ecf81c55f2bfc7e04963077d6"
Jul 16 09:16:48.524593 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:48.524570    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks"
Jul 16 09:16:48.524692 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:48.524613    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks" event={"ID":"fb53d53e-8e13-4560-a62f-80c30f22950e","Type":"ContainerDied","Data":"729c3cbf09ee9d0800f57e3e7a825639800e7ec68c627e73e4c80bc5e679c8f9"}
Jul 16 09:16:48.524692 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:48.524648    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="729c3cbf09ee9d0800f57e3e7a825639800e7ec68c627e73e4c80bc5e679c8f9"
Jul 16 09:16:50.191892 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:50.191863    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:52.625393 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.625367    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gthjp"]
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626182    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d43e22e5-3903-4879-a8b8-25f7ccfd3f80" containerName="util"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626251    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d43e22e5-3903-4879-a8b8-25f7ccfd3f80" containerName="util"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626263    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b87cf89-a5e5-43e9-a542-bc85c3af0d3a" containerName="pull"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626271    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b87cf89-a5e5-43e9-a542-bc85c3af0d3a" containerName="pull"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626302    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fc1b602-ed45-4019-82bd-ae191e6a51c2" containerName="util"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626312    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc1b602-ed45-4019-82bd-ae191e6a51c2" containerName="util"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626326    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fc1b602-ed45-4019-82bd-ae191e6a51c2" containerName="pull"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626334    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc1b602-ed45-4019-82bd-ae191e6a51c2" containerName="pull"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626370    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b87cf89-a5e5-43e9-a542-bc85c3af0d3a" containerName="util"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626379    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b87cf89-a5e5-43e9-a542-bc85c3af0d3a" containerName="util"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626392    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b87cf89-a5e5-43e9-a542-bc85c3af0d3a" containerName="extract"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626401    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b87cf89-a5e5-43e9-a542-bc85c3af0d3a" containerName="extract"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626418    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb53d53e-8e13-4560-a62f-80c30f22950e" containerName="pull"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626427    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb53d53e-8e13-4560-a62f-80c30f22950e" containerName="pull"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626476    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d43e22e5-3903-4879-a8b8-25f7ccfd3f80" containerName="pull"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626486    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d43e22e5-3903-4879-a8b8-25f7ccfd3f80" containerName="pull"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626494    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d43e22e5-3903-4879-a8b8-25f7ccfd3f80" containerName="extract"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626502    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d43e22e5-3903-4879-a8b8-25f7ccfd3f80" containerName="extract"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626523    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb53d53e-8e13-4560-a62f-80c30f22950e" containerName="util"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626531    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb53d53e-8e13-4560-a62f-80c30f22950e" containerName="util"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626541    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb53d53e-8e13-4560-a62f-80c30f22950e" containerName="extract"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626556    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb53d53e-8e13-4560-a62f-80c30f22950e" containerName="extract"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626569    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fc1b602-ed45-4019-82bd-ae191e6a51c2" containerName="extract"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626577    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc1b602-ed45-4019-82bd-ae191e6a51c2" containerName="extract"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626825    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b87cf89-a5e5-43e9-a542-bc85c3af0d3a" containerName="extract"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626852    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fc1b602-ed45-4019-82bd-ae191e6a51c2" containerName="extract"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626861    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb53d53e-8e13-4560-a62f-80c30f22950e" containerName="extract"
Jul 16 09:16:52.628599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.626870    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d43e22e5-3903-4879-a8b8-25f7ccfd3f80" containerName="extract"
Jul 16 09:16:52.632516 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.632490    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gthjp"
Jul 16 09:16:52.635899 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.635872    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 16 09:16:52.637129 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.637104    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bgn7d\""
Jul 16 09:16:52.640314 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.640290    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gthjp"]
Jul 16 09:16:52.784217 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.784189    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk6nn\" (UniqueName: \"kubernetes.io/projected/a10edabc-b532-4b0c-b5d6-52d2239ec79b-kube-api-access-gk6nn\") pod \"dns-operator-controller-manager-864dd78c4c-gthjp\" (UID: \"a10edabc-b532-4b0c-b5d6-52d2239ec79b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gthjp"
Jul 16 09:16:52.884927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.884852    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk6nn\" (UniqueName: \"kubernetes.io/projected/a10edabc-b532-4b0c-b5d6-52d2239ec79b-kube-api-access-gk6nn\") pod \"dns-operator-controller-manager-864dd78c4c-gthjp\" (UID: \"a10edabc-b532-4b0c-b5d6-52d2239ec79b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gthjp"
Jul 16 09:16:52.900206 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.900174    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk6nn\" (UniqueName: \"kubernetes.io/projected/a10edabc-b532-4b0c-b5d6-52d2239ec79b-kube-api-access-gk6nn\") pod \"dns-operator-controller-manager-864dd78c4c-gthjp\" (UID: \"a10edabc-b532-4b0c-b5d6-52d2239ec79b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gthjp"
Jul 16 09:16:52.945084 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:52.945058    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gthjp"
Jul 16 09:16:53.084498 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:53.084469    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gthjp"]
Jul 16 09:16:53.086017 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:16:53.085991    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda10edabc_b532_4b0c_b5d6_52d2239ec79b.slice/crio-9a1664aa983905859a617d29a593eaaec2b59449530321fa405d2b4b5673be5f WatchSource:0}: Error finding container 9a1664aa983905859a617d29a593eaaec2b59449530321fa405d2b4b5673be5f: Status 404 returned error can't find the container with id 9a1664aa983905859a617d29a593eaaec2b59449530321fa405d2b4b5673be5f
Jul 16 09:16:53.551686 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:53.551644    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gthjp" event={"ID":"a10edabc-b532-4b0c-b5d6-52d2239ec79b","Type":"ContainerStarted","Data":"9a1664aa983905859a617d29a593eaaec2b59449530321fa405d2b4b5673be5f"}
Jul 16 09:16:54.189898 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:54.189867    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:55.563515 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:55.563478    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gthjp" event={"ID":"a10edabc-b532-4b0c-b5d6-52d2239ec79b","Type":"ContainerStarted","Data":"ffaf95b9b6b51fe25b90e4097312b7a9a8a7e4a08c6ac11ddc3aa43983735066"}
Jul 16 09:16:55.563876 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:55.563587    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gthjp"
Jul 16 09:16:55.582980 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:55.582936    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gthjp" podStartSLOduration=1.675860954 podStartE2EDuration="3.58292363s" totalImagesPullingTime="1.907062676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:16:55.581297132 +0000 UTC m=+723.405148701" watchObservedRunningTime="2026-07-16 09:16:55.58292363 +0000 UTC m=+723.406775199"
Jul 16 09:16:56.273435 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:56.273397    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"]
Jul 16 09:16:56.276969 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:56.276947    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:16:56.279688 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:56.279669    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-x27fj\""
Jul 16 09:16:56.287385 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:56.287364    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"]
Jul 16 09:16:56.418150 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:56.418094    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqmh7\" (UniqueName: \"kubernetes.io/projected/af998ea8-bb09-4768-9081-5c88fed5bc29-kube-api-access-kqmh7\") pod \"limitador-operator-controller-manager-859d7b78bd-gmkrt\" (UID: \"af998ea8-bb09-4768-9081-5c88fed5bc29\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:16:56.519014 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:56.518982    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqmh7\" (UniqueName: \"kubernetes.io/projected/af998ea8-bb09-4768-9081-5c88fed5bc29-kube-api-access-kqmh7\") pod \"limitador-operator-controller-manager-859d7b78bd-gmkrt\" (UID: \"af998ea8-bb09-4768-9081-5c88fed5bc29\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:16:56.531291 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:56.531229    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqmh7\" (UniqueName: \"kubernetes.io/projected/af998ea8-bb09-4768-9081-5c88fed5bc29-kube-api-access-kqmh7\") pod \"limitador-operator-controller-manager-859d7b78bd-gmkrt\" (UID: \"af998ea8-bb09-4768-9081-5c88fed5bc29\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:16:56.587491 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:56.587468    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:16:56.737715 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:56.737694    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"]
Jul 16 09:16:56.740242 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:16:56.740216    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf998ea8_bb09_4768_9081_5c88fed5bc29.slice/crio-e120ccb79642e56a262bf76e3ed44893e183da44aa882eb4e76e27f082b0356d WatchSource:0}: Error finding container e120ccb79642e56a262bf76e3ed44893e183da44aa882eb4e76e27f082b0356d: Status 404 returned error can't find the container with id e120ccb79642e56a262bf76e3ed44893e183da44aa882eb4e76e27f082b0356d
Jul 16 09:16:56.983935 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:56.983903    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:16:57.575422 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:57.575389    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt" event={"ID":"af998ea8-bb09-4768-9081-5c88fed5bc29","Type":"ContainerStarted","Data":"e120ccb79642e56a262bf76e3ed44893e183da44aa882eb4e76e27f082b0356d"}
Jul 16 09:16:59.587646 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:59.587604    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt" event={"ID":"af998ea8-bb09-4768-9081-5c88fed5bc29","Type":"ContainerStarted","Data":"c49aef9ce3367890415e7b8c0a90a656e5093233d8579304e781c81b353c1231"}
Jul 16 09:16:59.588056 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:59.587669    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:16:59.608099 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:16:59.608050    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt" podStartSLOduration=1.761424813 podStartE2EDuration="3.608036347s" totalImagesPullingTime="1.846611534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:16:59.605343399 +0000 UTC m=+727.429194986" watchObservedRunningTime="2026-07-16 09:16:59.608036347 +0000 UTC m=+727.431887916"
Jul 16 09:17:00.512165 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:00.512134    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:01.011934 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.011904    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"]
Jul 16 09:17:01.015539 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.015521    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:01.020055 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.020035    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z6zqn\""
Jul 16 09:17:01.028238 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.028214    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"]
Jul 16 09:17:01.159188 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.159149    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0167266-3ac1-426f-b998-1b1461c5aa0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" (UID: \"f0167266-3ac1-426f-b998-1b1461c5aa0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:01.159188 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.159184    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxhk8\" (UniqueName: \"kubernetes.io/projected/f0167266-3ac1-426f-b998-1b1461c5aa0d-kube-api-access-xxhk8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" (UID: \"f0167266-3ac1-426f-b998-1b1461c5aa0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:01.260476 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.260439    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0167266-3ac1-426f-b998-1b1461c5aa0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" (UID: \"f0167266-3ac1-426f-b998-1b1461c5aa0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:01.260649 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.260488    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxhk8\" (UniqueName: \"kubernetes.io/projected/f0167266-3ac1-426f-b998-1b1461c5aa0d-kube-api-access-xxhk8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" (UID: \"f0167266-3ac1-426f-b998-1b1461c5aa0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:01.260828 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.260804    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0167266-3ac1-426f-b998-1b1461c5aa0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" (UID: \"f0167266-3ac1-426f-b998-1b1461c5aa0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:01.272386 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.272299    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxhk8\" (UniqueName: \"kubernetes.io/projected/f0167266-3ac1-426f-b998-1b1461c5aa0d-kube-api-access-xxhk8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" (UID: \"f0167266-3ac1-426f-b998-1b1461c5aa0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:01.326342 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.326304    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:01.385367 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.385301    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:01.471158 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.471137    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"]
Jul 16 09:17:01.473087 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:17:01.473059    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0167266_3ac1_426f_b998_1b1461c5aa0d.slice/crio-be6a99d112f77155a1682fd7d7cc7a25860aaf250de6eaaa067c044e780fee50 WatchSource:0}: Error finding container be6a99d112f77155a1682fd7d7cc7a25860aaf250de6eaaa067c044e780fee50: Status 404 returned error can't find the container with id be6a99d112f77155a1682fd7d7cc7a25860aaf250de6eaaa067c044e780fee50
Jul 16 09:17:01.601597 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.601505    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85" event={"ID":"f0167266-3ac1-426f-b998-1b1461c5aa0d","Type":"ContainerStarted","Data":"be6a99d112f77155a1682fd7d7cc7a25860aaf250de6eaaa067c044e780fee50"}
Jul 16 09:17:01.676445 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.676414    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:01.991534 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:01.991494    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:03.728312 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:03.728274    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:05.083620 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:05.083588    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5lv6j"]
Jul 16 09:17:05.092748 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:05.092696    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5lv6j"
Jul 16 09:17:05.095708 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:05.095676    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dx88w\""
Jul 16 09:17:05.096839 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:05.096806    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5lv6j"]
Jul 16 09:17:05.203477 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:05.203450    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9jbt\" (UniqueName: \"kubernetes.io/projected/ff91031d-8108-4bad-9e5d-03e71afca261-kube-api-access-b9jbt\") pod \"authorino-operator-75cc8d5cb7-5lv6j\" (UID: \"ff91031d-8108-4bad-9e5d-03e71afca261\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5lv6j"
Jul 16 09:17:05.304187 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:05.304153    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9jbt\" (UniqueName: \"kubernetes.io/projected/ff91031d-8108-4bad-9e5d-03e71afca261-kube-api-access-b9jbt\") pod \"authorino-operator-75cc8d5cb7-5lv6j\" (UID: \"ff91031d-8108-4bad-9e5d-03e71afca261\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5lv6j"
Jul 16 09:17:05.313708 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:05.313681    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9jbt\" (UniqueName: \"kubernetes.io/projected/ff91031d-8108-4bad-9e5d-03e71afca261-kube-api-access-b9jbt\") pod \"authorino-operator-75cc8d5cb7-5lv6j\" (UID: \"ff91031d-8108-4bad-9e5d-03e71afca261\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5lv6j"
Jul 16 09:17:05.407698 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:05.407644    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5lv6j"
Jul 16 09:17:05.552363 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:05.552319    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5lv6j"]
Jul 16 09:17:05.554243 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:17:05.554218    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff91031d_8108_4bad_9e5d_03e71afca261.slice/crio-22460c2ed66374d1d1eb4ef1e46f03ad6227a730528bdd64ee17d9b052742cba WatchSource:0}: Error finding container 22460c2ed66374d1d1eb4ef1e46f03ad6227a730528bdd64ee17d9b052742cba: Status 404 returned error can't find the container with id 22460c2ed66374d1d1eb4ef1e46f03ad6227a730528bdd64ee17d9b052742cba
Jul 16 09:17:05.624097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:05.624062    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5lv6j" event={"ID":"ff91031d-8108-4bad-9e5d-03e71afca261","Type":"ContainerStarted","Data":"22460c2ed66374d1d1eb4ef1e46f03ad6227a730528bdd64ee17d9b052742cba"}
Jul 16 09:17:06.234667 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:06.234586    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:06.393765 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:06.393729    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:06.571130 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:06.571049    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gthjp"
Jul 16 09:17:07.212180 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:07.212148    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:07.308870 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:07.308794    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:07.638805 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:07.638707    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85" event={"ID":"f0167266-3ac1-426f-b998-1b1461c5aa0d","Type":"ContainerStarted","Data":"7dc806565300f95868ba1c875213c0b66d3a06011b242402f650caa5dd360da0"}
Jul 16 09:17:07.638805 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:07.638800    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:07.660996 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:07.660938    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85" podStartSLOduration=2.112103549 podStartE2EDuration="7.660918677s" totalImagesPullingTime="5.548815128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:17:07.657717377 +0000 UTC m=+735.481568947" watchObservedRunningTime="2026-07-16 09:17:07.660918677 +0000 UTC m=+735.484770250"
Jul 16 09:17:09.654785 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:09.654747    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5lv6j" event={"ID":"ff91031d-8108-4bad-9e5d-03e71afca261","Type":"ContainerStarted","Data":"5cfbebc8621a9d7ae8288d9c7666938873d98d0d5dba09d42c83214355119744"}
Jul 16 09:17:09.655255 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:09.654818    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5lv6j"
Jul 16 09:17:09.671045 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:09.670974    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5lv6j" podStartSLOduration=1.475116203 podStartE2EDuration="4.670959665s" totalImagesPullingTime="3.195843462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:17:09.670328439 +0000 UTC m=+737.494180007" watchObservedRunningTime="2026-07-16 09:17:09.670959665 +0000 UTC m=+737.494811232"
Jul 16 09:17:09.953373 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:09.953316    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f"]
Jul 16 09:17:09.956884 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:09.956864    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f"
Jul 16 09:17:09.959860 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:09.959840    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 16 09:17:09.960654 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:09.960632    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dnnrv\""
Jul 16 09:17:09.960758 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:09.960662    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 16 09:17:09.969804 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:09.969781    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f"]
Jul 16 09:17:09.983310 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:09.983287    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:10.052234 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.052202    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwqqn\" (UniqueName: \"kubernetes.io/projected/e677dc77-0d3d-4398-bcb7-51b06d4c7ca0-kube-api-access-jwqqn\") pod \"kuadrant-console-plugin-66b5774985-n4z8f\" (UID: \"e677dc77-0d3d-4398-bcb7-51b06d4c7ca0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f"
Jul 16 09:17:10.052406 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.052264    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e677dc77-0d3d-4398-bcb7-51b06d4c7ca0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n4z8f\" (UID: \"e677dc77-0d3d-4398-bcb7-51b06d4c7ca0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f"
Jul 16 09:17:10.052406 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.052339    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e677dc77-0d3d-4398-bcb7-51b06d4c7ca0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n4z8f\" (UID: \"e677dc77-0d3d-4398-bcb7-51b06d4c7ca0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f"
Jul 16 09:17:10.110457 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.110424    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:10.153699 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.153669    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwqqn\" (UniqueName: \"kubernetes.io/projected/e677dc77-0d3d-4398-bcb7-51b06d4c7ca0-kube-api-access-jwqqn\") pod \"kuadrant-console-plugin-66b5774985-n4z8f\" (UID: \"e677dc77-0d3d-4398-bcb7-51b06d4c7ca0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f"
Jul 16 09:17:10.153832 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.153735    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e677dc77-0d3d-4398-bcb7-51b06d4c7ca0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n4z8f\" (UID: \"e677dc77-0d3d-4398-bcb7-51b06d4c7ca0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f"
Jul 16 09:17:10.153929 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.153908    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e677dc77-0d3d-4398-bcb7-51b06d4c7ca0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n4z8f\" (UID: \"e677dc77-0d3d-4398-bcb7-51b06d4c7ca0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f"
Jul 16 09:17:10.154552 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.154532    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e677dc77-0d3d-4398-bcb7-51b06d4c7ca0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n4z8f\" (UID: \"e677dc77-0d3d-4398-bcb7-51b06d4c7ca0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f"
Jul 16 09:17:10.156263 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.156240    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e677dc77-0d3d-4398-bcb7-51b06d4c7ca0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n4z8f\" (UID: \"e677dc77-0d3d-4398-bcb7-51b06d4c7ca0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f"
Jul 16 09:17:10.163046 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.163022    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwqqn\" (UniqueName: \"kubernetes.io/projected/e677dc77-0d3d-4398-bcb7-51b06d4c7ca0-kube-api-access-jwqqn\") pod \"kuadrant-console-plugin-66b5774985-n4z8f\" (UID: \"e677dc77-0d3d-4398-bcb7-51b06d4c7ca0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f"
Jul 16 09:17:10.265839 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.265761    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f"
Jul 16 09:17:10.398644 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.398622    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f"]
Jul 16 09:17:10.400518 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:17:10.400482    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode677dc77_0d3d_4398_bcb7_51b06d4c7ca0.slice/crio-882056c44da6f762befb8eb80792917319e003ddd0d2ea8980cffa5412355ef2 WatchSource:0}: Error finding container 882056c44da6f762befb8eb80792917319e003ddd0d2ea8980cffa5412355ef2: Status 404 returned error can't find the container with id 882056c44da6f762befb8eb80792917319e003ddd0d2ea8980cffa5412355ef2
Jul 16 09:17:10.595389 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.595290    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:17:10.662063 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.662009    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f" event={"ID":"e677dc77-0d3d-4398-bcb7-51b06d4c7ca0","Type":"ContainerStarted","Data":"882056c44da6f762befb8eb80792917319e003ddd0d2ea8980cffa5412355ef2"}
Jul 16 09:17:10.983785 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:10.983749    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:11.099635 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:11.099606    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:12.597759 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.597720    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57fdc5767f-snltt" podUID="68f15fe4-5866-4b3b-91ad-3c33e72dd32a" containerName="console" containerID="cri-o://997d03c1f9e810274454849c01aa0a60e03e86b60aa2c35aa846144d1dd8cf14" gracePeriod=15
Jul 16 09:17:12.889103 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.889075    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:17:12.979958 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.979928    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-service-ca\") pod \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") "
Jul 16 09:17:12.979958 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.979969    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-config\") pod \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") "
Jul 16 09:17:12.980181 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.980005    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-trusted-ca-bundle\") pod \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") "
Jul 16 09:17:12.980181 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.980052    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-oauth-config\") pod \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") "
Jul 16 09:17:12.980181 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.980086    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-oauth-serving-cert\") pod \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") "
Jul 16 09:17:12.980365 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.980182    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzfvt\" (UniqueName: \"kubernetes.io/projected/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-kube-api-access-zzfvt\") pod \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") "
Jul 16 09:17:12.980365 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.980242    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-serving-cert\") pod \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\" (UID: \"68f15fe4-5866-4b3b-91ad-3c33e72dd32a\") "
Jul 16 09:17:12.981160 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.980754    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "68f15fe4-5866-4b3b-91ad-3c33e72dd32a" (UID: "68f15fe4-5866-4b3b-91ad-3c33e72dd32a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:17:12.981160 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.980791    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "68f15fe4-5866-4b3b-91ad-3c33e72dd32a" (UID: "68f15fe4-5866-4b3b-91ad-3c33e72dd32a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:17:12.981160 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.981109    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-service-ca" (OuterVolumeSpecName: "service-ca") pod "68f15fe4-5866-4b3b-91ad-3c33e72dd32a" (UID: "68f15fe4-5866-4b3b-91ad-3c33e72dd32a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:17:12.981421 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.981173    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-config" (OuterVolumeSpecName: "console-config") pod "68f15fe4-5866-4b3b-91ad-3c33e72dd32a" (UID: "68f15fe4-5866-4b3b-91ad-3c33e72dd32a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:17:12.983783 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.983756    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-kube-api-access-zzfvt" (OuterVolumeSpecName: "kube-api-access-zzfvt") pod "68f15fe4-5866-4b3b-91ad-3c33e72dd32a" (UID: "68f15fe4-5866-4b3b-91ad-3c33e72dd32a"). InnerVolumeSpecName "kube-api-access-zzfvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:17:12.984244 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.984210    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "68f15fe4-5866-4b3b-91ad-3c33e72dd32a" (UID: "68f15fe4-5866-4b3b-91ad-3c33e72dd32a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:17:12.984244 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:12.984232    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "68f15fe4-5866-4b3b-91ad-3c33e72dd32a" (UID: "68f15fe4-5866-4b3b-91ad-3c33e72dd32a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:17:13.081248 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.081202    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-config\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:17:13.081248 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.081237    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-trusted-ca-bundle\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:17:13.081248 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.081253    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-oauth-config\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:17:13.081557 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.081267    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-oauth-serving-cert\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:17:13.081557 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.081282    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzfvt\" (UniqueName: \"kubernetes.io/projected/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-kube-api-access-zzfvt\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:17:13.081557 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.081295    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-console-serving-cert\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:17:13.081557 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.081309    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f15fe4-5866-4b3b-91ad-3c33e72dd32a-service-ca\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:17:13.682429 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.682389    2556 generic.go:356] "Generic (PLEG): container finished" podID="68f15fe4-5866-4b3b-91ad-3c33e72dd32a" containerID="997d03c1f9e810274454849c01aa0a60e03e86b60aa2c35aa846144d1dd8cf14" exitCode=0
Jul 16 09:17:13.682885 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.682481    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fdc5767f-snltt" event={"ID":"68f15fe4-5866-4b3b-91ad-3c33e72dd32a","Type":"ContainerDied","Data":"997d03c1f9e810274454849c01aa0a60e03e86b60aa2c35aa846144d1dd8cf14"}
Jul 16 09:17:13.682885 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.682528    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fdc5767f-snltt" event={"ID":"68f15fe4-5866-4b3b-91ad-3c33e72dd32a","Type":"ContainerDied","Data":"b1b22d19ca6a7043dc85878bdd38ed5a51ee2369ae287c5fe67b3b5c34ea24cb"}
Jul 16 09:17:13.682885 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.682554    2556 scope.go:117] "RemoveContainer" containerID="997d03c1f9e810274454849c01aa0a60e03e86b60aa2c35aa846144d1dd8cf14"
Jul 16 09:17:13.682885 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.682703    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fdc5767f-snltt"
Jul 16 09:17:13.696256 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.696234    2556 scope.go:117] "RemoveContainer" containerID="997d03c1f9e810274454849c01aa0a60e03e86b60aa2c35aa846144d1dd8cf14"
Jul 16 09:17:13.696593 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:13.696572    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"997d03c1f9e810274454849c01aa0a60e03e86b60aa2c35aa846144d1dd8cf14\": container with ID starting with 997d03c1f9e810274454849c01aa0a60e03e86b60aa2c35aa846144d1dd8cf14 not found: ID does not exist" containerID="997d03c1f9e810274454849c01aa0a60e03e86b60aa2c35aa846144d1dd8cf14"
Jul 16 09:17:13.696692 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.696606    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"997d03c1f9e810274454849c01aa0a60e03e86b60aa2c35aa846144d1dd8cf14"} err="failed to get container status \"997d03c1f9e810274454849c01aa0a60e03e86b60aa2c35aa846144d1dd8cf14\": rpc error: code = NotFound desc = could not find container \"997d03c1f9e810274454849c01aa0a60e03e86b60aa2c35aa846144d1dd8cf14\": container with ID starting with 997d03c1f9e810274454849c01aa0a60e03e86b60aa2c35aa846144d1dd8cf14 not found: ID does not exist"
Jul 16 09:17:13.718210 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.718174    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fdc5767f-snltt"]
Jul 16 09:17:13.721186 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:13.721156    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57fdc5767f-snltt"]
Jul 16 09:17:14.634618 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:14.634578    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:14.722943 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:14.722906    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68f15fe4-5866-4b3b-91ad-3c33e72dd32a" path="/var/lib/kubelet/pods/68f15fe4-5866-4b3b-91ad-3c33e72dd32a/volumes"
Jul 16 09:17:14.753998 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:14.753962    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:18.650591 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:18.650561    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:19.749472 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:19.749440    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"]
Jul 16 09:17:19.749972 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:19.749957    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68f15fe4-5866-4b3b-91ad-3c33e72dd32a" containerName="console"
Jul 16 09:17:19.750020 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:19.749975    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="68f15fe4-5866-4b3b-91ad-3c33e72dd32a" containerName="console"
Jul 16 09:17:19.750102 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:19.750081    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="68f15fe4-5866-4b3b-91ad-3c33e72dd32a" containerName="console"
Jul 16 09:17:19.767668 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:19.767648    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:19.780519 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:19.780498    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"]
Jul 16 09:17:19.843596 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:19.843558    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0249c96c-03f5-4ae6-80eb-6431f09d61a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nxfj5\" (UID: \"0249c96c-03f5-4ae6-80eb-6431f09d61a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:19.843767 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:19.843708    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zslnk\" (UniqueName: \"kubernetes.io/projected/0249c96c-03f5-4ae6-80eb-6431f09d61a7-kube-api-access-zslnk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nxfj5\" (UID: \"0249c96c-03f5-4ae6-80eb-6431f09d61a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:19.944612 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:19.944570    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zslnk\" (UniqueName: \"kubernetes.io/projected/0249c96c-03f5-4ae6-80eb-6431f09d61a7-kube-api-access-zslnk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nxfj5\" (UID: \"0249c96c-03f5-4ae6-80eb-6431f09d61a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:19.944777 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:19.944631    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0249c96c-03f5-4ae6-80eb-6431f09d61a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nxfj5\" (UID: \"0249c96c-03f5-4ae6-80eb-6431f09d61a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:19.944983 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:19.944955    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0249c96c-03f5-4ae6-80eb-6431f09d61a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nxfj5\" (UID: \"0249c96c-03f5-4ae6-80eb-6431f09d61a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:19.954185 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:19.954159    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zslnk\" (UniqueName: \"kubernetes.io/projected/0249c96c-03f5-4ae6-80eb-6431f09d61a7-kube-api-access-zslnk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nxfj5\" (UID: \"0249c96c-03f5-4ae6-80eb-6431f09d61a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:20.081163 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.080960    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:20.448620 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.448587    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"]
Jul 16 09:17:20.456979 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.456950    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"]
Jul 16 09:17:20.467469 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.467440    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"]
Jul 16 09:17:20.467742 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.467643    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" containerName="manager" containerID="cri-o://7dc806565300f95868ba1c875213c0b66d3a06011b242402f650caa5dd360da0" gracePeriod=2
Jul 16 09:17:20.483674 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.483597    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"]
Jul 16 09:17:20.493530 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:20.493484    2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f0167266-3ac1-426f-b998-1b1461c5aa0d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-vrg85\": pods \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:20.502229 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.502186    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"]
Jul 16 09:17:20.502473 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.502447    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt" podUID="af998ea8-bb09-4768-9081-5c88fed5bc29" containerName="manager" containerID="cri-o://c49aef9ce3367890415e7b8c0a90a656e5093233d8579304e781c81b353c1231" gracePeriod=2
Jul 16 09:17:20.505009 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.504987    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"]
Jul 16 09:17:20.505497 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.505462    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" containerName="manager"
Jul 16 09:17:20.505497 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.505482    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" containerName="manager"
Jul 16 09:17:20.505648 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.505586    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" containerName="manager"
Jul 16 09:17:20.516014 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:20.515967    2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"af998ea8-bb09-4768-9081-5c88fed5bc29\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-gmkrt\": pods \"limitador-operator-controller-manager-859d7b78bd-gmkrt\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:17:20.516779 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.516709    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"]
Jul 16 09:17:20.516883 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.516825    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"
Jul 16 09:17:20.531678 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:20.526601    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:20.531678 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.530093    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"]
Jul 16 09:17:20.531678 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:20.530663    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gmkrt\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="af998ea8-bb09-4768-9081-5c88fed5bc29" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:17:20.547954 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.547912    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9nqwb"]
Jul 16 09:17:20.548183 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:20.548154    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:20.551767 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.551744    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb6e7c29-2d5e-4804-8374-fc38bf3f94e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xp9sg\" (UID: \"cb6e7c29-2d5e-4804-8374-fc38bf3f94e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"
Jul 16 09:17:20.551959 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.551940    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qww9t\" (UniqueName: \"kubernetes.io/projected/cb6e7c29-2d5e-4804-8374-fc38bf3f94e9-kube-api-access-qww9t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xp9sg\" (UID: \"cb6e7c29-2d5e-4804-8374-fc38bf3f94e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"
Jul 16 09:17:20.555858 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.555837    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af998ea8-bb09-4768-9081-5c88fed5bc29" containerName="manager"
Jul 16 09:17:20.555858 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.555859    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="af998ea8-bb09-4768-9081-5c88fed5bc29" containerName="manager"
Jul 16 09:17:20.556017 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.555963    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="af998ea8-bb09-4768-9081-5c88fed5bc29" containerName="manager"
Jul 16 09:17:20.559607 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.559590    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9nqwb"
Jul 16 09:17:20.567283 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.567259    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9nqwb"]
Jul 16 09:17:20.570963 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:20.570932    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gmkrt\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="af998ea8-bb09-4768-9081-5c88fed5bc29" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:17:20.595011 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:20.594961    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:20.653051 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.653017    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zttrw\" (UniqueName: \"kubernetes.io/projected/cb1be6b2-a6f5-4440-992a-e98cd244e5e7-kube-api-access-zttrw\") pod \"limitador-operator-controller-manager-859d7b78bd-9nqwb\" (UID: \"cb1be6b2-a6f5-4440-992a-e98cd244e5e7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9nqwb"
Jul 16 09:17:20.653233 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.653089    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qww9t\" (UniqueName: \"kubernetes.io/projected/cb6e7c29-2d5e-4804-8374-fc38bf3f94e9-kube-api-access-qww9t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xp9sg\" (UID: \"cb6e7c29-2d5e-4804-8374-fc38bf3f94e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"
Jul 16 09:17:20.653233 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.653189    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb6e7c29-2d5e-4804-8374-fc38bf3f94e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xp9sg\" (UID: \"cb6e7c29-2d5e-4804-8374-fc38bf3f94e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"
Jul 16 09:17:20.653509 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.653491    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb6e7c29-2d5e-4804-8374-fc38bf3f94e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xp9sg\" (UID: \"cb6e7c29-2d5e-4804-8374-fc38bf3f94e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"
Jul 16 09:17:20.662622 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.662601    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qww9t\" (UniqueName: \"kubernetes.io/projected/cb6e7c29-2d5e-4804-8374-fc38bf3f94e9-kube-api-access-qww9t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xp9sg\" (UID: \"cb6e7c29-2d5e-4804-8374-fc38bf3f94e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"
Jul 16 09:17:20.665011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.664986    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5lv6j"
Jul 16 09:17:20.689457 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:20.689425    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:20.691141 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:20.691109    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gmkrt\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="af998ea8-bb09-4768-9081-5c88fed5bc29" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:17:20.754970 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.754642    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zttrw\" (UniqueName: \"kubernetes.io/projected/cb1be6b2-a6f5-4440-992a-e98cd244e5e7-kube-api-access-zttrw\") pod \"limitador-operator-controller-manager-859d7b78bd-9nqwb\" (UID: \"cb1be6b2-a6f5-4440-992a-e98cd244e5e7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9nqwb"
Jul 16 09:17:20.763892 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.763867    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zttrw\" (UniqueName: \"kubernetes.io/projected/cb1be6b2-a6f5-4440-992a-e98cd244e5e7-kube-api-access-zttrw\") pod \"limitador-operator-controller-manager-859d7b78bd-9nqwb\" (UID: \"cb1be6b2-a6f5-4440-992a-e98cd244e5e7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9nqwb"
Jul 16 09:17:20.894706 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.894674    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"
Jul 16 09:17:20.902252 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:20.902231    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9nqwb"
Jul 16 09:17:21.594094 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:21.594046    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt" podUID="af998ea8-bb09-4768-9081-5c88fed5bc29" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.42:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 09:17:22.517673 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:22.517635    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:22.727158 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:22.727129    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:25.018372 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:25.018318    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:25.115591 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:25.115559    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:27.839341 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:27.839295    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:27.947314 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:27.947284    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:31.419867 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:31.419827    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:31.517593 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:31.517561    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:32.123031 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.123007    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:32.125309 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:32.125279    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:32.134229 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.134205    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:17:32.136627 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:32.136494    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:32.139668 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:32.139637    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gmkrt\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="af998ea8-bb09-4768-9081-5c88fed5bc29" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:17:32.147045 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.147023    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"]
Jul 16 09:17:32.149137 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:17:32.149111    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb6e7c29_2d5e_4804_8374_fc38bf3f94e9.slice/crio-264d0f8b29e0ffab03e53d9803300e8ac52f983492c9c60a3cd12ff17b98b2d1 WatchSource:0}: Error finding container 264d0f8b29e0ffab03e53d9803300e8ac52f983492c9c60a3cd12ff17b98b2d1: Status 404 returned error can't find the container with id 264d0f8b29e0ffab03e53d9803300e8ac52f983492c9c60a3cd12ff17b98b2d1
Jul 16 09:17:32.170619 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.170592    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9nqwb"]
Jul 16 09:17:32.173227 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:17:32.173191    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1be6b2_a6f5_4440_992a_e98cd244e5e7.slice/crio-537ba4646f908195a69798b94924801245e868f569a9f9e11c08c6b677f7b2fb WatchSource:0}: Error finding container 537ba4646f908195a69798b94924801245e868f569a9f9e11c08c6b677f7b2fb: Status 404 returned error can't find the container with id 537ba4646f908195a69798b94924801245e868f569a9f9e11c08c6b677f7b2fb
Jul 16 09:17:32.261745 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.261719    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxhk8\" (UniqueName: \"kubernetes.io/projected/f0167266-3ac1-426f-b998-1b1461c5aa0d-kube-api-access-xxhk8\") pod \"f0167266-3ac1-426f-b998-1b1461c5aa0d\" (UID: \"f0167266-3ac1-426f-b998-1b1461c5aa0d\") "
Jul 16 09:17:32.261880 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.261774    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqmh7\" (UniqueName: \"kubernetes.io/projected/af998ea8-bb09-4768-9081-5c88fed5bc29-kube-api-access-kqmh7\") pod \"af998ea8-bb09-4768-9081-5c88fed5bc29\" (UID: \"af998ea8-bb09-4768-9081-5c88fed5bc29\") "
Jul 16 09:17:32.261880 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.261843    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0167266-3ac1-426f-b998-1b1461c5aa0d-extensions-socket-volume\") pod \"f0167266-3ac1-426f-b998-1b1461c5aa0d\" (UID: \"f0167266-3ac1-426f-b998-1b1461c5aa0d\") "
Jul 16 09:17:32.262379 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.262340    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0167266-3ac1-426f-b998-1b1461c5aa0d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f0167266-3ac1-426f-b998-1b1461c5aa0d" (UID: "f0167266-3ac1-426f-b998-1b1461c5aa0d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:17:32.263656 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.263635    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0167266-3ac1-426f-b998-1b1461c5aa0d-kube-api-access-xxhk8" (OuterVolumeSpecName: "kube-api-access-xxhk8") pod "f0167266-3ac1-426f-b998-1b1461c5aa0d" (UID: "f0167266-3ac1-426f-b998-1b1461c5aa0d"). InnerVolumeSpecName "kube-api-access-xxhk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:17:32.263728 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.263683    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af998ea8-bb09-4768-9081-5c88fed5bc29-kube-api-access-kqmh7" (OuterVolumeSpecName: "kube-api-access-kqmh7") pod "af998ea8-bb09-4768-9081-5c88fed5bc29" (UID: "af998ea8-bb09-4768-9081-5c88fed5bc29"). InnerVolumeSpecName "kube-api-access-kqmh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:17:32.363076 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.363047    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0167266-3ac1-426f-b998-1b1461c5aa0d-extensions-socket-volume\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:17:32.363076 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.363071    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxhk8\" (UniqueName: \"kubernetes.io/projected/f0167266-3ac1-426f-b998-1b1461c5aa0d-kube-api-access-xxhk8\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:17:32.363076 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.363080    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqmh7\" (UniqueName: \"kubernetes.io/projected/af998ea8-bb09-4768-9081-5c88fed5bc29-kube-api-access-kqmh7\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:17:32.716664 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:32.716618    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:32.718586 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:32.718541    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gmkrt\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="af998ea8-bb09-4768-9081-5c88fed5bc29" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:17:32.718975 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.718945    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af998ea8-bb09-4768-9081-5c88fed5bc29" path="/var/lib/kubelet/pods/af998ea8-bb09-4768-9081-5c88fed5bc29/volumes"
Jul 16 09:17:32.719473 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.719453    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" path="/var/lib/kubelet/pods/f0167266-3ac1-426f-b998-1b1461c5aa0d/volumes"
Jul 16 09:17:32.821832 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.821799    2556 generic.go:356] "Generic (PLEG): container finished" podID="f0167266-3ac1-426f-b998-1b1461c5aa0d" containerID="7dc806565300f95868ba1c875213c0b66d3a06011b242402f650caa5dd360da0" exitCode=0
Jul 16 09:17:32.821974 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.821845    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:32.821974 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.821885    2556 scope.go:117] "RemoveContainer" containerID="7dc806565300f95868ba1c875213c0b66d3a06011b242402f650caa5dd360da0"
Jul 16 09:17:32.824049 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.823976    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg" event={"ID":"cb6e7c29-2d5e-4804-8374-fc38bf3f94e9","Type":"ContainerStarted","Data":"f2cca8d6093b065c59167b58a893d0139e12c4c26a1a3c810d80fab9183c7817"}
Jul 16 09:17:32.824049 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.824034    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg" event={"ID":"cb6e7c29-2d5e-4804-8374-fc38bf3f94e9","Type":"ContainerStarted","Data":"264d0f8b29e0ffab03e53d9803300e8ac52f983492c9c60a3cd12ff17b98b2d1"}
Jul 16 09:17:32.824235 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.824080    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"
Jul 16 09:17:32.825258 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:32.825227    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:32.825854 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.825833    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f" event={"ID":"e677dc77-0d3d-4398-bcb7-51b06d4c7ca0","Type":"ContainerStarted","Data":"30444b07a1e5261221f0b0ed45792b8148a31a535a7aad4b7ed983828f06eb84"}
Jul 16 09:17:32.827622 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.827598    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9nqwb" event={"ID":"cb1be6b2-a6f5-4440-992a-e98cd244e5e7","Type":"ContainerStarted","Data":"cbd5c1ddcd858c1f3a9a6eb4cb1319de49dbc10686211ae891cb9689edf094eb"}
Jul 16 09:17:32.827728 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.827643    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9nqwb" event={"ID":"cb1be6b2-a6f5-4440-992a-e98cd244e5e7","Type":"ContainerStarted","Data":"537ba4646f908195a69798b94924801245e868f569a9f9e11c08c6b677f7b2fb"}
Jul 16 09:17:32.827728 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.827686    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9nqwb"
Jul 16 09:17:32.828229 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:32.828202    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:32.828873 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.828856    2556 generic.go:356] "Generic (PLEG): container finished" podID="af998ea8-bb09-4768-9081-5c88fed5bc29" containerID="c49aef9ce3367890415e7b8c0a90a656e5093233d8579304e781c81b353c1231" exitCode=0
Jul 16 09:17:32.828951 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.828888    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:17:32.831564 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.831548    2556 scope.go:117] "RemoveContainer" containerID="7dc806565300f95868ba1c875213c0b66d3a06011b242402f650caa5dd360da0"
Jul 16 09:17:32.831784 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:32.831768    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dc806565300f95868ba1c875213c0b66d3a06011b242402f650caa5dd360da0\": container with ID starting with 7dc806565300f95868ba1c875213c0b66d3a06011b242402f650caa5dd360da0 not found: ID does not exist" containerID="7dc806565300f95868ba1c875213c0b66d3a06011b242402f650caa5dd360da0"
Jul 16 09:17:32.831825 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.831791    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dc806565300f95868ba1c875213c0b66d3a06011b242402f650caa5dd360da0"} err="failed to get container status \"7dc806565300f95868ba1c875213c0b66d3a06011b242402f650caa5dd360da0\": rpc error: code = NotFound desc = could not find container \"7dc806565300f95868ba1c875213c0b66d3a06011b242402f650caa5dd360da0\": container with ID starting with 7dc806565300f95868ba1c875213c0b66d3a06011b242402f650caa5dd360da0 not found: ID does not exist"
Jul 16 09:17:32.831825 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.831807    2556 scope.go:117] "RemoveContainer" containerID="c49aef9ce3367890415e7b8c0a90a656e5093233d8579304e781c81b353c1231"
Jul 16 09:17:32.839581 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.839565    2556 scope.go:117] "RemoveContainer" containerID="c49aef9ce3367890415e7b8c0a90a656e5093233d8579304e781c81b353c1231"
Jul 16 09:17:32.839807 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:32.839792    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c49aef9ce3367890415e7b8c0a90a656e5093233d8579304e781c81b353c1231\": container with ID starting with c49aef9ce3367890415e7b8c0a90a656e5093233d8579304e781c81b353c1231 not found: ID does not exist" containerID="c49aef9ce3367890415e7b8c0a90a656e5093233d8579304e781c81b353c1231"
Jul 16 09:17:32.839859 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.839812    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c49aef9ce3367890415e7b8c0a90a656e5093233d8579304e781c81b353c1231"} err="failed to get container status \"c49aef9ce3367890415e7b8c0a90a656e5093233d8579304e781c81b353c1231\": rpc error: code = NotFound desc = could not find container \"c49aef9ce3367890415e7b8c0a90a656e5093233d8579304e781c81b353c1231\": container with ID starting with c49aef9ce3367890415e7b8c0a90a656e5093233d8579304e781c81b353c1231 not found: ID does not exist"
Jul 16 09:17:32.852284 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:32.852234    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gmkrt\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="af998ea8-bb09-4768-9081-5c88fed5bc29" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gmkrt"
Jul 16 09:17:32.852413 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.852222    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg" podStartSLOduration=12.852206989 podStartE2EDuration="12.852206989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:17:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:17:32.85012185 +0000 UTC m=+760.673973422" watchObservedRunningTime="2026-07-16 09:17:32.852206989 +0000 UTC m=+760.676058559"
Jul 16 09:17:32.869882 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.869848    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n4z8f" podStartSLOduration=2.223984524 podStartE2EDuration="23.869836756s" totalImagesPullingTime="21.645852232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:17:32.868934117 +0000 UTC m=+760.692785709" watchObservedRunningTime="2026-07-16 09:17:32.869836756 +0000 UTC m=+760.693688325"
Jul 16 09:17:32.887775 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:32.887732    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9nqwb" podStartSLOduration=12.88772044 podStartE2EDuration="12.88772044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:17:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:17:32.885606758 +0000 UTC m=+760.709458327" watchObservedRunningTime="2026-07-16 09:17:32.88772044 +0000 UTC m=+760.711572008"
Jul 16 09:17:32.887898 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:32.887786    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vrg85\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="f0167266-3ac1-426f-b998-1b1461c5aa0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vrg85"
Jul 16 09:17:34.493808 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:34.493773    2556 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-nxfj5_kuadrant-system_0249c96c-03f5-4ae6-80eb-6431f09d61a7_0(9ae1216027066aeadf494dafffc21d71ed8947787fa9c8ec2dc983c53e223afe): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-nxfj5 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 16 09:17:34.494066 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:34.493832    2556 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-nxfj5_kuadrant-system_0249c96c-03f5-4ae6-80eb-6431f09d61a7_0(9ae1216027066aeadf494dafffc21d71ed8947787fa9c8ec2dc983c53e223afe): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-nxfj5 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:34.842307 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:34.842229    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:34.845455 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:34.845419    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-nxfj5\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="0249c96c-03f5-4ae6-80eb-6431f09d61a7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:34.850661 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:34.850641    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:34.853148 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:34.853124    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-nxfj5\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="0249c96c-03f5-4ae6-80eb-6431f09d61a7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:34.985263 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:34.985237    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0249c96c-03f5-4ae6-80eb-6431f09d61a7-extensions-socket-volume\") pod \"0249c96c-03f5-4ae6-80eb-6431f09d61a7\" (UID: \"0249c96c-03f5-4ae6-80eb-6431f09d61a7\") "
Jul 16 09:17:34.985403 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:34.985274    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zslnk\" (UniqueName: \"kubernetes.io/projected/0249c96c-03f5-4ae6-80eb-6431f09d61a7-kube-api-access-zslnk\") pod \"0249c96c-03f5-4ae6-80eb-6431f09d61a7\" (UID: \"0249c96c-03f5-4ae6-80eb-6431f09d61a7\") "
Jul 16 09:17:34.985522 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:34.985502    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0249c96c-03f5-4ae6-80eb-6431f09d61a7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0249c96c-03f5-4ae6-80eb-6431f09d61a7" (UID: "0249c96c-03f5-4ae6-80eb-6431f09d61a7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:17:34.987399 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:34.987373    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0249c96c-03f5-4ae6-80eb-6431f09d61a7-kube-api-access-zslnk" (OuterVolumeSpecName: "kube-api-access-zslnk") pod "0249c96c-03f5-4ae6-80eb-6431f09d61a7" (UID: "0249c96c-03f5-4ae6-80eb-6431f09d61a7"). InnerVolumeSpecName "kube-api-access-zslnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:17:35.085971 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:35.085944    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0249c96c-03f5-4ae6-80eb-6431f09d61a7-extensions-socket-volume\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:17:35.085971 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:35.085968    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zslnk\" (UniqueName: \"kubernetes.io/projected/0249c96c-03f5-4ae6-80eb-6431f09d61a7-kube-api-access-zslnk\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:17:35.847798 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:35.847768    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:35.850157 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:35.850131    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-nxfj5\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="0249c96c-03f5-4ae6-80eb-6431f09d61a7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:35.855450 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:35.855425    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-nxfj5\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="0249c96c-03f5-4ae6-80eb-6431f09d61a7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxfj5"
Jul 16 09:17:36.718146 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:36.718114    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0249c96c-03f5-4ae6-80eb-6431f09d61a7" path="/var/lib/kubelet/pods/0249c96c-03f5-4ae6-80eb-6431f09d61a7/volumes"
Jul 16 09:17:37.244361 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.244327    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"]
Jul 16 09:17:37.244821 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.244527    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg" podUID="cb6e7c29-2d5e-4804-8374-fc38bf3f94e9" containerName="manager" containerID="cri-o://f2cca8d6093b065c59167b58a893d0139e12c4c26a1a3c810d80fab9183c7817" gracePeriod=10
Jul 16 09:17:37.246378 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.246338    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"
Jul 16 09:17:37.492940 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.492918    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"
Jul 16 09:17:37.588238 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.588163    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"]
Jul 16 09:17:37.588559 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.588544    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb6e7c29-2d5e-4804-8374-fc38bf3f94e9" containerName="manager"
Jul 16 09:17:37.588611 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.588560    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb6e7c29-2d5e-4804-8374-fc38bf3f94e9" containerName="manager"
Jul 16 09:17:37.588647 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.588632    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb6e7c29-2d5e-4804-8374-fc38bf3f94e9" containerName="manager"
Jul 16 09:17:37.591465 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.591444    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"
Jul 16 09:17:37.605486 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.605466    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb6e7c29-2d5e-4804-8374-fc38bf3f94e9-extensions-socket-volume\") pod \"cb6e7c29-2d5e-4804-8374-fc38bf3f94e9\" (UID: \"cb6e7c29-2d5e-4804-8374-fc38bf3f94e9\") "
Jul 16 09:17:37.605574 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.605565    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qww9t\" (UniqueName: \"kubernetes.io/projected/cb6e7c29-2d5e-4804-8374-fc38bf3f94e9-kube-api-access-qww9t\") pod \"cb6e7c29-2d5e-4804-8374-fc38bf3f94e9\" (UID: \"cb6e7c29-2d5e-4804-8374-fc38bf3f94e9\") "
Jul 16 09:17:37.605895 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.605869    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb6e7c29-2d5e-4804-8374-fc38bf3f94e9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cb6e7c29-2d5e-4804-8374-fc38bf3f94e9" (UID: "cb6e7c29-2d5e-4804-8374-fc38bf3f94e9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:17:37.606140 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.606124    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"]
Jul 16 09:17:37.607545 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.607523    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb6e7c29-2d5e-4804-8374-fc38bf3f94e9-kube-api-access-qww9t" (OuterVolumeSpecName: "kube-api-access-qww9t") pod "cb6e7c29-2d5e-4804-8374-fc38bf3f94e9" (UID: "cb6e7c29-2d5e-4804-8374-fc38bf3f94e9"). InnerVolumeSpecName "kube-api-access-qww9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:17:37.706746 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.706719    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/777ca4e6-38bc-4cd8-b69f-531ee9cb15b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wgq8j\" (UID: \"777ca4e6-38bc-4cd8-b69f-531ee9cb15b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"
Jul 16 09:17:37.706873 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.706773    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gpvm\" (UniqueName: \"kubernetes.io/projected/777ca4e6-38bc-4cd8-b69f-531ee9cb15b1-kube-api-access-5gpvm\") pod \"kuadrant-operator-controller-manager-86878c769f-wgq8j\" (UID: \"777ca4e6-38bc-4cd8-b69f-531ee9cb15b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"
Jul 16 09:17:37.706940 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.706886    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qww9t\" (UniqueName: \"kubernetes.io/projected/cb6e7c29-2d5e-4804-8374-fc38bf3f94e9-kube-api-access-qww9t\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:17:37.706940 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.706911    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb6e7c29-2d5e-4804-8374-fc38bf3f94e9-extensions-socket-volume\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:17:37.808131 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.808105    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/777ca4e6-38bc-4cd8-b69f-531ee9cb15b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wgq8j\" (UID: \"777ca4e6-38bc-4cd8-b69f-531ee9cb15b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"
Jul 16 09:17:37.808264 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.808156    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gpvm\" (UniqueName: \"kubernetes.io/projected/777ca4e6-38bc-4cd8-b69f-531ee9cb15b1-kube-api-access-5gpvm\") pod \"kuadrant-operator-controller-manager-86878c769f-wgq8j\" (UID: \"777ca4e6-38bc-4cd8-b69f-531ee9cb15b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"
Jul 16 09:17:37.808548 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.808525    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/777ca4e6-38bc-4cd8-b69f-531ee9cb15b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wgq8j\" (UID: \"777ca4e6-38bc-4cd8-b69f-531ee9cb15b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"
Jul 16 09:17:37.816791 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.816772    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gpvm\" (UniqueName: \"kubernetes.io/projected/777ca4e6-38bc-4cd8-b69f-531ee9cb15b1-kube-api-access-5gpvm\") pod \"kuadrant-operator-controller-manager-86878c769f-wgq8j\" (UID: \"777ca4e6-38bc-4cd8-b69f-531ee9cb15b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"
Jul 16 09:17:37.860211 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.860139    2556 generic.go:356] "Generic (PLEG): container finished" podID="cb6e7c29-2d5e-4804-8374-fc38bf3f94e9" containerID="f2cca8d6093b065c59167b58a893d0139e12c4c26a1a3c810d80fab9183c7817" exitCode=0
Jul 16 09:17:37.860211 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.860183    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"
Jul 16 09:17:37.860390 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.860208    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg" event={"ID":"cb6e7c29-2d5e-4804-8374-fc38bf3f94e9","Type":"ContainerDied","Data":"f2cca8d6093b065c59167b58a893d0139e12c4c26a1a3c810d80fab9183c7817"}
Jul 16 09:17:37.860390 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.860259    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg" event={"ID":"cb6e7c29-2d5e-4804-8374-fc38bf3f94e9","Type":"ContainerDied","Data":"264d0f8b29e0ffab03e53d9803300e8ac52f983492c9c60a3cd12ff17b98b2d1"}
Jul 16 09:17:37.860390 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.860293    2556 scope.go:117] "RemoveContainer" containerID="f2cca8d6093b065c59167b58a893d0139e12c4c26a1a3c810d80fab9183c7817"
Jul 16 09:17:37.871944 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.871925    2556 scope.go:117] "RemoveContainer" containerID="f2cca8d6093b065c59167b58a893d0139e12c4c26a1a3c810d80fab9183c7817"
Jul 16 09:17:37.872188 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:17:37.872172    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2cca8d6093b065c59167b58a893d0139e12c4c26a1a3c810d80fab9183c7817\": container with ID starting with f2cca8d6093b065c59167b58a893d0139e12c4c26a1a3c810d80fab9183c7817 not found: ID does not exist" containerID="f2cca8d6093b065c59167b58a893d0139e12c4c26a1a3c810d80fab9183c7817"
Jul 16 09:17:37.872244 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.872194    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2cca8d6093b065c59167b58a893d0139e12c4c26a1a3c810d80fab9183c7817"} err="failed to get container status \"f2cca8d6093b065c59167b58a893d0139e12c4c26a1a3c810d80fab9183c7817\": rpc error: code = NotFound desc = could not find container \"f2cca8d6093b065c59167b58a893d0139e12c4c26a1a3c810d80fab9183c7817\": container with ID starting with f2cca8d6093b065c59167b58a893d0139e12c4c26a1a3c810d80fab9183c7817 not found: ID does not exist"
Jul 16 09:17:37.885850 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.885825    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"]
Jul 16 09:17:37.893921 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.893900    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xp9sg"]
Jul 16 09:17:37.901249 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:37.901224    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"
Jul 16 09:17:38.040413 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:38.040390    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"]
Jul 16 09:17:38.042610 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:17:38.042583    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777ca4e6_38bc_4cd8_b69f_531ee9cb15b1.slice/crio-fdd74b46a17ad7b59d36c239d4d1b2a21242ea74264283c4476c9d384d2289b3 WatchSource:0}: Error finding container fdd74b46a17ad7b59d36c239d4d1b2a21242ea74264283c4476c9d384d2289b3: Status 404 returned error can't find the container with id fdd74b46a17ad7b59d36c239d4d1b2a21242ea74264283c4476c9d384d2289b3
Jul 16 09:17:38.723981 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:38.723934    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb6e7c29-2d5e-4804-8374-fc38bf3f94e9" path="/var/lib/kubelet/pods/cb6e7c29-2d5e-4804-8374-fc38bf3f94e9/volumes"
Jul 16 09:17:38.868505 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:38.868467    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j" event={"ID":"777ca4e6-38bc-4cd8-b69f-531ee9cb15b1","Type":"ContainerStarted","Data":"bef04dacfd3bfb51d2e1a50f2cec7f4e9b2c3d16e4c638cb530c91df03ccd5b5"}
Jul 16 09:17:38.868681 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:38.868520    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j" event={"ID":"777ca4e6-38bc-4cd8-b69f-531ee9cb15b1","Type":"ContainerStarted","Data":"fdd74b46a17ad7b59d36c239d4d1b2a21242ea74264283c4476c9d384d2289b3"}
Jul 16 09:17:38.868681 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:38.868586    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"
Jul 16 09:17:38.889477 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:38.889436    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j" podStartSLOduration=1.889418268 podStartE2EDuration="1.889418268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:17:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:17:38.887865457 +0000 UTC m=+766.711717047" watchObservedRunningTime="2026-07-16 09:17:38.889418268 +0000 UTC m=+766.713269838"
Jul 16 09:17:40.258274 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:40.258242    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:40.358531 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:40.358494    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:42.843461 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:42.843432    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:42.950418 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:42.950391    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:43.838937 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:43.838907    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9nqwb"
Jul 16 09:17:46.059426 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:46.059384    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:46.201160 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:46.201134    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:47.707866 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:47.707833    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:48.213026 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:48.212996    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:49.469618 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:49.469588    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:49.570381 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:49.570330    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:49.876091 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:49.876006    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"
Jul 16 09:17:54.003370 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:54.003317    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:54.104612 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:54.104575    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:58.062916 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:58.062864    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:17:58.177953 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:17:58.177917    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:06.646551 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:06.646518    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:06.746933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:06.746910    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:06.831730 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:06.831696    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:18:06.867296 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:06.867263    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:18:06.867296 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:06.867303    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:18:06.867515 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:06.867382    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"
Jul 16 09:18:06.869613 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:06.869593    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 09:18:06.948726 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:06.948697    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5-config-file\") pod \"limitador-limitador-54d6d988d5-qsxp7\" (UID: \"1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"
Jul 16 09:18:06.948873 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:06.948729    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6l5z\" (UniqueName: \"kubernetes.io/projected/1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5-kube-api-access-s6l5z\") pod \"limitador-limitador-54d6d988d5-qsxp7\" (UID: \"1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"
Jul 16 09:18:07.050016 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.049983    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6l5z\" (UniqueName: \"kubernetes.io/projected/1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5-kube-api-access-s6l5z\") pod \"limitador-limitador-54d6d988d5-qsxp7\" (UID: \"1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"
Jul 16 09:18:07.050164 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.050073    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5-config-file\") pod \"limitador-limitador-54d6d988d5-qsxp7\" (UID: \"1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"
Jul 16 09:18:07.050644 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.050628    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5-config-file\") pod \"limitador-limitador-54d6d988d5-qsxp7\" (UID: \"1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"
Jul 16 09:18:07.058472 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.058448    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6l5z\" (UniqueName: \"kubernetes.io/projected/1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5-kube-api-access-s6l5z\") pod \"limitador-limitador-54d6d988d5-qsxp7\" (UID: \"1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"
Jul 16 09:18:07.177656 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.177629    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"
Jul 16 09:18:07.295764 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.295735    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-xmtfb"]
Jul 16 09:18:07.300381 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.300361    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xmtfb"
Jul 16 09:18:07.302724 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.302705    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2t9c2\""
Jul 16 09:18:07.309340 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.308914    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xmtfb"]
Jul 16 09:18:07.318682 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.318664    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:18:07.320430 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:18:07.320410    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e3c5bcd_5fc8_4042_a6a6_ac2ac990b1a5.slice/crio-5f3db641d603c9e0381cd3b7da9d6c0e27dafbfd41e7e28be6b4f9a50d039b91 WatchSource:0}: Error finding container 5f3db641d603c9e0381cd3b7da9d6c0e27dafbfd41e7e28be6b4f9a50d039b91: Status 404 returned error can't find the container with id 5f3db641d603c9e0381cd3b7da9d6c0e27dafbfd41e7e28be6b4f9a50d039b91
Jul 16 09:18:07.329599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.329572    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:07.353119 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.353097    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49f8w\" (UniqueName: \"kubernetes.io/projected/e5bc93eb-0675-4e89-8623-9f3d18603813-kube-api-access-49f8w\") pod \"authorino-58cd955675-xmtfb\" (UID: \"e5bc93eb-0675-4e89-8623-9f3d18603813\") " pod="kuadrant-system/authorino-58cd955675-xmtfb"
Jul 16 09:18:07.444649 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.444604    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:07.453842 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.453824    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49f8w\" (UniqueName: \"kubernetes.io/projected/e5bc93eb-0675-4e89-8623-9f3d18603813-kube-api-access-49f8w\") pod \"authorino-58cd955675-xmtfb\" (UID: \"e5bc93eb-0675-4e89-8623-9f3d18603813\") " pod="kuadrant-system/authorino-58cd955675-xmtfb"
Jul 16 09:18:07.462035 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.462007    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49f8w\" (UniqueName: \"kubernetes.io/projected/e5bc93eb-0675-4e89-8623-9f3d18603813-kube-api-access-49f8w\") pod \"authorino-58cd955675-xmtfb\" (UID: \"e5bc93eb-0675-4e89-8623-9f3d18603813\") " pod="kuadrant-system/authorino-58cd955675-xmtfb"
Jul 16 09:18:07.612108 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.612035    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xmtfb"
Jul 16 09:18:07.743867 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:07.743843    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xmtfb"]
Jul 16 09:18:07.745462 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:18:07.745436    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5bc93eb_0675_4e89_8623_9f3d18603813.slice/crio-fbaacfa7de9056ecb3989817f7c0e494631df5d5794749d7e548f576e4f22504 WatchSource:0}: Error finding container fbaacfa7de9056ecb3989817f7c0e494631df5d5794749d7e548f576e4f22504: Status 404 returned error can't find the container with id fbaacfa7de9056ecb3989817f7c0e494631df5d5794749d7e548f576e4f22504
Jul 16 09:18:08.040040 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:08.039994    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qsxp7" event={"ID":"1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5","Type":"ContainerStarted","Data":"5f3db641d603c9e0381cd3b7da9d6c0e27dafbfd41e7e28be6b4f9a50d039b91"}
Jul 16 09:18:08.043460 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:08.043397    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xmtfb" event={"ID":"e5bc93eb-0675-4e89-8623-9f3d18603813","Type":"ContainerStarted","Data":"fbaacfa7de9056ecb3989817f7c0e494631df5d5794749d7e548f576e4f22504"}
Jul 16 09:18:12.071379 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:12.071325    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xmtfb" event={"ID":"e5bc93eb-0675-4e89-8623-9f3d18603813","Type":"ContainerStarted","Data":"ce4cdebaf6a006a0a08fb42a803d81d647addc8dfc713604ccbfd44316cd5700"}
Jul 16 09:18:12.072923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:12.072898    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qsxp7" event={"ID":"1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5","Type":"ContainerStarted","Data":"046ff01240ca79852a88be48048a04e1cc0d264e47de0ce7bd24764b0f7866ca"}
Jul 16 09:18:12.073048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:12.072960    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"
Jul 16 09:18:12.089428 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:12.089381    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-xmtfb" podStartSLOduration=1.12117533 podStartE2EDuration="5.089366831s" totalImagesPullingTime="3.968191501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:18:12.086756956 +0000 UTC m=+799.910608524" watchObservedRunningTime="2026-07-16 09:18:12.089366831 +0000 UTC m=+799.913218391"
Jul 16 09:18:12.104108 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:12.104059    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-qsxp7" podStartSLOduration=1.773070037 podStartE2EDuration="6.104042128s" totalImagesPullingTime="4.330972091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:18:12.103017132 +0000 UTC m=+799.926868724" watchObservedRunningTime="2026-07-16 09:18:12.104042128 +0000 UTC m=+799.927893698"
Jul 16 09:18:12.507656 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:12.507622    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xmtfb"]
Jul 16 09:18:14.083523 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:14.083481    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-xmtfb" podUID="e5bc93eb-0675-4e89-8623-9f3d18603813" containerName="authorino" containerID="cri-o://ce4cdebaf6a006a0a08fb42a803d81d647addc8dfc713604ccbfd44316cd5700" gracePeriod=30
Jul 16 09:18:14.343095 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:14.343040    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xmtfb"
Jul 16 09:18:14.414160 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:14.414134    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49f8w\" (UniqueName: \"kubernetes.io/projected/e5bc93eb-0675-4e89-8623-9f3d18603813-kube-api-access-49f8w\") pod \"e5bc93eb-0675-4e89-8623-9f3d18603813\" (UID: \"e5bc93eb-0675-4e89-8623-9f3d18603813\") "
Jul 16 09:18:14.416071 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:14.416047    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5bc93eb-0675-4e89-8623-9f3d18603813-kube-api-access-49f8w" (OuterVolumeSpecName: "kube-api-access-49f8w") pod "e5bc93eb-0675-4e89-8623-9f3d18603813" (UID: "e5bc93eb-0675-4e89-8623-9f3d18603813"). InnerVolumeSpecName "kube-api-access-49f8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:18:14.514647 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:14.514625    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49f8w\" (UniqueName: \"kubernetes.io/projected/e5bc93eb-0675-4e89-8623-9f3d18603813-kube-api-access-49f8w\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:18:15.095032 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:15.094944    2556 generic.go:356] "Generic (PLEG): container finished" podID="e5bc93eb-0675-4e89-8623-9f3d18603813" containerID="ce4cdebaf6a006a0a08fb42a803d81d647addc8dfc713604ccbfd44316cd5700" exitCode=0
Jul 16 09:18:15.095032 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:15.095006    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xmtfb"
Jul 16 09:18:15.095527 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:15.095025    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xmtfb" event={"ID":"e5bc93eb-0675-4e89-8623-9f3d18603813","Type":"ContainerDied","Data":"ce4cdebaf6a006a0a08fb42a803d81d647addc8dfc713604ccbfd44316cd5700"}
Jul 16 09:18:15.095527 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:15.095064    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xmtfb" event={"ID":"e5bc93eb-0675-4e89-8623-9f3d18603813","Type":"ContainerDied","Data":"fbaacfa7de9056ecb3989817f7c0e494631df5d5794749d7e548f576e4f22504"}
Jul 16 09:18:15.095527 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:15.095080    2556 scope.go:117] "RemoveContainer" containerID="ce4cdebaf6a006a0a08fb42a803d81d647addc8dfc713604ccbfd44316cd5700"
Jul 16 09:18:15.103635 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:15.103617    2556 scope.go:117] "RemoveContainer" containerID="ce4cdebaf6a006a0a08fb42a803d81d647addc8dfc713604ccbfd44316cd5700"
Jul 16 09:18:15.103903 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:18:15.103885    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce4cdebaf6a006a0a08fb42a803d81d647addc8dfc713604ccbfd44316cd5700\": container with ID starting with ce4cdebaf6a006a0a08fb42a803d81d647addc8dfc713604ccbfd44316cd5700 not found: ID does not exist" containerID="ce4cdebaf6a006a0a08fb42a803d81d647addc8dfc713604ccbfd44316cd5700"
Jul 16 09:18:15.103949 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:15.103910    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce4cdebaf6a006a0a08fb42a803d81d647addc8dfc713604ccbfd44316cd5700"} err="failed to get container status \"ce4cdebaf6a006a0a08fb42a803d81d647addc8dfc713604ccbfd44316cd5700\": rpc error: code = NotFound desc = could not find container \"ce4cdebaf6a006a0a08fb42a803d81d647addc8dfc713604ccbfd44316cd5700\": container with ID starting with ce4cdebaf6a006a0a08fb42a803d81d647addc8dfc713604ccbfd44316cd5700 not found: ID does not exist"
Jul 16 09:18:15.110595 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:15.110575    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xmtfb"]
Jul 16 09:18:15.113925 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:15.113905    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-xmtfb"]
Jul 16 09:18:16.718077 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:16.718044    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5bc93eb-0675-4e89-8623-9f3d18603813" path="/var/lib/kubelet/pods/e5bc93eb-0675-4e89-8623-9f3d18603813/volumes"
Jul 16 09:18:23.079316 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:23.079289    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"
Jul 16 09:18:26.947257 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:26.947223    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:27.123478 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:27.118548    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:27.359507 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:27.359429    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:39.834024 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:39.833989    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:40.062389 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:40.062339    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-95hj9"]
Jul 16 09:18:40.062878 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:40.062852    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5bc93eb-0675-4e89-8623-9f3d18603813" containerName="authorino"
Jul 16 09:18:40.062878 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:40.062874    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5bc93eb-0675-4e89-8623-9f3d18603813" containerName="authorino"
Jul 16 09:18:40.063064 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:40.062999    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5bc93eb-0675-4e89-8623-9f3d18603813" containerName="authorino"
Jul 16 09:18:40.065604 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:40.065584    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-95hj9"
Jul 16 09:18:40.068254 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:40.068234    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2t9c2\""
Jul 16 09:18:40.073536 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:40.073513    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-95hj9"]
Jul 16 09:18:40.121543 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:40.121483    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdj7s\" (UniqueName: \"kubernetes.io/projected/dcf0455e-74e1-4ea6-bf80-a01eba7d9d74-kube-api-access-zdj7s\") pod \"authorino-5d4b67c446-95hj9\" (UID: \"dcf0455e-74e1-4ea6-bf80-a01eba7d9d74\") " pod="kuadrant-system/authorino-5d4b67c446-95hj9"
Jul 16 09:18:40.217535 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:40.217503    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:40.221992 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:40.221970    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdj7s\" (UniqueName: \"kubernetes.io/projected/dcf0455e-74e1-4ea6-bf80-a01eba7d9d74-kube-api-access-zdj7s\") pod \"authorino-5d4b67c446-95hj9\" (UID: \"dcf0455e-74e1-4ea6-bf80-a01eba7d9d74\") " pod="kuadrant-system/authorino-5d4b67c446-95hj9"
Jul 16 09:18:40.230523 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:40.230503    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdj7s\" (UniqueName: \"kubernetes.io/projected/dcf0455e-74e1-4ea6-bf80-a01eba7d9d74-kube-api-access-zdj7s\") pod \"authorino-5d4b67c446-95hj9\" (UID: \"dcf0455e-74e1-4ea6-bf80-a01eba7d9d74\") " pod="kuadrant-system/authorino-5d4b67c446-95hj9"
Jul 16 09:18:40.295147 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:40.295115    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-95hj9"]
Jul 16 09:18:40.295416 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:40.295401    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-95hj9"
Jul 16 09:18:40.439011 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:40.438982    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-95hj9"]
Jul 16 09:18:40.441240 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:18:40.441213    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcf0455e_74e1_4ea6_bf80_a01eba7d9d74.slice/crio-df6b28ee57943461a102628aad918624337d11c93eb26047a6fe4bf2a579990b WatchSource:0}: Error finding container df6b28ee57943461a102628aad918624337d11c93eb26047a6fe4bf2a579990b: Status 404 returned error can't find the container with id df6b28ee57943461a102628aad918624337d11c93eb26047a6fe4bf2a579990b
Jul 16 09:18:41.232058 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:41.232024    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-95hj9" event={"ID":"dcf0455e-74e1-4ea6-bf80-a01eba7d9d74","Type":"ContainerStarted","Data":"5f228bcf9a194c5eb75ccb6a54ee82b50761e4df6cb98555b25493abcde187d4"}
Jul 16 09:18:41.232412 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:41.232068    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-95hj9" event={"ID":"dcf0455e-74e1-4ea6-bf80-a01eba7d9d74","Type":"ContainerStarted","Data":"df6b28ee57943461a102628aad918624337d11c93eb26047a6fe4bf2a579990b"}
Jul 16 09:18:41.232412 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:41.232055    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-95hj9" podUID="dcf0455e-74e1-4ea6-bf80-a01eba7d9d74" containerName="authorino" containerID="cri-o://5f228bcf9a194c5eb75ccb6a54ee82b50761e4df6cb98555b25493abcde187d4" gracePeriod=30
Jul 16 09:18:41.247647 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:41.247604    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-95hj9" podStartSLOduration=0.575794902 podStartE2EDuration="1.247590945s" totalImagesPullingTime="671.796043ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:18:41.246042541 +0000 UTC m=+829.069894134" watchObservedRunningTime="2026-07-16 09:18:41.247590945 +0000 UTC m=+829.071442514"
Jul 16 09:18:41.555143 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:41.555117    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-95hj9"
Jul 16 09:18:41.634568 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:41.634490    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdj7s\" (UniqueName: \"kubernetes.io/projected/dcf0455e-74e1-4ea6-bf80-a01eba7d9d74-kube-api-access-zdj7s\") pod \"dcf0455e-74e1-4ea6-bf80-a01eba7d9d74\" (UID: \"dcf0455e-74e1-4ea6-bf80-a01eba7d9d74\") "
Jul 16 09:18:41.637012 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:41.636987    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcf0455e-74e1-4ea6-bf80-a01eba7d9d74-kube-api-access-zdj7s" (OuterVolumeSpecName: "kube-api-access-zdj7s") pod "dcf0455e-74e1-4ea6-bf80-a01eba7d9d74" (UID: "dcf0455e-74e1-4ea6-bf80-a01eba7d9d74"). InnerVolumeSpecName "kube-api-access-zdj7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:18:41.735859 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:41.735822    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdj7s\" (UniqueName: \"kubernetes.io/projected/dcf0455e-74e1-4ea6-bf80-a01eba7d9d74-kube-api-access-zdj7s\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:18:42.238677 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:42.238642    2556 generic.go:356] "Generic (PLEG): container finished" podID="dcf0455e-74e1-4ea6-bf80-a01eba7d9d74" containerID="5f228bcf9a194c5eb75ccb6a54ee82b50761e4df6cb98555b25493abcde187d4" exitCode=2
Jul 16 09:18:42.239178 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:42.238691    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-95hj9"
Jul 16 09:18:42.239178 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:42.238694    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-95hj9" event={"ID":"dcf0455e-74e1-4ea6-bf80-a01eba7d9d74","Type":"ContainerDied","Data":"5f228bcf9a194c5eb75ccb6a54ee82b50761e4df6cb98555b25493abcde187d4"}
Jul 16 09:18:42.239178 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:42.238752    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-95hj9" event={"ID":"dcf0455e-74e1-4ea6-bf80-a01eba7d9d74","Type":"ContainerDied","Data":"df6b28ee57943461a102628aad918624337d11c93eb26047a6fe4bf2a579990b"}
Jul 16 09:18:42.239178 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:42.238777    2556 scope.go:117] "RemoveContainer" containerID="5f228bcf9a194c5eb75ccb6a54ee82b50761e4df6cb98555b25493abcde187d4"
Jul 16 09:18:42.249075 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:42.249061    2556 scope.go:117] "RemoveContainer" containerID="5f228bcf9a194c5eb75ccb6a54ee82b50761e4df6cb98555b25493abcde187d4"
Jul 16 09:18:42.249323 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:18:42.249303    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f228bcf9a194c5eb75ccb6a54ee82b50761e4df6cb98555b25493abcde187d4\": container with ID starting with 5f228bcf9a194c5eb75ccb6a54ee82b50761e4df6cb98555b25493abcde187d4 not found: ID does not exist" containerID="5f228bcf9a194c5eb75ccb6a54ee82b50761e4df6cb98555b25493abcde187d4"
Jul 16 09:18:42.249395 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:42.249332    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f228bcf9a194c5eb75ccb6a54ee82b50761e4df6cb98555b25493abcde187d4"} err="failed to get container status \"5f228bcf9a194c5eb75ccb6a54ee82b50761e4df6cb98555b25493abcde187d4\": rpc error: code = NotFound desc = could not find container \"5f228bcf9a194c5eb75ccb6a54ee82b50761e4df6cb98555b25493abcde187d4\": container with ID starting with 5f228bcf9a194c5eb75ccb6a54ee82b50761e4df6cb98555b25493abcde187d4 not found: ID does not exist"
Jul 16 09:18:42.268307 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:42.268286    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-95hj9"]
Jul 16 09:18:42.276870 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:42.276848    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-95hj9"]
Jul 16 09:18:42.718527 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:42.718498    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcf0455e-74e1-4ea6-bf80-a01eba7d9d74" path="/var/lib/kubelet/pods/dcf0455e-74e1-4ea6-bf80-a01eba7d9d74/volumes"
Jul 16 09:18:46.173049 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:46.173008    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:46.273226 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:46.273195    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:46.364057 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:46.364030    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:46.429417 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:46.429311    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:49.788211 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:49.788179    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:18:49.892830 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:18:49.892799    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:19:21.393724 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:21.393685    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:19:21.498306 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:21.498271    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:19:22.012567 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:22.012541    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:19:22.579362 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:22.579317    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:19:22.680168 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:22.680138    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:19:22.776149 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:22.776123    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:19:22.785821 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:22.785786    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:19:32.814426 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:32.814306    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:19:32.905217 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:32.905190    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:19:43.512932 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:43.512897    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:19:43.983841 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:43.983808    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:19:52.665672 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:52.665643    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:19:52.669424 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:52.669402    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:19:53.180964 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:53.180934    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:19:53.978058 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:19:53.978023    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:20:11.881443 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.881405    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"]
Jul 16 09:20:11.882082 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.881949    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcf0455e-74e1-4ea6-bf80-a01eba7d9d74" containerName="authorino"
Jul 16 09:20:11.882082 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.881968    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcf0455e-74e1-4ea6-bf80-a01eba7d9d74" containerName="authorino"
Jul 16 09:20:11.882210 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.882086    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcf0455e-74e1-4ea6-bf80-a01eba7d9d74" containerName="authorino"
Jul 16 09:20:11.885409 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.885389    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:11.888940 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.888919    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 09:20:11.888940 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.888929    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5qshb\""
Jul 16 09:20:11.889111 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.888941    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 09:20:11.889111 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.888946    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 16 09:20:11.895560 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.895537    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"]
Jul 16 09:20:11.958134 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.958109    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d20d949-9893-4a42-85f7-517502714697-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:11.958285 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.958154    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d20d949-9893-4a42-85f7-517502714697-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:11.958285 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.958210    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d20d949-9893-4a42-85f7-517502714697-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:11.958285 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.958236    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwtwr\" (UniqueName: \"kubernetes.io/projected/7d20d949-9893-4a42-85f7-517502714697-kube-api-access-cwtwr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:11.958285 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.958276    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d20d949-9893-4a42-85f7-517502714697-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:11.958473 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.958304    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d20d949-9893-4a42-85f7-517502714697-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:11.976958 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:11.976932    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:20:12.059144 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.059116    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d20d949-9893-4a42-85f7-517502714697-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:12.059299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.059156    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d20d949-9893-4a42-85f7-517502714697-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:12.059299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.059213    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d20d949-9893-4a42-85f7-517502714697-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:12.059299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.059275    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d20d949-9893-4a42-85f7-517502714697-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:12.059489 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.059312    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwtwr\" (UniqueName: \"kubernetes.io/projected/7d20d949-9893-4a42-85f7-517502714697-kube-api-access-cwtwr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:12.059489 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.059380    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d20d949-9893-4a42-85f7-517502714697-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:12.059600 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.059562    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d20d949-9893-4a42-85f7-517502714697-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:12.059689 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.059666    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d20d949-9893-4a42-85f7-517502714697-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:12.059793 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.059772    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d20d949-9893-4a42-85f7-517502714697-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:12.061559 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.061532    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d20d949-9893-4a42-85f7-517502714697-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:12.061909 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.061892    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d20d949-9893-4a42-85f7-517502714697-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:12.067839 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.067815    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwtwr\" (UniqueName: \"kubernetes.io/projected/7d20d949-9893-4a42-85f7-517502714697-kube-api-access-cwtwr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dc5vz\" (UID: \"7d20d949-9893-4a42-85f7-517502714697\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:12.196585 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.196557    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:12.341639 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.341612    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"]
Jul 16 09:20:12.343400 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:20:12.343370    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d20d949_9893_4a42_85f7_517502714697.slice/crio-8b7919b72c3619e59c1ddca74a5199297b180092a7f317161cff7ec3c5a92738 WatchSource:0}: Error finding container 8b7919b72c3619e59c1ddca74a5199297b180092a7f317161cff7ec3c5a92738: Status 404 returned error can't find the container with id 8b7919b72c3619e59c1ddca74a5199297b180092a7f317161cff7ec3c5a92738
Jul 16 09:20:12.344743 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.344722    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:20:12.725429 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:12.725329    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz" event={"ID":"7d20d949-9893-4a42-85f7-517502714697","Type":"ContainerStarted","Data":"8b7919b72c3619e59c1ddca74a5199297b180092a7f317161cff7ec3c5a92738"}
Jul 16 09:20:13.370702 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:13.370665    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:20:13.733415 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:13.733379    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz" event={"ID":"7d20d949-9893-4a42-85f7-517502714697","Type":"ContainerStarted","Data":"b17c301fc11d779a3ee3c0652b505b30e2ee8f3b8b8f75b5740ce9c33ae736e6"}
Jul 16 09:20:13.752288 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:13.752232    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz" podStartSLOduration=1.592864918 podStartE2EDuration="2.752215943s" totalImagesPullingTime="1.159351025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:20:13.751276404 +0000 UTC m=+921.575127988" watchObservedRunningTime="2026-07-16 09:20:13.752215943 +0000 UTC m=+921.576067551"
Jul 16 09:20:22.196876 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:22.196830    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:22.197260 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:22.196908    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:22.209433 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:22.209414    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:22.791051 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:22.791022    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dc5vz"
Jul 16 09:20:40.484989 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.484959    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"]
Jul 16 09:20:40.488590 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.488572    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.491138 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.491115    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 16 09:20:40.500285 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.500264    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"]
Jul 16 09:20:40.528784 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.528757    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:20:40.573845 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.573821    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71b5d215-27a9-42e8-9ef1-b674c2a83c98-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.573963 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.573856    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71b5d215-27a9-42e8-9ef1-b674c2a83c98-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.573963 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.573949    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71b5d215-27a9-42e8-9ef1-b674c2a83c98-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.574039 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.573994    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71b5d215-27a9-42e8-9ef1-b674c2a83c98-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.574039 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.574013    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71b5d215-27a9-42e8-9ef1-b674c2a83c98-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.574102 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.574070    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njglr\" (UniqueName: \"kubernetes.io/projected/71b5d215-27a9-42e8-9ef1-b674c2a83c98-kube-api-access-njglr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.674664 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.674635    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njglr\" (UniqueName: \"kubernetes.io/projected/71b5d215-27a9-42e8-9ef1-b674c2a83c98-kube-api-access-njglr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.674837 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.674676    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71b5d215-27a9-42e8-9ef1-b674c2a83c98-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.674837 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.674794    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71b5d215-27a9-42e8-9ef1-b674c2a83c98-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.674955 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.674887    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71b5d215-27a9-42e8-9ef1-b674c2a83c98-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.674955 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.674925    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71b5d215-27a9-42e8-9ef1-b674c2a83c98-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.674955 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.674943    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71b5d215-27a9-42e8-9ef1-b674c2a83c98-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.675251 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.675225    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71b5d215-27a9-42e8-9ef1-b674c2a83c98-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.675331 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.675254    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71b5d215-27a9-42e8-9ef1-b674c2a83c98-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.675331 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.675295    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71b5d215-27a9-42e8-9ef1-b674c2a83c98-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.677001 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.676973    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71b5d215-27a9-42e8-9ef1-b674c2a83c98-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.677139 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.677121    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71b5d215-27a9-42e8-9ef1-b674c2a83c98-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.683328 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.683310    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njglr\" (UniqueName: \"kubernetes.io/projected/71b5d215-27a9-42e8-9ef1-b674c2a83c98-kube-api-access-njglr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh\" (UID: \"71b5d215-27a9-42e8-9ef1-b674c2a83c98\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.801248 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.801181    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:40.935148 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:40.935121    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"]
Jul 16 09:20:40.936377 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:20:40.936335    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b5d215_27a9_42e8_9ef1_b674c2a83c98.slice/crio-7d20d7f78a27da7b16e854ca568a7066e7de2f0ddd84b0780c2527dff5e6198a WatchSource:0}: Error finding container 7d20d7f78a27da7b16e854ca568a7066e7de2f0ddd84b0780c2527dff5e6198a: Status 404 returned error can't find the container with id 7d20d7f78a27da7b16e854ca568a7066e7de2f0ddd84b0780c2527dff5e6198a
Jul 16 09:20:41.886416 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:41.886378    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh" event={"ID":"71b5d215-27a9-42e8-9ef1-b674c2a83c98","Type":"ContainerStarted","Data":"da60ed81353d6522ac4027ac49ea98b64c28f08a428632315d6aef36f753010f"}
Jul 16 09:20:41.886805 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:41.886435    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh" event={"ID":"71b5d215-27a9-42e8-9ef1-b674c2a83c98","Type":"ContainerStarted","Data":"7d20d7f78a27da7b16e854ca568a7066e7de2f0ddd84b0780c2527dff5e6198a"}
Jul 16 09:20:41.904758 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:41.904712    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh" podStartSLOduration=1.711164874 podStartE2EDuration="1.904696115s" totalImagesPullingTime="193.531241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:20:41.903079682 +0000 UTC m=+949.726931250" watchObservedRunningTime="2026-07-16 09:20:41.904696115 +0000 UTC m=+949.728547683"
Jul 16 09:20:42.070469 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:42.070438    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:20:45.376427 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.376391    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"]
Jul 16 09:20:45.383093 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.383067    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.385404 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.385382    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 16 09:20:45.389626 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.389608    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"]
Jul 16 09:20:45.414492 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.414462    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:20:45.514917 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.514887    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3056af29-6909-408e-be7d-9e7d28c4db17-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.515041 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.514940    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3056af29-6909-408e-be7d-9e7d28c4db17-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.515041 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.514972    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqpfm\" (UniqueName: \"kubernetes.io/projected/3056af29-6909-408e-be7d-9e7d28c4db17-kube-api-access-kqpfm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.515041 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.515001    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3056af29-6909-408e-be7d-9e7d28c4db17-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.515041 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.515019    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3056af29-6909-408e-be7d-9e7d28c4db17-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.515179 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.515080    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3056af29-6909-408e-be7d-9e7d28c4db17-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.615521 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.615488    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3056af29-6909-408e-be7d-9e7d28c4db17-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.615669 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.615535    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3056af29-6909-408e-be7d-9e7d28c4db17-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.615669 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.615560    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqpfm\" (UniqueName: \"kubernetes.io/projected/3056af29-6909-408e-be7d-9e7d28c4db17-kube-api-access-kqpfm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.615669 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.615603    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3056af29-6909-408e-be7d-9e7d28c4db17-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.615669 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.615631    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3056af29-6909-408e-be7d-9e7d28c4db17-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.615669 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.615667    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3056af29-6909-408e-be7d-9e7d28c4db17-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.615982 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.615956    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3056af29-6909-408e-be7d-9e7d28c4db17-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.616047 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.616015    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3056af29-6909-408e-be7d-9e7d28c4db17-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.616147 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.616129    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3056af29-6909-408e-be7d-9e7d28c4db17-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.618548 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.618522    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3056af29-6909-408e-be7d-9e7d28c4db17-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.618644 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.618578    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3056af29-6909-408e-be7d-9e7d28c4db17-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.624340 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.624315    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqpfm\" (UniqueName: \"kubernetes.io/projected/3056af29-6909-408e-be7d-9e7d28c4db17-kube-api-access-kqpfm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8955q\" (UID: \"3056af29-6909-408e-be7d-9e7d28c4db17\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.696416 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.696378    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:45.830975 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.830938    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"]
Jul 16 09:20:45.832144 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:20:45.832120    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3056af29_6909_408e_be7d_9e7d28c4db17.slice/crio-b590cb4ef50f8128cfaa58a16bcbcaef853e0fa3377401047a6aba1d56310c8d WatchSource:0}: Error finding container b590cb4ef50f8128cfaa58a16bcbcaef853e0fa3377401047a6aba1d56310c8d: Status 404 returned error can't find the container with id b590cb4ef50f8128cfaa58a16bcbcaef853e0fa3377401047a6aba1d56310c8d
Jul 16 09:20:45.907718 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:45.907693    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q" event={"ID":"3056af29-6909-408e-be7d-9e7d28c4db17","Type":"ContainerStarted","Data":"b590cb4ef50f8128cfaa58a16bcbcaef853e0fa3377401047a6aba1d56310c8d"}
Jul 16 09:20:46.914254 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:46.914217    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q" event={"ID":"3056af29-6909-408e-be7d-9e7d28c4db17","Type":"ContainerStarted","Data":"880079b268cd0a203d39b6870c7058f2c01e15d16136f6577a3465ee87ed9c7f"}
Jul 16 09:20:46.933077 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:46.933027    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q" podStartSLOduration=1.719363757 podStartE2EDuration="1.933013308s" totalImagesPullingTime="213.649551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:20:46.930620813 +0000 UTC m=+954.754472383" watchObservedRunningTime="2026-07-16 09:20:46.933013308 +0000 UTC m=+954.756864876"
Jul 16 09:20:47.873876 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:47.873839    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:20:50.802159 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:50.802129    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:50.802618 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:50.802185    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:50.814674 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:50.814648    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:50.948971 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:50.948940    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh"
Jul 16 09:20:55.696512 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:55.696477    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:55.697003 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:55.696537    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:55.708788 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:55.708765    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:20:55.986391 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:20:55.986302    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8955q"
Jul 16 09:21:03.010948 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:21:03.010905    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:21:05.374047 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:21:05.374013    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:21:31.904761 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:21:31.904728    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:16.840786 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:22:16.840697    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:16.939018 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:22:16.938986    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:17.930496 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:22:17.930466    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:18.046144 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:22:18.046112    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:24.986388 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:22:24.986336    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:25.085467 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:22:25.085438    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:32.905082 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:22:32.905048    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:22:39.055446 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:22:39.055404    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:05.284224 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:23:05.284132    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:23:15.175733 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:23:15.175696    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:23:25.373085 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:23:25.373054    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:23:35.378403 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:23:35.378370    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:23:44.170560 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:23:44.170509    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:44.271960 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:23:44.271932    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:46.374440 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:23:46.374404    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:23:47.276465 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:23:47.276430    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:47.378044 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:23:47.378013    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:48.107300 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:23:48.107252    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:23:49.801095 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:23:49.801063    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:13.275801 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:13.275756    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:24:25.473085 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:25.473007    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:24:30.201734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:30.201698    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:30.299877 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:30.299849    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:30.559584 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:30.559506    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:36.246230 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:36.246199    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:36.353114 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:36.353074    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:36.446090 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:36.446057    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:36.588536 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:36.588462    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:42.236550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:42.236521    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:42.644223 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:42.644119    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:52.707705 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:52.707678    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:24:52.713502 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:52.713473    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:24:56.953127 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:56.953095    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:58.393731 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:58.393700    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:24:58.973210 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:24:58.973171    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:25:10.074387 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:25:10.074342    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:25:19.480466 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:25:19.480432    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:25:28.373306 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:25:28.373270    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:25:40.276547 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:25:40.276512    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:25:51.083651 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:25:51.083577    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:25:55.666662 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:25:55.666626    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:25:55.722982 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:25:55.722945    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:26:01.973074 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:26:01.973038    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:26:11.877768 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:26:11.877737    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:26:37.525141 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:26:37.525110    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:26:48.175473 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:26:48.175438    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:27:10.573370 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:27:10.569916    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:27:21.279547 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:27:21.279474    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:27:35.582083 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:27:35.582043    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:27:45.376373 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:27:45.376322    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:27:54.587967 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:27:54.587932    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:28:04.267579 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:04.267545    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:28:13.375919 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:13.375887    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:28:22.282750 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:22.282714    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:28:40.185606 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:40.185567    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"]
Jul 16 09:28:40.186122 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:40.185734    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j" podUID="777ca4e6-38bc-4cd8-b69f-531ee9cb15b1" containerName="manager" containerID="cri-o://bef04dacfd3bfb51d2e1a50f2cec7f4e9b2c3d16e4c638cb530c91df03ccd5b5" gracePeriod=10
Jul 16 09:28:42.541294 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.541269    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"
Jul 16 09:28:42.569329 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.569256    2556 generic.go:356] "Generic (PLEG): container finished" podID="777ca4e6-38bc-4cd8-b69f-531ee9cb15b1" containerID="bef04dacfd3bfb51d2e1a50f2cec7f4e9b2c3d16e4c638cb530c91df03ccd5b5" exitCode=0
Jul 16 09:28:42.569329 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.569288    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"
Jul 16 09:28:42.569329 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.569319    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j" event={"ID":"777ca4e6-38bc-4cd8-b69f-531ee9cb15b1","Type":"ContainerDied","Data":"bef04dacfd3bfb51d2e1a50f2cec7f4e9b2c3d16e4c638cb530c91df03ccd5b5"}
Jul 16 09:28:42.569613 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.569398    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j" event={"ID":"777ca4e6-38bc-4cd8-b69f-531ee9cb15b1","Type":"ContainerDied","Data":"fdd74b46a17ad7b59d36c239d4d1b2a21242ea74264283c4476c9d384d2289b3"}
Jul 16 09:28:42.569613 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.569430    2556 scope.go:117] "RemoveContainer" containerID="bef04dacfd3bfb51d2e1a50f2cec7f4e9b2c3d16e4c638cb530c91df03ccd5b5"
Jul 16 09:28:42.579745 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.579727    2556 scope.go:117] "RemoveContainer" containerID="bef04dacfd3bfb51d2e1a50f2cec7f4e9b2c3d16e4c638cb530c91df03ccd5b5"
Jul 16 09:28:42.580036 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:28:42.580008    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bef04dacfd3bfb51d2e1a50f2cec7f4e9b2c3d16e4c638cb530c91df03ccd5b5\": container with ID starting with bef04dacfd3bfb51d2e1a50f2cec7f4e9b2c3d16e4c638cb530c91df03ccd5b5 not found: ID does not exist" containerID="bef04dacfd3bfb51d2e1a50f2cec7f4e9b2c3d16e4c638cb530c91df03ccd5b5"
Jul 16 09:28:42.580152 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.580041    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bef04dacfd3bfb51d2e1a50f2cec7f4e9b2c3d16e4c638cb530c91df03ccd5b5"} err="failed to get container status \"bef04dacfd3bfb51d2e1a50f2cec7f4e9b2c3d16e4c638cb530c91df03ccd5b5\": rpc error: code = NotFound desc = could not find container \"bef04dacfd3bfb51d2e1a50f2cec7f4e9b2c3d16e4c638cb530c91df03ccd5b5\": container with ID starting with bef04dacfd3bfb51d2e1a50f2cec7f4e9b2c3d16e4c638cb530c91df03ccd5b5 not found: ID does not exist"
Jul 16 09:28:42.676688 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.676663    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gpvm\" (UniqueName: \"kubernetes.io/projected/777ca4e6-38bc-4cd8-b69f-531ee9cb15b1-kube-api-access-5gpvm\") pod \"777ca4e6-38bc-4cd8-b69f-531ee9cb15b1\" (UID: \"777ca4e6-38bc-4cd8-b69f-531ee9cb15b1\") "
Jul 16 09:28:42.676806 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.676753    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/777ca4e6-38bc-4cd8-b69f-531ee9cb15b1-extensions-socket-volume\") pod \"777ca4e6-38bc-4cd8-b69f-531ee9cb15b1\" (UID: \"777ca4e6-38bc-4cd8-b69f-531ee9cb15b1\") "
Jul 16 09:28:42.677129 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.677102    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/777ca4e6-38bc-4cd8-b69f-531ee9cb15b1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "777ca4e6-38bc-4cd8-b69f-531ee9cb15b1" (UID: "777ca4e6-38bc-4cd8-b69f-531ee9cb15b1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:28:42.678547 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.678521    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/777ca4e6-38bc-4cd8-b69f-531ee9cb15b1-kube-api-access-5gpvm" (OuterVolumeSpecName: "kube-api-access-5gpvm") pod "777ca4e6-38bc-4cd8-b69f-531ee9cb15b1" (UID: "777ca4e6-38bc-4cd8-b69f-531ee9cb15b1"). InnerVolumeSpecName "kube-api-access-5gpvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:28:42.777949 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.777912    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/777ca4e6-38bc-4cd8-b69f-531ee9cb15b1-extensions-socket-volume\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:28:42.777949 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.777941    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gpvm\" (UniqueName: \"kubernetes.io/projected/777ca4e6-38bc-4cd8-b69f-531ee9cb15b1-kube-api-access-5gpvm\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:28:42.885885 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.885816    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"]
Jul 16 09:28:42.891551 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:42.891529    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgq8j"]
Jul 16 09:28:44.718742 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:28:44.718706    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="777ca4e6-38bc-4cd8-b69f-531ee9cb15b1" path="/var/lib/kubelet/pods/777ca4e6-38bc-4cd8-b69f-531ee9cb15b1/volumes"
Jul 16 09:29:52.741389 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:29:52.741362    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:29:52.748873 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:29:52.748852    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:30:00.139863 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:00.139826    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736570-4tnh9"]
Jul 16 09:30:00.142211 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:00.140441    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="777ca4e6-38bc-4cd8-b69f-531ee9cb15b1" containerName="manager"
Jul 16 09:30:00.142211 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:00.140459    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="777ca4e6-38bc-4cd8-b69f-531ee9cb15b1" containerName="manager"
Jul 16 09:30:00.142211 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:00.140567    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="777ca4e6-38bc-4cd8-b69f-531ee9cb15b1" containerName="manager"
Jul 16 09:30:00.143511 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:00.143496    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-4tnh9"
Jul 16 09:30:00.145916 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:00.145898    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtlcb\""
Jul 16 09:30:00.153306 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:00.153274    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736570-4tnh9"]
Jul 16 09:30:00.159464 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:00.159440    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-4tnh9"
Jul 16 09:30:00.292337 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:00.292309    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736570-4tnh9"]
Jul 16 09:30:00.293658 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:30:00.293629    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45aff672_4d97_4b76_b0a5_ef968b0e0e51.slice/crio-ab756e0bff3aef6aa3f5e349c84fde6c73191a6a81f21060b761fb9049364867 WatchSource:0}: Error finding container ab756e0bff3aef6aa3f5e349c84fde6c73191a6a81f21060b761fb9049364867: Status 404 returned error can't find the container with id ab756e0bff3aef6aa3f5e349c84fde6c73191a6a81f21060b761fb9049364867
Jul 16 09:30:00.295410 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:00.295395    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:30:00.993493 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:00.993462    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-4tnh9" event={"ID":"45aff672-4d97-4b76-b0a5-ef968b0e0e51","Type":"ContainerStarted","Data":"ab756e0bff3aef6aa3f5e349c84fde6c73191a6a81f21060b761fb9049364867"}
Jul 16 09:30:03.854275 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:03.854244    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:30:04.013293 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:04.013257    2556 generic.go:356] "Generic (PLEG): container finished" podID="45aff672-4d97-4b76-b0a5-ef968b0e0e51" containerID="45f811e1cc88e56874d1a84b2a4f728a82d4227da4f8a4065b46b461da2d2cb4" exitCode=0
Jul 16 09:30:04.013458 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:04.013340    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-4tnh9" event={"ID":"45aff672-4d97-4b76-b0a5-ef968b0e0e51","Type":"ContainerDied","Data":"45f811e1cc88e56874d1a84b2a4f728a82d4227da4f8a4065b46b461da2d2cb4"}
Jul 16 09:30:05.153782 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:05.153756    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-4tnh9"
Jul 16 09:30:06.025572 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:06.025544    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-4tnh9"
Jul 16 09:30:06.025765 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:06.025594    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-4tnh9" event={"ID":"45aff672-4d97-4b76-b0a5-ef968b0e0e51","Type":"ContainerDied","Data":"ab756e0bff3aef6aa3f5e349c84fde6c73191a6a81f21060b761fb9049364867"}
Jul 16 09:30:06.025765 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:06.025645    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab756e0bff3aef6aa3f5e349c84fde6c73191a6a81f21060b761fb9049364867"
Jul 16 09:30:14.446287 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:14.446250    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:30:14.759280 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:14.759192    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:30:15.845549 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:15.845462    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:30:27.069446 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:27.069409    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:30:36.270598 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:36.270567    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:30:53.052104 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:30:53.052073    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:31:03.848708 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:31:03.848673    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:31:15.948230 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:31:15.948195    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:31:23.851102 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:31:23.851067    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:31:24.184602 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:31:24.184572    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:31:35.150446 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:31:35.150406    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:31:48.350856 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:31:48.350778    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:31:56.550843 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:31:56.550805    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:32:16.354676 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:32:16.354643    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:32:25.357006 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:32:25.356969    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:32:34.651929 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:32:34.651895    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:32:45.946735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:32:45.946691    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:33:03.957188 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:33:03.957150    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:33:13.446185 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:33:13.446146    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:33:21.753694 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:33:21.753610    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:33:25.447286 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:33:25.447247    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:33:36.353162 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:33:36.353129    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:33:45.261493 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:33:45.261456    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:33:56.955025 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:33:56.954984    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:34:10.251131 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:34:10.251095    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:34:19.451171 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:34:19.451137    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:34:34.048676 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:34:34.048643    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:34:41.955043 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:34:41.955016    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:34:52.159595 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:34:52.159558    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:34:52.775025 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:34:52.774999    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:34:52.785445 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:34:52.785426    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:35:09.654017 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:09.653985    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:35:21.755752 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:21.755717    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:35:31.371920 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:31.371886    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:35:35.605343 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:35.605306    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:37.366064 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:37.366032    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:41.836433 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:41.836403    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:41.898135 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:41.898111    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:42.073115 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.073087    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:42.174377 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.174326    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:42.270702 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.270674    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:42.379238 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.379206    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"]
Jul 16 09:35:42.379714 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.379695    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45aff672-4d97-4b76-b0a5-ef968b0e0e51" containerName="cleanup"
Jul 16 09:35:42.379714 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.379712    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="45aff672-4d97-4b76-b0a5-ef968b0e0e51" containerName="cleanup"
Jul 16 09:35:42.379901 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.379814    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="45aff672-4d97-4b76-b0a5-ef968b0e0e51" containerName="cleanup"
Jul 16 09:35:42.382988 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.382970    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:42.386760 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.386742    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5cefe74e-serving-cert\""
Jul 16 09:35:42.387655 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.387638    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 09:35:42.387735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.387695    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 09:35:42.387881 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.387870    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vp4zf\""
Jul 16 09:35:42.399543 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.399522    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"]
Jul 16 09:35:42.421706 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.421684    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:42.486659 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.486583    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-maas-api-tls\") pod \"maas-api-e2e-ait-5cefe74e-65b4585449-smb79\" (UID: \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:42.486779 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.486675    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjmwq\" (UniqueName: \"kubernetes.io/projected/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-kube-api-access-hjmwq\") pod \"maas-api-e2e-ait-5cefe74e-65b4585449-smb79\" (UID: \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:42.486779 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.486723    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-openshift-service-ca\") pod \"maas-api-e2e-ait-5cefe74e-65b4585449-smb79\" (UID: \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:42.567586 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.567558    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:42.587551 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.587528    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-maas-api-tls\") pod \"maas-api-e2e-ait-5cefe74e-65b4585449-smb79\" (UID: \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:42.587670 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.587584    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjmwq\" (UniqueName: \"kubernetes.io/projected/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-kube-api-access-hjmwq\") pod \"maas-api-e2e-ait-5cefe74e-65b4585449-smb79\" (UID: \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:42.587670 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.587616    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-openshift-service-ca\") pod \"maas-api-e2e-ait-5cefe74e-65b4585449-smb79\" (UID: \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:42.588300 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.588282    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-openshift-service-ca\") pod \"maas-api-e2e-ait-5cefe74e-65b4585449-smb79\" (UID: \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:42.589895 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.589873    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-maas-api-tls\") pod \"maas-api-e2e-ait-5cefe74e-65b4585449-smb79\" (UID: \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:42.595584 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.595565    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjmwq\" (UniqueName: \"kubernetes.io/projected/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-kube-api-access-hjmwq\") pod \"maas-api-e2e-ait-5cefe74e-65b4585449-smb79\" (UID: \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:42.693432 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.693408    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:42.828729 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.828696    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"]
Jul 16 09:35:42.829849 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:35:42.829822    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb0f0a63_a2aa_4107_91d8_10c0c7552f46.slice/crio-c8debf573367f8f5aae4b7575dd02a6931e6fddc38eb21a888dda9c3d5c0e0c8 WatchSource:0}: Error finding container c8debf573367f8f5aae4b7575dd02a6931e6fddc38eb21a888dda9c3d5c0e0c8: Status 404 returned error can't find the container with id c8debf573367f8f5aae4b7575dd02a6931e6fddc38eb21a888dda9c3d5c0e0c8
Jul 16 09:35:42.831167 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.831148    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:35:42.844522 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.844495    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79" event={"ID":"cb0f0a63-a2aa-4107-91d8-10c0c7552f46","Type":"ContainerStarted","Data":"c8debf573367f8f5aae4b7575dd02a6931e6fddc38eb21a888dda9c3d5c0e0c8"}
Jul 16 09:35:42.902509 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:42.902489    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:43.003229 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:43.003154    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:45.865320 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:45.865281    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79" event={"ID":"cb0f0a63-a2aa-4107-91d8-10c0c7552f46","Type":"ContainerStarted","Data":"b6959200aa8d74c5f8f94a52b8db1488c58d047063045837eb56ff76e16cbcfb"}
Jul 16 09:35:45.865764 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:45.865406    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:45.883698 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:45.883652    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79" podStartSLOduration=1.5538649 podStartE2EDuration="3.883639836s" totalImagesPullingTime="2.329774936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:35:45.881109161 +0000 UTC m=+1853.704960754" watchObservedRunningTime="2026-07-16 09:35:45.883639836 +0000 UTC m=+1853.707491405"
Jul 16 09:35:45.952673 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:45.952625    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:46.144857 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:46.144780    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:35:48.363112 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:48.363079    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:48.526153 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:48.526123    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:50.021363 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:50.021321    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:51.876202 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:51.876174    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:54.181336 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.181296    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"]
Jul 16 09:35:54.181874 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.181531    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79" podUID="cb0f0a63-a2aa-4107-91d8-10c0c7552f46" containerName="maas-api" containerID="cri-o://b6959200aa8d74c5f8f94a52b8db1488c58d047063045837eb56ff76e16cbcfb" gracePeriod=30
Jul 16 09:35:54.199319 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.199295    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:54.355010 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.354977    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:35:54.430387 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.430366    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:54.489502 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.489445    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjmwq\" (UniqueName: \"kubernetes.io/projected/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-kube-api-access-hjmwq\") pod \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\" (UID: \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\") "
Jul 16 09:35:54.489502 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.489476    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-maas-api-tls\") pod \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\" (UID: \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\") "
Jul 16 09:35:54.489502 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.489494    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-openshift-service-ca\") pod \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\" (UID: \"cb0f0a63-a2aa-4107-91d8-10c0c7552f46\") "
Jul 16 09:35:54.489886 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.489862    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cb0f0a63-a2aa-4107-91d8-10c0c7552f46" (UID: "cb0f0a63-a2aa-4107-91d8-10c0c7552f46"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:35:54.491610 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.491586    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cb0f0a63-a2aa-4107-91d8-10c0c7552f46" (UID: "cb0f0a63-a2aa-4107-91d8-10c0c7552f46"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:35:54.491705 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.491650    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-kube-api-access-hjmwq" (OuterVolumeSpecName: "kube-api-access-hjmwq") pod "cb0f0a63-a2aa-4107-91d8-10c0c7552f46" (UID: "cb0f0a63-a2aa-4107-91d8-10c0c7552f46"). InnerVolumeSpecName "kube-api-access-hjmwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:35:54.590507 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.590475    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjmwq\" (UniqueName: \"kubernetes.io/projected/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-kube-api-access-hjmwq\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:35:54.590507 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.590505    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-maas-api-tls\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:35:54.590507 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.590515    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0f0a63-a2aa-4107-91d8-10c0c7552f46-openshift-service-ca\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:35:54.857993 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.857917    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:35:54.914903 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.914870    2556 generic.go:356] "Generic (PLEG): container finished" podID="cb0f0a63-a2aa-4107-91d8-10c0c7552f46" containerID="b6959200aa8d74c5f8f94a52b8db1488c58d047063045837eb56ff76e16cbcfb" exitCode=0
Jul 16 09:35:54.915032 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.914906    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"
Jul 16 09:35:54.915032 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.914950    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79" event={"ID":"cb0f0a63-a2aa-4107-91d8-10c0c7552f46","Type":"ContainerDied","Data":"b6959200aa8d74c5f8f94a52b8db1488c58d047063045837eb56ff76e16cbcfb"}
Jul 16 09:35:54.915032 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.914997    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79" event={"ID":"cb0f0a63-a2aa-4107-91d8-10c0c7552f46","Type":"ContainerDied","Data":"c8debf573367f8f5aae4b7575dd02a6931e6fddc38eb21a888dda9c3d5c0e0c8"}
Jul 16 09:35:54.915032 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.915019    2556 scope.go:117] "RemoveContainer" containerID="b6959200aa8d74c5f8f94a52b8db1488c58d047063045837eb56ff76e16cbcfb"
Jul 16 09:35:54.926088 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.926068    2556 scope.go:117] "RemoveContainer" containerID="b6959200aa8d74c5f8f94a52b8db1488c58d047063045837eb56ff76e16cbcfb"
Jul 16 09:35:54.926405 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:35:54.926383    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6959200aa8d74c5f8f94a52b8db1488c58d047063045837eb56ff76e16cbcfb\": container with ID starting with b6959200aa8d74c5f8f94a52b8db1488c58d047063045837eb56ff76e16cbcfb not found: ID does not exist" containerID="b6959200aa8d74c5f8f94a52b8db1488c58d047063045837eb56ff76e16cbcfb"
Jul 16 09:35:54.926476 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.926419    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6959200aa8d74c5f8f94a52b8db1488c58d047063045837eb56ff76e16cbcfb"} err="failed to get container status \"b6959200aa8d74c5f8f94a52b8db1488c58d047063045837eb56ff76e16cbcfb\": rpc error: code = NotFound desc = could not find container \"b6959200aa8d74c5f8f94a52b8db1488c58d047063045837eb56ff76e16cbcfb\": container with ID starting with b6959200aa8d74c5f8f94a52b8db1488c58d047063045837eb56ff76e16cbcfb not found: ID does not exist"
Jul 16 09:35:54.935807 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.935782    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"]
Jul 16 09:35:54.942431 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:54.942412    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5cefe74e-65b4585449-smb79"]
Jul 16 09:35:56.719166 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:35:56.719130    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb0f0a63-a2aa-4107-91d8-10c0c7552f46" path="/var/lib/kubelet/pods/cb0f0a63-a2aa-4107-91d8-10c0c7552f46/volumes"
Jul 16 09:36:00.085368 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.085311    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:00.186948 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.186916    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:00.363289 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.363199    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:00.460098 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.460070    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:00.558684 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.558656    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:00.624639 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.624564    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:00.788464 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.788425    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:00.856686 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.856655    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"]
Jul 16 09:36:00.857236 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.857221    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb0f0a63-a2aa-4107-91d8-10c0c7552f46" containerName="maas-api"
Jul 16 09:36:00.857286 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.857240    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb0f0a63-a2aa-4107-91d8-10c0c7552f46" containerName="maas-api"
Jul 16 09:36:00.857474 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.857344    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb0f0a63-a2aa-4107-91d8-10c0c7552f46" containerName="maas-api"
Jul 16 09:36:00.860640 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.860621    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:00.863006 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.862989    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 09:36:00.863790 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.863771    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-878a849a-serving-cert\""
Jul 16 09:36:00.863790 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.863783    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vp4zf\""
Jul 16 09:36:00.863918 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.863774    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 09:36:00.869554 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.869532    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"]
Jul 16 09:36:00.887614 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.887556    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:00.940964 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.940938    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bf28445-f2aa-4003-a971-c3446733a621-maas-api-tls\") pod \"maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9\" (UID: \"9bf28445-f2aa-4003-a971-c3446733a621\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:00.941051 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.940990    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtr6m\" (UniqueName: \"kubernetes.io/projected/9bf28445-f2aa-4003-a971-c3446733a621-kube-api-access-mtr6m\") pod \"maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9\" (UID: \"9bf28445-f2aa-4003-a971-c3446733a621\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:00.941093 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:00.941061    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf28445-f2aa-4003-a971-c3446733a621-openshift-service-ca\") pod \"maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9\" (UID: \"9bf28445-f2aa-4003-a971-c3446733a621\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:01.042252 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:01.042229    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf28445-f2aa-4003-a971-c3446733a621-openshift-service-ca\") pod \"maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9\" (UID: \"9bf28445-f2aa-4003-a971-c3446733a621\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:01.042406 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:01.042281    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bf28445-f2aa-4003-a971-c3446733a621-maas-api-tls\") pod \"maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9\" (UID: \"9bf28445-f2aa-4003-a971-c3446733a621\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:01.042406 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:01.042307    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtr6m\" (UniqueName: \"kubernetes.io/projected/9bf28445-f2aa-4003-a971-c3446733a621-kube-api-access-mtr6m\") pod \"maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9\" (UID: \"9bf28445-f2aa-4003-a971-c3446733a621\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:01.042528 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:36:01.042460    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-serving-cert: secret "maas-api-e2e-migrate-878a849a-serving-cert" not found
Jul 16 09:36:01.042584 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:36:01.042531    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bf28445-f2aa-4003-a971-c3446733a621-maas-api-tls podName:9bf28445-f2aa-4003-a971-c3446733a621 nodeName:}" failed. No retries permitted until 2026-07-16 09:36:01.542509198 +0000 UTC m=+1869.366360751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9bf28445-f2aa-4003-a971-c3446733a621-maas-api-tls") pod "maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9" (UID: "9bf28445-f2aa-4003-a971-c3446733a621") : secret "maas-api-e2e-migrate-878a849a-serving-cert" not found
Jul 16 09:36:01.042870 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:01.042851    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf28445-f2aa-4003-a971-c3446733a621-openshift-service-ca\") pod \"maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9\" (UID: \"9bf28445-f2aa-4003-a971-c3446733a621\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:01.050738 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:01.050717    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtr6m\" (UniqueName: \"kubernetes.io/projected/9bf28445-f2aa-4003-a971-c3446733a621-kube-api-access-mtr6m\") pod \"maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9\" (UID: \"9bf28445-f2aa-4003-a971-c3446733a621\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:01.454278 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:01.454245    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:01.546257 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:01.546225    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bf28445-f2aa-4003-a971-c3446733a621-maas-api-tls\") pod \"maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9\" (UID: \"9bf28445-f2aa-4003-a971-c3446733a621\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:01.548611 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:01.548590    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bf28445-f2aa-4003-a971-c3446733a621-maas-api-tls\") pod \"maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9\" (UID: \"9bf28445-f2aa-4003-a971-c3446733a621\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:01.554620 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:01.554597    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:01.654919 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:01.654888    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:01.772881 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:01.772791    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:01.912885 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:01.912808    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"]
Jul 16 09:36:01.916050 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:36:01.916018    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf28445_f2aa_4003_a971_c3446733a621.slice/crio-5d7c215ab239a3fa904cc6b4ec74cfc3a2cbe812d1f0582a14bb02bc273be301 WatchSource:0}: Error finding container 5d7c215ab239a3fa904cc6b4ec74cfc3a2cbe812d1f0582a14bb02bc273be301: Status 404 returned error can't find the container with id 5d7c215ab239a3fa904cc6b4ec74cfc3a2cbe812d1f0582a14bb02bc273be301
Jul 16 09:36:01.957249 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:01.957220    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9" event={"ID":"9bf28445-f2aa-4003-a971-c3446733a621","Type":"ContainerStarted","Data":"5d7c215ab239a3fa904cc6b4ec74cfc3a2cbe812d1f0582a14bb02bc273be301"}
Jul 16 09:36:02.965560 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:02.965531    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9" event={"ID":"9bf28445-f2aa-4003-a971-c3446733a621","Type":"ContainerStarted","Data":"5df5ddc4b6c058108e83aa83f6fb903588b647187fcd0caf6343c2c328756dcf"}
Jul 16 09:36:02.965974 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:02.965659    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:02.986113 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:02.986066    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9" podStartSLOduration=2.570925222 podStartE2EDuration="2.986050932s" totalImagesPullingTime="415.12571ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:36:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:36:02.982696092 +0000 UTC m=+1870.806547660" watchObservedRunningTime="2026-07-16 09:36:02.986050932 +0000 UTC m=+1870.809902501"
Jul 16 09:36:03.965499 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:03.965473    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:04.155376 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:04.155328    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:36:06.427616 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:06.427584    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:06.537317 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:06.537280    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:08.214690 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:08.214652    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:08.976523 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:08.976498    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:11.872091 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:11.872060    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"]
Jul 16 09:36:11.872575 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:11.872259    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9" podUID="9bf28445-f2aa-4003-a971-c3446733a621" containerName="maas-api" containerID="cri-o://5df5ddc4b6c058108e83aa83f6fb903588b647187fcd0caf6343c2c328756dcf" gracePeriod=30
Jul 16 09:36:11.899914 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:11.899892    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:12.024806 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:12.024767    2556 generic.go:356] "Generic (PLEG): container finished" podID="9bf28445-f2aa-4003-a971-c3446733a621" containerID="5df5ddc4b6c058108e83aa83f6fb903588b647187fcd0caf6343c2c328756dcf" exitCode=0
Jul 16 09:36:12.024953 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:12.024820    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9" event={"ID":"9bf28445-f2aa-4003-a971-c3446733a621","Type":"ContainerDied","Data":"5df5ddc4b6c058108e83aa83f6fb903588b647187fcd0caf6343c2c328756dcf"}
Jul 16 09:36:12.129786 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:12.129729    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:12.237972 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:12.237939    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf28445-f2aa-4003-a971-c3446733a621-openshift-service-ca\") pod \"9bf28445-f2aa-4003-a971-c3446733a621\" (UID: \"9bf28445-f2aa-4003-a971-c3446733a621\") "
Jul 16 09:36:12.238197 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:12.238033    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtr6m\" (UniqueName: \"kubernetes.io/projected/9bf28445-f2aa-4003-a971-c3446733a621-kube-api-access-mtr6m\") pod \"9bf28445-f2aa-4003-a971-c3446733a621\" (UID: \"9bf28445-f2aa-4003-a971-c3446733a621\") "
Jul 16 09:36:12.238197 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:12.238079    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bf28445-f2aa-4003-a971-c3446733a621-maas-api-tls\") pod \"9bf28445-f2aa-4003-a971-c3446733a621\" (UID: \"9bf28445-f2aa-4003-a971-c3446733a621\") "
Jul 16 09:36:12.238326 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:12.238301    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bf28445-f2aa-4003-a971-c3446733a621-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9bf28445-f2aa-4003-a971-c3446733a621" (UID: "9bf28445-f2aa-4003-a971-c3446733a621"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:36:12.240142 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:12.240113    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bf28445-f2aa-4003-a971-c3446733a621-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9bf28445-f2aa-4003-a971-c3446733a621" (UID: "9bf28445-f2aa-4003-a971-c3446733a621"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:36:12.240226 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:12.240155    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bf28445-f2aa-4003-a971-c3446733a621-kube-api-access-mtr6m" (OuterVolumeSpecName: "kube-api-access-mtr6m") pod "9bf28445-f2aa-4003-a971-c3446733a621" (UID: "9bf28445-f2aa-4003-a971-c3446733a621"). InnerVolumeSpecName "kube-api-access-mtr6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:36:12.338859 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:12.338831    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtr6m\" (UniqueName: \"kubernetes.io/projected/9bf28445-f2aa-4003-a971-c3446733a621-kube-api-access-mtr6m\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:36:12.338859 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:12.338855    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bf28445-f2aa-4003-a971-c3446733a621-maas-api-tls\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:36:12.339030 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:12.338865    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf28445-f2aa-4003-a971-c3446733a621-openshift-service-ca\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:36:12.569232 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:12.569204    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:13.031919 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:13.031876    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9" event={"ID":"9bf28445-f2aa-4003-a971-c3446733a621","Type":"ContainerDied","Data":"5d7c215ab239a3fa904cc6b4ec74cfc3a2cbe812d1f0582a14bb02bc273be301"}
Jul 16 09:36:13.031919 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:13.031894    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"
Jul 16 09:36:13.032451 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:13.031951    2556 scope.go:117] "RemoveContainer" containerID="5df5ddc4b6c058108e83aa83f6fb903588b647187fcd0caf6343c2c328756dcf"
Jul 16 09:36:13.049833 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:13.049812    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"]
Jul 16 09:36:13.053128 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:13.053106    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-878a849a-7664687c9b-jvmt9"]
Jul 16 09:36:14.157300 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:14.157267    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:36:14.718289 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:14.718254    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bf28445-f2aa-4003-a971-c3446733a621" path="/var/lib/kubelet/pods/9bf28445-f2aa-4003-a971-c3446733a621/volumes"
Jul 16 09:36:18.094159 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.094057    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:18.150899 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.150874    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:18.330327 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.330295    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:18.463683 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.463637    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:18.550101 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.550070    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"]
Jul 16 09:36:18.550696 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.550674    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bf28445-f2aa-4003-a971-c3446733a621" containerName="maas-api"
Jul 16 09:36:18.550696 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.550697    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bf28445-f2aa-4003-a971-c3446733a621" containerName="maas-api"
Jul 16 09:36:18.550892 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.550817    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bf28445-f2aa-4003-a971-c3446733a621" containerName="maas-api"
Jul 16 09:36:18.552239 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.552218    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:18.555863 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.555845    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:18.558667 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.558615    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-e9c2e924-serving-cert\""
Jul 16 09:36:18.558667 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.558628    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 09:36:18.558950 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.558932    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 09:36:18.559609 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.559594    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vp4zf\""
Jul 16 09:36:18.566653 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.566631    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"]
Jul 16 09:36:18.627265 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.627242    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:18.690786 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.690760    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bxpt\" (UniqueName: \"kubernetes.io/projected/4615850f-f846-4164-8eba-b0f01e5e7d1a-kube-api-access-4bxpt\") pod \"maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp\" (UID: \"4615850f-f846-4164-8eba-b0f01e5e7d1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:18.690896 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.690795    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4615850f-f846-4164-8eba-b0f01e5e7d1a-maas-api-tls\") pod \"maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp\" (UID: \"4615850f-f846-4164-8eba-b0f01e5e7d1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:18.690939 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.690891    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4615850f-f846-4164-8eba-b0f01e5e7d1a-openshift-service-ca\") pod \"maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp\" (UID: \"4615850f-f846-4164-8eba-b0f01e5e7d1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:18.792381 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.792299    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4615850f-f846-4164-8eba-b0f01e5e7d1a-openshift-service-ca\") pod \"maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp\" (UID: \"4615850f-f846-4164-8eba-b0f01e5e7d1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:18.792507 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.792387    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bxpt\" (UniqueName: \"kubernetes.io/projected/4615850f-f846-4164-8eba-b0f01e5e7d1a-kube-api-access-4bxpt\") pod \"maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp\" (UID: \"4615850f-f846-4164-8eba-b0f01e5e7d1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:18.792507 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.792412    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4615850f-f846-4164-8eba-b0f01e5e7d1a-maas-api-tls\") pod \"maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp\" (UID: \"4615850f-f846-4164-8eba-b0f01e5e7d1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:18.792970 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.792948    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4615850f-f846-4164-8eba-b0f01e5e7d1a-openshift-service-ca\") pod \"maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp\" (UID: \"4615850f-f846-4164-8eba-b0f01e5e7d1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:18.794732 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.794714    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4615850f-f846-4164-8eba-b0f01e5e7d1a-maas-api-tls\") pod \"maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp\" (UID: \"4615850f-f846-4164-8eba-b0f01e5e7d1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:18.809975 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.809954    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bxpt\" (UniqueName: \"kubernetes.io/projected/4615850f-f846-4164-8eba-b0f01e5e7d1a-kube-api-access-4bxpt\") pod \"maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp\" (UID: \"4615850f-f846-4164-8eba-b0f01e5e7d1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:18.867801 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.867779    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:18.868601 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:18.868576    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:19.008835 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:19.008811    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"]
Jul 16 09:36:19.010159 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:36:19.010133    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4615850f_f846_4164_8eba_b0f01e5e7d1a.slice/crio-8a60b155c30a3ace75feb7417c9175de31ab8c784f38469a0e90388925b2aab0 WatchSource:0}: Error finding container 8a60b155c30a3ace75feb7417c9175de31ab8c784f38469a0e90388925b2aab0: Status 404 returned error can't find the container with id 8a60b155c30a3ace75feb7417c9175de31ab8c784f38469a0e90388925b2aab0
Jul 16 09:36:19.070062 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:19.069977    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp" event={"ID":"4615850f-f846-4164-8eba-b0f01e5e7d1a","Type":"ContainerStarted","Data":"8a60b155c30a3ace75feb7417c9175de31ab8c784f38469a0e90388925b2aab0"}
Jul 16 09:36:19.266154 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:19.266126    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:19.365576 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:19.365476    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:20.077825 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:20.077789    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp" event={"ID":"4615850f-f846-4164-8eba-b0f01e5e7d1a","Type":"ContainerStarted","Data":"14c452c435e18eb98512ad7c0b7ea5795432820265ddbbc7e0ba0e3c2c5ef733"}
Jul 16 09:36:20.077975 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:20.077921    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:20.095837 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:20.095780    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp" podStartSLOduration=1.6595556070000002 podStartE2EDuration="2.095766532s" totalImagesPullingTime="436.210925ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:36:20.093641938 +0000 UTC m=+1887.917493519" watchObservedRunningTime="2026-07-16 09:36:20.095766532 +0000 UTC m=+1887.919618101"
Jul 16 09:36:21.563546 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:21.563506    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:22.848803 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:22.848761    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:36:24.009859 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:24.009827    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:24.101306 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:24.101272    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:25.647166 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:25.647130    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:26.089977 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:26.089949    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:29.634077 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:29.634038    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"]
Jul 16 09:36:29.634582 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:29.634264    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp" podUID="4615850f-f846-4164-8eba-b0f01e5e7d1a" containerName="maas-api" containerID="cri-o://14c452c435e18eb98512ad7c0b7ea5795432820265ddbbc7e0ba0e3c2c5ef733" gracePeriod=30
Jul 16 09:36:29.661189 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:29.661167    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:29.884550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:29.884482    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:29.890188 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:29.890166    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4615850f-f846-4164-8eba-b0f01e5e7d1a-maas-api-tls\") pod \"4615850f-f846-4164-8eba-b0f01e5e7d1a\" (UID: \"4615850f-f846-4164-8eba-b0f01e5e7d1a\") "
Jul 16 09:36:29.890302 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:29.890231    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4615850f-f846-4164-8eba-b0f01e5e7d1a-openshift-service-ca\") pod \"4615850f-f846-4164-8eba-b0f01e5e7d1a\" (UID: \"4615850f-f846-4164-8eba-b0f01e5e7d1a\") "
Jul 16 09:36:29.890302 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:29.890271    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bxpt\" (UniqueName: \"kubernetes.io/projected/4615850f-f846-4164-8eba-b0f01e5e7d1a-kube-api-access-4bxpt\") pod \"4615850f-f846-4164-8eba-b0f01e5e7d1a\" (UID: \"4615850f-f846-4164-8eba-b0f01e5e7d1a\") "
Jul 16 09:36:29.890569 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:29.890547    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4615850f-f846-4164-8eba-b0f01e5e7d1a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4615850f-f846-4164-8eba-b0f01e5e7d1a" (UID: "4615850f-f846-4164-8eba-b0f01e5e7d1a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:36:29.892231 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:29.892215    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4615850f-f846-4164-8eba-b0f01e5e7d1a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4615850f-f846-4164-8eba-b0f01e5e7d1a" (UID: "4615850f-f846-4164-8eba-b0f01e5e7d1a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:36:29.892340 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:29.892326    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4615850f-f846-4164-8eba-b0f01e5e7d1a-kube-api-access-4bxpt" (OuterVolumeSpecName: "kube-api-access-4bxpt") pod "4615850f-f846-4164-8eba-b0f01e5e7d1a" (UID: "4615850f-f846-4164-8eba-b0f01e5e7d1a"). InnerVolumeSpecName "kube-api-access-4bxpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:36:29.991304 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:29.991274    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4615850f-f846-4164-8eba-b0f01e5e7d1a-openshift-service-ca\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:36:29.991304 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:29.991299    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bxpt\" (UniqueName: \"kubernetes.io/projected/4615850f-f846-4164-8eba-b0f01e5e7d1a-kube-api-access-4bxpt\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:36:29.991304 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:29.991310    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4615850f-f846-4164-8eba-b0f01e5e7d1a-maas-api-tls\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:36:30.074499 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.074455    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:30.138151 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.138068    2556 generic.go:356] "Generic (PLEG): container finished" podID="4615850f-f846-4164-8eba-b0f01e5e7d1a" containerID="14c452c435e18eb98512ad7c0b7ea5795432820265ddbbc7e0ba0e3c2c5ef733" exitCode=0
Jul 16 09:36:30.138151 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.138108    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"
Jul 16 09:36:30.138324 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.138159    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp" event={"ID":"4615850f-f846-4164-8eba-b0f01e5e7d1a","Type":"ContainerDied","Data":"14c452c435e18eb98512ad7c0b7ea5795432820265ddbbc7e0ba0e3c2c5ef733"}
Jul 16 09:36:30.138324 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.138209    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp" event={"ID":"4615850f-f846-4164-8eba-b0f01e5e7d1a","Type":"ContainerDied","Data":"8a60b155c30a3ace75feb7417c9175de31ab8c784f38469a0e90388925b2aab0"}
Jul 16 09:36:30.138324 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.138236    2556 scope.go:117] "RemoveContainer" containerID="14c452c435e18eb98512ad7c0b7ea5795432820265ddbbc7e0ba0e3c2c5ef733"
Jul 16 09:36:30.140319 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.140287    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:30.148020 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.148006    2556 scope.go:117] "RemoveContainer" containerID="14c452c435e18eb98512ad7c0b7ea5795432820265ddbbc7e0ba0e3c2c5ef733"
Jul 16 09:36:30.148255 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:36:30.148240    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14c452c435e18eb98512ad7c0b7ea5795432820265ddbbc7e0ba0e3c2c5ef733\": container with ID starting with 14c452c435e18eb98512ad7c0b7ea5795432820265ddbbc7e0ba0e3c2c5ef733 not found: ID does not exist" containerID="14c452c435e18eb98512ad7c0b7ea5795432820265ddbbc7e0ba0e3c2c5ef733"
Jul 16 09:36:30.148295 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.148264    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14c452c435e18eb98512ad7c0b7ea5795432820265ddbbc7e0ba0e3c2c5ef733"} err="failed to get container status \"14c452c435e18eb98512ad7c0b7ea5795432820265ddbbc7e0ba0e3c2c5ef733\": rpc error: code = NotFound desc = could not find container \"14c452c435e18eb98512ad7c0b7ea5795432820265ddbbc7e0ba0e3c2c5ef733\": container with ID starting with 14c452c435e18eb98512ad7c0b7ea5795432820265ddbbc7e0ba0e3c2c5ef733 not found: ID does not exist"
Jul 16 09:36:30.159860 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.159840    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"]
Jul 16 09:36:30.162508 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.162489    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e9c2e924-5d798d9f69-bkkkp"]
Jul 16 09:36:30.567907 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.567865    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:30.656667 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.656632    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:30.718919 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.718884    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4615850f-f846-4164-8eba-b0f01e5e7d1a" path="/var/lib/kubelet/pods/4615850f-f846-4164-8eba-b0f01e5e7d1a/volumes"
Jul 16 09:36:30.725564 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:30.725543    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:32.194453 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:32.194423    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:33.956926 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:33.956891    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:36:38.125234 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:38.125201    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:38.202761 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:38.202731    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:38.282145 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:38.282108    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:38.379051 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:38.378971    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:36:38.824441 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:36:38.824411    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:04.781064 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:04.781016    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:10.652039 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:10.652005    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:10.750953 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:10.750920    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:26.654825 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:26.654790    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:32.704437 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:32.704407    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:32.801676 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:32.801650    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:43.213868 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:43.213820    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:43.994677 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:43.994645    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:49.905414 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:49.905319    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:50.012356 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:50.012325    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:50.105058 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:50.105029    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:50.214304 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:50.214276    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:50.978290 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:50.978256    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:51.078611 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:51.078577    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:51.416409 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:51.416383    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:52.718172 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:52.718147    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:53.157022 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:53.156953    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:37:58.599523 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:58.599460    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:58.747517 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:58.747481    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:37:59.287480 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:37:59.287421    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:02.255754 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:02.255716    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:38:05.212802 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:05.212759    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:05.311889 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:05.311856    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:05.743672 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:05.743635    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:05.844976 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:05.844947    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:06.140380 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:06.140280    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:07.572505 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.572464    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:07.650869 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.650841    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"]
Jul 16 09:38:07.651226 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.651215    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4615850f-f846-4164-8eba-b0f01e5e7d1a" containerName="maas-api"
Jul 16 09:38:07.651279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.651228    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4615850f-f846-4164-8eba-b0f01e5e7d1a" containerName="maas-api"
Jul 16 09:38:07.651332 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.651322    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4615850f-f846-4164-8eba-b0f01e5e7d1a" containerName="maas-api"
Jul 16 09:38:07.654626 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.654608    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:07.662766 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.662742    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-746d752f-serving-cert\""
Jul 16 09:38:07.663428 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.662752    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vp4zf\""
Jul 16 09:38:07.663600 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.662778    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 09:38:07.663965 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.663642    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:07.664301 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.664282    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 09:38:07.667891 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.667868    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"]
Jul 16 09:38:07.750012 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.749989    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:07.784762 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.784726    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42a5401e-066c-4a1f-92ea-5649e5556723-maas-api-tls\") pod \"maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q\" (UID: \"42a5401e-066c-4a1f-92ea-5649e5556723\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:07.784762 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.784770    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a5401e-066c-4a1f-92ea-5649e5556723-openshift-service-ca\") pod \"maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q\" (UID: \"42a5401e-066c-4a1f-92ea-5649e5556723\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:07.784932 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.784804    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfjbt\" (UniqueName: \"kubernetes.io/projected/42a5401e-066c-4a1f-92ea-5649e5556723-kube-api-access-mfjbt\") pod \"maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q\" (UID: \"42a5401e-066c-4a1f-92ea-5649e5556723\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:07.885267 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.885206    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42a5401e-066c-4a1f-92ea-5649e5556723-maas-api-tls\") pod \"maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q\" (UID: \"42a5401e-066c-4a1f-92ea-5649e5556723\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:07.885267 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.885239    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a5401e-066c-4a1f-92ea-5649e5556723-openshift-service-ca\") pod \"maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q\" (UID: \"42a5401e-066c-4a1f-92ea-5649e5556723\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:07.885458 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.885286    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfjbt\" (UniqueName: \"kubernetes.io/projected/42a5401e-066c-4a1f-92ea-5649e5556723-kube-api-access-mfjbt\") pod \"maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q\" (UID: \"42a5401e-066c-4a1f-92ea-5649e5556723\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:07.885458 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:38:07.885388    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-serving-cert: secret "maas-api-e2e-mt-746d752f-serving-cert" not found
Jul 16 09:38:07.885531 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:38:07.885470    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42a5401e-066c-4a1f-92ea-5649e5556723-maas-api-tls podName:42a5401e-066c-4a1f-92ea-5649e5556723 nodeName:}" failed. No retries permitted until 2026-07-16 09:38:08.385450446 +0000 UTC m=+1996.209301998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/42a5401e-066c-4a1f-92ea-5649e5556723-maas-api-tls") pod "maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q" (UID: "42a5401e-066c-4a1f-92ea-5649e5556723") : secret "maas-api-e2e-mt-746d752f-serving-cert" not found
Jul 16 09:38:07.885910 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.885892    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a5401e-066c-4a1f-92ea-5649e5556723-openshift-service-ca\") pod \"maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q\" (UID: \"42a5401e-066c-4a1f-92ea-5649e5556723\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:07.894785 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:07.894765    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfjbt\" (UniqueName: \"kubernetes.io/projected/42a5401e-066c-4a1f-92ea-5649e5556723-kube-api-access-mfjbt\") pod \"maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q\" (UID: \"42a5401e-066c-4a1f-92ea-5649e5556723\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:08.019670 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:08.019646    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:08.345184 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:08.345154    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:08.389629 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:08.389597    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42a5401e-066c-4a1f-92ea-5649e5556723-maas-api-tls\") pod \"maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q\" (UID: \"42a5401e-066c-4a1f-92ea-5649e5556723\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:08.392022 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:08.391998    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42a5401e-066c-4a1f-92ea-5649e5556723-maas-api-tls\") pod \"maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q\" (UID: \"42a5401e-066c-4a1f-92ea-5649e5556723\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:08.446303 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:08.446279    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:08.574315 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:08.574283    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:08.920196 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:08.920171    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"]
Jul 16 09:38:08.922362 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:38:08.922319    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a5401e_066c_4a1f_92ea_5649e5556723.slice/crio-ffa54a735556d5e5ea754759502f7bb27a6a945db4043f362b667d4930189416 WatchSource:0}: Error finding container ffa54a735556d5e5ea754759502f7bb27a6a945db4043f362b667d4930189416: Status 404 returned error can't find the container with id ffa54a735556d5e5ea754759502f7bb27a6a945db4043f362b667d4930189416
Jul 16 09:38:09.698254 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:09.698181    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q" event={"ID":"42a5401e-066c-4a1f-92ea-5649e5556723","Type":"ContainerStarted","Data":"785487b502fd5d2191265122ff93d781b439204aae1af1e42a499c98530fca74"}
Jul 16 09:38:09.698254 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:09.698229    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q" event={"ID":"42a5401e-066c-4a1f-92ea-5649e5556723","Type":"ContainerStarted","Data":"ffa54a735556d5e5ea754759502f7bb27a6a945db4043f362b667d4930189416"}
Jul 16 09:38:09.698656 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:09.698258    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:09.715412 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:09.715344    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q" podStartSLOduration=2.190995983 podStartE2EDuration="2.715329533s" totalImagesPullingTime="524.33355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:38:09.713616887 +0000 UTC m=+1997.537468480" watchObservedRunningTime="2026-07-16 09:38:09.715329533 +0000 UTC m=+1997.539181102"
Jul 16 09:38:11.653434 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:11.653394    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:38:13.089009 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:13.088970    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:13.800528 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:13.800494    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:13.896514 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:13.896484    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:14.212261 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:14.212234    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:15.710319 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:15.710290    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:20.081034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:20.081003    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:20.144902 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:20.144876    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:20.799903 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:20.799868    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:26.320486 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.320454    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"]
Jul 16 09:38:26.320934 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.320712    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q" podUID="42a5401e-066c-4a1f-92ea-5649e5556723" containerName="maas-api" containerID="cri-o://785487b502fd5d2191265122ff93d781b439204aae1af1e42a499c98530fca74" gracePeriod=30
Jul 16 09:38:26.351328 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.351302    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:26.575875 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.575822    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:26.603628 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.603606    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:26.746760 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.746736    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42a5401e-066c-4a1f-92ea-5649e5556723-maas-api-tls\") pod \"42a5401e-066c-4a1f-92ea-5649e5556723\" (UID: \"42a5401e-066c-4a1f-92ea-5649e5556723\") "
Jul 16 09:38:26.746929 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.746794    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a5401e-066c-4a1f-92ea-5649e5556723-openshift-service-ca\") pod \"42a5401e-066c-4a1f-92ea-5649e5556723\" (UID: \"42a5401e-066c-4a1f-92ea-5649e5556723\") "
Jul 16 09:38:26.746929 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.746830    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfjbt\" (UniqueName: \"kubernetes.io/projected/42a5401e-066c-4a1f-92ea-5649e5556723-kube-api-access-mfjbt\") pod \"42a5401e-066c-4a1f-92ea-5649e5556723\" (UID: \"42a5401e-066c-4a1f-92ea-5649e5556723\") "
Jul 16 09:38:26.747185 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.747163    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42a5401e-066c-4a1f-92ea-5649e5556723-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "42a5401e-066c-4a1f-92ea-5649e5556723" (UID: "42a5401e-066c-4a1f-92ea-5649e5556723"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:38:26.748907 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.748880    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42a5401e-066c-4a1f-92ea-5649e5556723-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "42a5401e-066c-4a1f-92ea-5649e5556723" (UID: "42a5401e-066c-4a1f-92ea-5649e5556723"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:38:26.748992 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.748939    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42a5401e-066c-4a1f-92ea-5649e5556723-kube-api-access-mfjbt" (OuterVolumeSpecName: "kube-api-access-mfjbt") pod "42a5401e-066c-4a1f-92ea-5649e5556723" (UID: "42a5401e-066c-4a1f-92ea-5649e5556723"). InnerVolumeSpecName "kube-api-access-mfjbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:38:26.798199 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.798171    2556 generic.go:356] "Generic (PLEG): container finished" podID="42a5401e-066c-4a1f-92ea-5649e5556723" containerID="785487b502fd5d2191265122ff93d781b439204aae1af1e42a499c98530fca74" exitCode=0
Jul 16 09:38:26.798305 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.798217    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"
Jul 16 09:38:26.798305 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.798231    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q" event={"ID":"42a5401e-066c-4a1f-92ea-5649e5556723","Type":"ContainerDied","Data":"785487b502fd5d2191265122ff93d781b439204aae1af1e42a499c98530fca74"}
Jul 16 09:38:26.798305 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.798283    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q" event={"ID":"42a5401e-066c-4a1f-92ea-5649e5556723","Type":"ContainerDied","Data":"ffa54a735556d5e5ea754759502f7bb27a6a945db4043f362b667d4930189416"}
Jul 16 09:38:26.798507 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.798315    2556 scope.go:117] "RemoveContainer" containerID="785487b502fd5d2191265122ff93d781b439204aae1af1e42a499c98530fca74"
Jul 16 09:38:26.807754 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.807737    2556 scope.go:117] "RemoveContainer" containerID="785487b502fd5d2191265122ff93d781b439204aae1af1e42a499c98530fca74"
Jul 16 09:38:26.807992 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:38:26.807972    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"785487b502fd5d2191265122ff93d781b439204aae1af1e42a499c98530fca74\": container with ID starting with 785487b502fd5d2191265122ff93d781b439204aae1af1e42a499c98530fca74 not found: ID does not exist" containerID="785487b502fd5d2191265122ff93d781b439204aae1af1e42a499c98530fca74"
Jul 16 09:38:26.808051 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.807999    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"785487b502fd5d2191265122ff93d781b439204aae1af1e42a499c98530fca74"} err="failed to get container status \"785487b502fd5d2191265122ff93d781b439204aae1af1e42a499c98530fca74\": rpc error: code = NotFound desc = could not find container \"785487b502fd5d2191265122ff93d781b439204aae1af1e42a499c98530fca74\": container with ID starting with 785487b502fd5d2191265122ff93d781b439204aae1af1e42a499c98530fca74 not found: ID does not exist"
Jul 16 09:38:26.820131 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.820107    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"]
Jul 16 09:38:26.825804 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.825784    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-746d752f-856d4b8c57-g4r2q"]
Jul 16 09:38:26.847949 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.847880    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42a5401e-066c-4a1f-92ea-5649e5556723-maas-api-tls\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:38:26.848057 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.847979    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a5401e-066c-4a1f-92ea-5649e5556723-openshift-service-ca\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:38:26.848057 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:26.847992    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfjbt\" (UniqueName: \"kubernetes.io/projected/42a5401e-066c-4a1f-92ea-5649e5556723-kube-api-access-mfjbt\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:38:28.718000 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:28.717968    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42a5401e-066c-4a1f-92ea-5649e5556723" path="/var/lib/kubelet/pods/42a5401e-066c-4a1f-92ea-5649e5556723/volumes"
Jul 16 09:38:29.248378 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:29.248334    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:38:32.277514 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:32.277484    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:32.377191 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:32.377160    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:32.559727 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:32.559657    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:32.767931 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:32.767901    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:32.878646 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:32.878568    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:32.977979 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:32.977944    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:33.143757 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:33.143688    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:38.811297 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:38.811269    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:38.917561 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:38.917526    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:39.012059 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:39.012029    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:39.152272 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:39.152165    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:44.763109 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:44.763074    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:44.828104 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:44.828078    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:48.921865 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:48.921821    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:48.975756 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:48.975721    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:52.319308 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:52.319239    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:52.425453 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:52.425404    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:52.521581 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:52.521545    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:53.218195 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:53.218156    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:53.315755 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:53.315711    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:53.416000 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:53.415972    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:54.721083 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:54.721056    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:38:56.860109 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:38:56.860075    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:39:00.532811 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:00.532771    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:00.596363 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:00.596329    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:01.193461 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:01.193432    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:07.159544 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:07.159511    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:07.225293 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:07.225265    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:07.313181 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:07.313153    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:07.413586 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:07.413556    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:08.948641 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:08.948611    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:39:12.097285 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:12.097215    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:12.196834 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:12.196773    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:17.883009 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:17.882899    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:18.216984 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:18.216951    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:39.197503 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:39.197471    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:45.070929 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:45.070892    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:45.136592 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:45.136552    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:45.415992 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:45.415964    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:45.710637 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:45.710558    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:46.114538 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:46.114455    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:47.648270 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:47.648240    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:47.844633 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:47.844604    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:47.953016 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:47.952977    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"]
Jul 16 09:39:47.953984 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:47.953959    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42a5401e-066c-4a1f-92ea-5649e5556723" containerName="maas-api"
Jul 16 09:39:47.953984 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:47.953986    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="42a5401e-066c-4a1f-92ea-5649e5556723" containerName="maas-api"
Jul 16 09:39:47.954224 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:47.954211    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="42a5401e-066c-4a1f-92ea-5649e5556723" containerName="maas-api"
Jul 16 09:39:47.958323 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:47.958298    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:39:47.961533 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:47.961514    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 09:39:47.961940 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:47.961926    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 09:39:47.962058 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:47.962043    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-58462d-serving-cert\""
Jul 16 09:39:47.962479 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:47.962463    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vp4zf\""
Jul 16 09:39:47.984548 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:47.984524    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"]
Jul 16 09:39:48.010573 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.010552    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:48.093660 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.093635    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj\" (UID: \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:39:48.093762 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.093695    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkh8d\" (UniqueName: \"kubernetes.io/projected/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-kube-api-access-zkh8d\") pod \"maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj\" (UID: \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:39:48.093803 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.093785    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-maas-api-tls\") pod \"maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj\" (UID: \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:39:48.195067 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.195037    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj\" (UID: \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:39:48.195200 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.195112    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkh8d\" (UniqueName: \"kubernetes.io/projected/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-kube-api-access-zkh8d\") pod \"maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj\" (UID: \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:39:48.195263 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.195202    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-maas-api-tls\") pod \"maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj\" (UID: \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:39:48.195680 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.195660    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj\" (UID: \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:39:48.197739 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.197718    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-maas-api-tls\") pod \"maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj\" (UID: \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:39:48.207853 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.207798    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkh8d\" (UniqueName: \"kubernetes.io/projected/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-kube-api-access-zkh8d\") pod \"maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj\" (UID: \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:39:48.230948 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.230924    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:48.269553 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.269531    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:39:48.406524 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.406489    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"]
Jul 16 09:39:48.407752 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:39:48.407727    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e21ff86_c478_4f0f_b594_a64c6c35ad7f.slice/crio-b6117a1c9e92c177a7129fce4078dd71f1d2a23b1de62fec5861ad416d4fb507 WatchSource:0}: Error finding container b6117a1c9e92c177a7129fce4078dd71f1d2a23b1de62fec5861ad416d4fb507: Status 404 returned error can't find the container with id b6117a1c9e92c177a7129fce4078dd71f1d2a23b1de62fec5861ad416d4fb507
Jul 16 09:39:48.642282 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.642187    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:48.744857 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:48.744829    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:49.254108 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:49.254074    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj" event={"ID":"9e21ff86-c478-4f0f-b594-a64c6c35ad7f","Type":"ContainerStarted","Data":"6a189ebd5deef4fb1db6f0c1f30ea77248a2c4106130854b83ebe83fe9936646"}
Jul 16 09:39:49.254289 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:49.254136    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj" event={"ID":"9e21ff86-c478-4f0f-b594-a64c6c35ad7f","Type":"ContainerStarted","Data":"b6117a1c9e92c177a7129fce4078dd71f1d2a23b1de62fec5861ad416d4fb507"}
Jul 16 09:39:49.254289 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:49.254215    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:39:49.272413 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:49.272367    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj" podStartSLOduration=1.856846139 podStartE2EDuration="2.272336222s" totalImagesPullingTime="415.490083ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:39:49.271175292 +0000 UTC m=+2097.095026885" watchObservedRunningTime="2026-07-16 09:39:49.272336222 +0000 UTC m=+2097.096187791"
Jul 16 09:39:52.812698 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:52.812670    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:39:52.822657 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:52.822637    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:39:53.139308 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:53.139214    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:53.464920 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:53.464888    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:53.777111 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:53.777031    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:53.892883 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:53.892853    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:55.265491 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:55.265465    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:39:55.667112 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:55.667070    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:55.809661 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:55.809635    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"]
Jul 16 09:39:55.813407 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:55.813389    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:39:55.816178 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:55.816162    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e84a9d-serving-cert\""
Jul 16 09:39:55.836263 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:55.836234    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"]
Jul 16 09:39:55.852995 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:55.852963    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:55.962655 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:55.962585    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15f1f2d0-d4d7-42b8-b5de-42a46acafade-maas-api-tls\") pod \"maas-api-e2e-inf-b-e84a9d-6454646896-sgznj\" (UID: \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:39:55.962811 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:55.962685    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15f1f2d0-d4d7-42b8-b5de-42a46acafade-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e84a9d-6454646896-sgznj\" (UID: \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:39:55.962811 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:55.962750    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfbpc\" (UniqueName: \"kubernetes.io/projected/15f1f2d0-d4d7-42b8-b5de-42a46acafade-kube-api-access-lfbpc\") pod \"maas-api-e2e-inf-b-e84a9d-6454646896-sgznj\" (UID: \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:39:55.966796 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:55.966777    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:56.063775 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:56.063751    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15f1f2d0-d4d7-42b8-b5de-42a46acafade-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e84a9d-6454646896-sgznj\" (UID: \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:39:56.063879 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:56.063780    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfbpc\" (UniqueName: \"kubernetes.io/projected/15f1f2d0-d4d7-42b8-b5de-42a46acafade-kube-api-access-lfbpc\") pod \"maas-api-e2e-inf-b-e84a9d-6454646896-sgznj\" (UID: \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:39:56.063879 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:56.063813    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15f1f2d0-d4d7-42b8-b5de-42a46acafade-maas-api-tls\") pod \"maas-api-e2e-inf-b-e84a9d-6454646896-sgznj\" (UID: \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:39:56.064463 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:56.064441    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15f1f2d0-d4d7-42b8-b5de-42a46acafade-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e84a9d-6454646896-sgznj\" (UID: \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:39:56.066158 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:56.066136    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15f1f2d0-d4d7-42b8-b5de-42a46acafade-maas-api-tls\") pod \"maas-api-e2e-inf-b-e84a9d-6454646896-sgznj\" (UID: \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:39:56.073325 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:56.073303    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfbpc\" (UniqueName: \"kubernetes.io/projected/15f1f2d0-d4d7-42b8-b5de-42a46acafade-kube-api-access-lfbpc\") pod \"maas-api-e2e-inf-b-e84a9d-6454646896-sgznj\" (UID: \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:39:56.123963 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:56.123941    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:39:56.259083 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:56.259049    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"]
Jul 16 09:39:56.260837 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:39:56.260815    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f1f2d0_d4d7_42b8_b5de_42a46acafade.slice/crio-80495ed9924e35a5cc5df896c5e6caf235c9b8837a77a84d49401e5146753145 WatchSource:0}: Error finding container 80495ed9924e35a5cc5df896c5e6caf235c9b8837a77a84d49401e5146753145: Status 404 returned error can't find the container with id 80495ed9924e35a5cc5df896c5e6caf235c9b8837a77a84d49401e5146753145
Jul 16 09:39:56.292308 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:56.292279    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj" event={"ID":"15f1f2d0-d4d7-42b8-b5de-42a46acafade","Type":"ContainerStarted","Data":"80495ed9924e35a5cc5df896c5e6caf235c9b8837a77a84d49401e5146753145"}
Jul 16 09:39:56.464829 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:56.464799    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:56.564654 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:56.564582    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:39:56.665664 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:56.665638    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:39:57.300013 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:57.299980    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj" event={"ID":"15f1f2d0-d4d7-42b8-b5de-42a46acafade","Type":"ContainerStarted","Data":"f4978d38a81aa3781575b4d1e38f1955983303561a99db22e0ed14f22273302b"}
Jul 16 09:39:57.300415 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:57.300127    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:39:57.320175 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:39:57.320124    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj" podStartSLOduration=2.007110042 podStartE2EDuration="2.320110873s" totalImagesPullingTime="313.000831ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:39:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:39:57.317701363 +0000 UTC m=+2105.141552931" watchObservedRunningTime="2026-07-16 09:39:57.320110873 +0000 UTC m=+2105.143962447"
Jul 16 09:40:01.127144 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:01.127037    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:40:03.311277 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:03.311242    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:40:05.566376 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.566328    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"]
Jul 16 09:40:05.569988 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.569973    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.572941 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.572917    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-58462d\"/\"default-dockercfg-6n89z\""
Jul 16 09:40:05.573067 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.572957    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-58462d\"/\"openshift-service-ca.crt\""
Jul 16 09:40:05.573067 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.572977    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-58462d\"/\"test-model-58462d-kserve-self-signed-certs\""
Jul 16 09:40:05.573067 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.572983    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-58462d\"/\"kube-root-ca.crt\""
Jul 16 09:40:05.579929 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.579908    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"]
Jul 16 09:40:05.639235 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.639203    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpzkb\" (UniqueName: \"kubernetes.io/projected/21bc0f43-5678-4e70-bdd3-890c04a37621-kube-api-access-cpzkb\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.639400 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.639258    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-model-cache\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.639400 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.639311    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-home\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.639400 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.639342    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-dshm\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.639514 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.639408    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-tmp-dir\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.639514 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.639436    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bc0f43-5678-4e70-bdd3-890c04a37621-tls-certs\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.667035 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.666993    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:40:05.739984 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.739943    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpzkb\" (UniqueName: \"kubernetes.io/projected/21bc0f43-5678-4e70-bdd3-890c04a37621-kube-api-access-cpzkb\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.740174 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.740047    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-model-cache\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.740390 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.740343    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-home\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.740523 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.740452    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-dshm\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.740623 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.740602    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-tmp-dir\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.740692 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.740626    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-model-cache\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.740692 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.740679    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-home\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.740803 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.740681    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bc0f43-5678-4e70-bdd3-890c04a37621-tls-certs\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.741000 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.740979    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-tmp-dir\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.742698 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.742677    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-dshm\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.743197 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.743181    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bc0f43-5678-4e70-bdd3-890c04a37621-tls-certs\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.752427 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.752403    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpzkb\" (UniqueName: \"kubernetes.io/projected/21bc0f43-5678-4e70-bdd3-890c04a37621-kube-api-access-cpzkb\") pod \"test-model-58462d-kserve-56885f988c-kngrf\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") " pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:05.880615 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:05.880541    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:06.016538 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:06.016512    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"]
Jul 16 09:40:06.018896 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:40:06.018869    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21bc0f43_5678_4e70_bdd3_890c04a37621.slice/crio-6f451de2e4f146df234427229fd30a98433a3f82003e52661ecee1bd83c77f89 WatchSource:0}: Error finding container 6f451de2e4f146df234427229fd30a98433a3f82003e52661ecee1bd83c77f89: Status 404 returned error can't find the container with id 6f451de2e4f146df234427229fd30a98433a3f82003e52661ecee1bd83c77f89
Jul 16 09:40:06.354555 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:06.354523    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf" event={"ID":"21bc0f43-5678-4e70-bdd3-890c04a37621","Type":"ContainerStarted","Data":"4ed6afa7bef6f723645ac968025a501b18b4e986984f26b8e4aee65062d04a36"}
Jul 16 09:40:06.354727 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:06.354565    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf" event={"ID":"21bc0f43-5678-4e70-bdd3-890c04a37621","Type":"ContainerStarted","Data":"6f451de2e4f146df234427229fd30a98433a3f82003e52661ecee1bd83c77f89"}
Jul 16 09:40:06.371399 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:06.371329    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf" podStartSLOduration=1.3713143620000001 podStartE2EDuration="1.371314362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:40:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:40:06.369107514 +0000 UTC m=+2114.192959107" watchObservedRunningTime="2026-07-16 09:40:06.371314362 +0000 UTC m=+2114.195165931"
Jul 16 09:40:06.950767 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:06.950734    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:40:10.580155 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:10.580120    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:40:10.684578 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:10.684548    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:40:15.880987 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:15.880955    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:15.881382 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:15.881015    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:15.892980 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:15.892961    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:16.430237 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:16.430204    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:40:17.408468 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:17.408428    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:40:17.510241 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:17.510216    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:40:18.549686 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:18.549655    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:40:23.288873 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:23.288840    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:40:30.146660 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:30.146626    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:40:43.657064 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:43.657030    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:40:54.624716 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:54.624642    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"]
Jul 16 09:40:54.645568 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:54.645537    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:40:56.459849 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:40:56.459816    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:01.050034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:01.050003    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:01.556630 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:01.556596    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:41:09.645188 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.645145    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf" podUID="21bc0f43-5678-4e70-bdd3-890c04a37621" containerName="main" containerID="cri-o://4ed6afa7bef6f723645ac968025a501b18b4e986984f26b8e4aee65062d04a36" gracePeriod=45
Jul 16 09:41:09.697184 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:41:09.697157    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21bc0f43_5678_4e70_bdd3_890c04a37621.slice/crio-conmon-4ed6afa7bef6f723645ac968025a501b18b4e986984f26b8e4aee65062d04a36.scope\": RecentStats: unable to find data in memory cache]"
Jul 16 09:41:09.900238 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.900184    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:41:09.977858 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.977831    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-model-cache\") pod \"21bc0f43-5678-4e70-bdd3-890c04a37621\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") "
Jul 16 09:41:09.977993 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.977872    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-tmp-dir\") pod \"21bc0f43-5678-4e70-bdd3-890c04a37621\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") "
Jul 16 09:41:09.977993 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.977909    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-home\") pod \"21bc0f43-5678-4e70-bdd3-890c04a37621\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") "
Jul 16 09:41:09.978117 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.977996    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bc0f43-5678-4e70-bdd3-890c04a37621-tls-certs\") pod \"21bc0f43-5678-4e70-bdd3-890c04a37621\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") "
Jul 16 09:41:09.978117 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.978037    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpzkb\" (UniqueName: \"kubernetes.io/projected/21bc0f43-5678-4e70-bdd3-890c04a37621-kube-api-access-cpzkb\") pod \"21bc0f43-5678-4e70-bdd3-890c04a37621\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") "
Jul 16 09:41:09.978117 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.978059    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-dshm\") pod \"21bc0f43-5678-4e70-bdd3-890c04a37621\" (UID: \"21bc0f43-5678-4e70-bdd3-890c04a37621\") "
Jul 16 09:41:09.978117 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.978105    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-model-cache" (OuterVolumeSpecName: "model-cache") pod "21bc0f43-5678-4e70-bdd3-890c04a37621" (UID: "21bc0f43-5678-4e70-bdd3-890c04a37621"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:41:09.978309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.978233    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "21bc0f43-5678-4e70-bdd3-890c04a37621" (UID: "21bc0f43-5678-4e70-bdd3-890c04a37621"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:41:09.978309 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.978236    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-home" (OuterVolumeSpecName: "home") pod "21bc0f43-5678-4e70-bdd3-890c04a37621" (UID: "21bc0f43-5678-4e70-bdd3-890c04a37621"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:41:09.978436 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.978309    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-model-cache\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:41:09.978436 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.978324    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-tmp-dir\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:41:09.978436 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.978337    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-home\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:41:09.980319 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.980297    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-dshm" (OuterVolumeSpecName: "dshm") pod "21bc0f43-5678-4e70-bdd3-890c04a37621" (UID: "21bc0f43-5678-4e70-bdd3-890c04a37621"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:41:09.980319 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.980307    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21bc0f43-5678-4e70-bdd3-890c04a37621-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "21bc0f43-5678-4e70-bdd3-890c04a37621" (UID: "21bc0f43-5678-4e70-bdd3-890c04a37621"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:41:09.980494 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:09.980372    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21bc0f43-5678-4e70-bdd3-890c04a37621-kube-api-access-cpzkb" (OuterVolumeSpecName: "kube-api-access-cpzkb") pod "21bc0f43-5678-4e70-bdd3-890c04a37621" (UID: "21bc0f43-5678-4e70-bdd3-890c04a37621"). InnerVolumeSpecName "kube-api-access-cpzkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:41:10.078690 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:10.078665    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bc0f43-5678-4e70-bdd3-890c04a37621-tls-certs\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:41:10.078690 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:10.078689    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpzkb\" (UniqueName: \"kubernetes.io/projected/21bc0f43-5678-4e70-bdd3-890c04a37621-kube-api-access-cpzkb\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:41:10.078828 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:10.078699    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bc0f43-5678-4e70-bdd3-890c04a37621-dshm\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:41:10.723095 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:10.723066    2556 generic.go:356] "Generic (PLEG): container finished" podID="21bc0f43-5678-4e70-bdd3-890c04a37621" containerID="4ed6afa7bef6f723645ac968025a501b18b4e986984f26b8e4aee65062d04a36" exitCode=0
Jul 16 09:41:10.723551 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:10.723117    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"
Jul 16 09:41:10.723551 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:10.723158    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf" event={"ID":"21bc0f43-5678-4e70-bdd3-890c04a37621","Type":"ContainerDied","Data":"4ed6afa7bef6f723645ac968025a501b18b4e986984f26b8e4aee65062d04a36"}
Jul 16 09:41:10.723551 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:10.723193    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf" event={"ID":"21bc0f43-5678-4e70-bdd3-890c04a37621","Type":"ContainerDied","Data":"6f451de2e4f146df234427229fd30a98433a3f82003e52661ecee1bd83c77f89"}
Jul 16 09:41:10.723551 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:10.723213    2556 scope.go:117] "RemoveContainer" containerID="4ed6afa7bef6f723645ac968025a501b18b4e986984f26b8e4aee65062d04a36"
Jul 16 09:41:10.732801 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:10.732783    2556 scope.go:117] "RemoveContainer" containerID="4ed6afa7bef6f723645ac968025a501b18b4e986984f26b8e4aee65062d04a36"
Jul 16 09:41:10.733058 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:41:10.733041    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ed6afa7bef6f723645ac968025a501b18b4e986984f26b8e4aee65062d04a36\": container with ID starting with 4ed6afa7bef6f723645ac968025a501b18b4e986984f26b8e4aee65062d04a36 not found: ID does not exist" containerID="4ed6afa7bef6f723645ac968025a501b18b4e986984f26b8e4aee65062d04a36"
Jul 16 09:41:10.733099 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:10.733070    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed6afa7bef6f723645ac968025a501b18b4e986984f26b8e4aee65062d04a36"} err="failed to get container status \"4ed6afa7bef6f723645ac968025a501b18b4e986984f26b8e4aee65062d04a36\": rpc error: code = NotFound desc = could not find container \"4ed6afa7bef6f723645ac968025a501b18b4e986984f26b8e4aee65062d04a36\": container with ID starting with 4ed6afa7bef6f723645ac968025a501b18b4e986984f26b8e4aee65062d04a36 not found: ID does not exist"
Jul 16 09:41:10.741798 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:10.741777    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"]
Jul 16 09:41:10.746491 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:10.746470    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-58462d/test-model-58462d-kserve-56885f988c-kngrf"]
Jul 16 09:41:12.725090 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:12.725054    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21bc0f43-5678-4e70-bdd3-890c04a37621" path="/var/lib/kubelet/pods/21bc0f43-5678-4e70-bdd3-890c04a37621/volumes"
Jul 16 09:41:38.106589 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.106553    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"]
Jul 16 09:41:38.107151 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.106801    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj" podUID="9e21ff86-c478-4f0f-b594-a64c6c35ad7f" containerName="maas-api" containerID="cri-o://6a189ebd5deef4fb1db6f0c1f30ea77248a2c4106130854b83ebe83fe9936646" gracePeriod=30
Jul 16 09:41:38.133917 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.133893    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:38.363217 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.363135    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:38.555250 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.555229    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:41:38.602970 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.602939    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-maas-api-tls\") pod \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\" (UID: \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\") "
Jul 16 09:41:38.603161 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.603014    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-openshift-service-ca\") pod \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\" (UID: \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\") "
Jul 16 09:41:38.603161 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.603112    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkh8d\" (UniqueName: \"kubernetes.io/projected/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-kube-api-access-zkh8d\") pod \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\" (UID: \"9e21ff86-c478-4f0f-b594-a64c6c35ad7f\") "
Jul 16 09:41:38.603388 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.603342    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9e21ff86-c478-4f0f-b594-a64c6c35ad7f" (UID: "9e21ff86-c478-4f0f-b594-a64c6c35ad7f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:41:38.605103 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.605076    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9e21ff86-c478-4f0f-b594-a64c6c35ad7f" (UID: "9e21ff86-c478-4f0f-b594-a64c6c35ad7f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:41:38.605197 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.605128    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-kube-api-access-zkh8d" (OuterVolumeSpecName: "kube-api-access-zkh8d") pod "9e21ff86-c478-4f0f-b594-a64c6c35ad7f" (UID: "9e21ff86-c478-4f0f-b594-a64c6c35ad7f"). InnerVolumeSpecName "kube-api-access-zkh8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:41:38.703771 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.703733    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkh8d\" (UniqueName: \"kubernetes.io/projected/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-kube-api-access-zkh8d\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:41:38.703771 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.703770    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-maas-api-tls\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:41:38.703771 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.703780    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e21ff86-c478-4f0f-b594-a64c6c35ad7f-openshift-service-ca\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:41:38.874403 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.874368    2556 generic.go:356] "Generic (PLEG): container finished" podID="9e21ff86-c478-4f0f-b594-a64c6c35ad7f" containerID="6a189ebd5deef4fb1db6f0c1f30ea77248a2c4106130854b83ebe83fe9936646" exitCode=0
Jul 16 09:41:38.874403 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.874405    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"
Jul 16 09:41:38.874660 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.874445    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj" event={"ID":"9e21ff86-c478-4f0f-b594-a64c6c35ad7f","Type":"ContainerDied","Data":"6a189ebd5deef4fb1db6f0c1f30ea77248a2c4106130854b83ebe83fe9936646"}
Jul 16 09:41:38.874660 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.874509    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj" event={"ID":"9e21ff86-c478-4f0f-b594-a64c6c35ad7f","Type":"ContainerDied","Data":"b6117a1c9e92c177a7129fce4078dd71f1d2a23b1de62fec5861ad416d4fb507"}
Jul 16 09:41:38.874660 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.874542    2556 scope.go:117] "RemoveContainer" containerID="6a189ebd5deef4fb1db6f0c1f30ea77248a2c4106130854b83ebe83fe9936646"
Jul 16 09:41:38.885793 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.885774    2556 scope.go:117] "RemoveContainer" containerID="6a189ebd5deef4fb1db6f0c1f30ea77248a2c4106130854b83ebe83fe9936646"
Jul 16 09:41:38.886153 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:41:38.886131    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a189ebd5deef4fb1db6f0c1f30ea77248a2c4106130854b83ebe83fe9936646\": container with ID starting with 6a189ebd5deef4fb1db6f0c1f30ea77248a2c4106130854b83ebe83fe9936646 not found: ID does not exist" containerID="6a189ebd5deef4fb1db6f0c1f30ea77248a2c4106130854b83ebe83fe9936646"
Jul 16 09:41:38.886203 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.886168    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a189ebd5deef4fb1db6f0c1f30ea77248a2c4106130854b83ebe83fe9936646"} err="failed to get container status \"6a189ebd5deef4fb1db6f0c1f30ea77248a2c4106130854b83ebe83fe9936646\": rpc error: code = NotFound desc = could not find container \"6a189ebd5deef4fb1db6f0c1f30ea77248a2c4106130854b83ebe83fe9936646\": container with ID starting with 6a189ebd5deef4fb1db6f0c1f30ea77248a2c4106130854b83ebe83fe9936646 not found: ID does not exist"
Jul 16 09:41:38.891090 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.891064    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"]
Jul 16 09:41:38.897009 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:38.896989    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-58462d-5847f898cc-mjpzj"]
Jul 16 09:41:40.718535 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:40.718498    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e21ff86-c478-4f0f-b594-a64c6c35ad7f" path="/var/lib/kubelet/pods/9e21ff86-c478-4f0f-b594-a64c6c35ad7f/volumes"
Jul 16 09:41:41.454607 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:41.454570    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:41:44.091863 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:44.091835    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:44.163769 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:44.163739    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:44.387647 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:44.387567    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:44.617838 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:44.617811    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:45.083048 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:45.083015    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:50.773996 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:50.773960    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"]
Jul 16 09:41:50.774423 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:50.774216    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj" podUID="15f1f2d0-d4d7-42b8-b5de-42a46acafade" containerName="maas-api" containerID="cri-o://f4978d38a81aa3781575b4d1e38f1955983303561a99db22e0ed14f22273302b" gracePeriod=30
Jul 16 09:41:50.863173 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:50.863144    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:50.942085 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:50.942049    2556 generic.go:356] "Generic (PLEG): container finished" podID="15f1f2d0-d4d7-42b8-b5de-42a46acafade" containerID="f4978d38a81aa3781575b4d1e38f1955983303561a99db22e0ed14f22273302b" exitCode=0
Jul 16 09:41:50.942242 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:50.942121    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj" event={"ID":"15f1f2d0-d4d7-42b8-b5de-42a46acafade","Type":"ContainerDied","Data":"f4978d38a81aa3781575b4d1e38f1955983303561a99db22e0ed14f22273302b"}
Jul 16 09:41:51.031928 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.031874    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:41:51.103315 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.103292    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15f1f2d0-d4d7-42b8-b5de-42a46acafade-openshift-service-ca\") pod \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\" (UID: \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\") "
Jul 16 09:41:51.103465 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.103379    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15f1f2d0-d4d7-42b8-b5de-42a46acafade-maas-api-tls\") pod \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\" (UID: \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\") "
Jul 16 09:41:51.103465 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.103417    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfbpc\" (UniqueName: \"kubernetes.io/projected/15f1f2d0-d4d7-42b8-b5de-42a46acafade-kube-api-access-lfbpc\") pod \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\" (UID: \"15f1f2d0-d4d7-42b8-b5de-42a46acafade\") "
Jul 16 09:41:51.103608 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.103588    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15f1f2d0-d4d7-42b8-b5de-42a46acafade-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "15f1f2d0-d4d7-42b8-b5de-42a46acafade" (UID: "15f1f2d0-d4d7-42b8-b5de-42a46acafade"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:41:51.105460 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.105437    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15f1f2d0-d4d7-42b8-b5de-42a46acafade-kube-api-access-lfbpc" (OuterVolumeSpecName: "kube-api-access-lfbpc") pod "15f1f2d0-d4d7-42b8-b5de-42a46acafade" (UID: "15f1f2d0-d4d7-42b8-b5de-42a46acafade"). InnerVolumeSpecName "kube-api-access-lfbpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:41:51.105595 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.105575    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15f1f2d0-d4d7-42b8-b5de-42a46acafade-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "15f1f2d0-d4d7-42b8-b5de-42a46acafade" (UID: "15f1f2d0-d4d7-42b8-b5de-42a46acafade"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:41:51.173037 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.173008    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:51.204864 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.204846    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15f1f2d0-d4d7-42b8-b5de-42a46acafade-maas-api-tls\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:41:51.204864 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.204864    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfbpc\" (UniqueName: \"kubernetes.io/projected/15f1f2d0-d4d7-42b8-b5de-42a46acafade-kube-api-access-lfbpc\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:41:51.204989 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.204874    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15f1f2d0-d4d7-42b8-b5de-42a46acafade-openshift-service-ca\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:41:51.956743 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.956715    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"
Jul 16 09:41:51.957196 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.956742    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj" event={"ID":"15f1f2d0-d4d7-42b8-b5de-42a46acafade","Type":"ContainerDied","Data":"80495ed9924e35a5cc5df896c5e6caf235c9b8837a77a84d49401e5146753145"}
Jul 16 09:41:51.957196 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.956825    2556 scope.go:117] "RemoveContainer" containerID="f4978d38a81aa3781575b4d1e38f1955983303561a99db22e0ed14f22273302b"
Jul 16 09:41:51.978092 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.978067    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"]
Jul 16 09:41:51.981797 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:51.981777    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e84a9d-6454646896-sgznj"]
Jul 16 09:41:52.718511 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:52.718482    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15f1f2d0-d4d7-42b8-b5de-42a46acafade" path="/var/lib/kubelet/pods/15f1f2d0-d4d7-42b8-b5de-42a46acafade/volumes"
Jul 16 09:41:55.496638 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:55.496605    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:41:56.960983 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:56.960928    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:57.026192 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:57.026160    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:57.248254 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:57.248178    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:57.481425 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:57.481396    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:57.819878 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:57.819846    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:58.125021 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.124949    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"]
Jul 16 09:41:58.125367 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.125335    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21bc0f43-5678-4e70-bdd3-890c04a37621" containerName="main"
Jul 16 09:41:58.125416 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.125374    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="21bc0f43-5678-4e70-bdd3-890c04a37621" containerName="main"
Jul 16 09:41:58.125416 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.125388    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e21ff86-c478-4f0f-b594-a64c6c35ad7f" containerName="maas-api"
Jul 16 09:41:58.125416 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.125393    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e21ff86-c478-4f0f-b594-a64c6c35ad7f" containerName="maas-api"
Jul 16 09:41:58.125416 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.125400    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15f1f2d0-d4d7-42b8-b5de-42a46acafade" containerName="maas-api"
Jul 16 09:41:58.125416 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.125405    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="15f1f2d0-d4d7-42b8-b5de-42a46acafade" containerName="maas-api"
Jul 16 09:41:58.125571 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.125476    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="15f1f2d0-d4d7-42b8-b5de-42a46acafade" containerName="maas-api"
Jul 16 09:41:58.125571 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.125483    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="21bc0f43-5678-4e70-bdd3-890c04a37621" containerName="main"
Jul 16 09:41:58.125571 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.125490    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e21ff86-c478-4f0f-b594-a64c6c35ad7f" containerName="maas-api"
Jul 16 09:41:58.128564 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.128546    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.130950 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.130930    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 09:41:58.131079 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.131003    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-73e67e-openshift-default-dockercfg-rnwjt\""
Jul 16 09:41:58.141734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.141708    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"]
Jul 16 09:41:58.153105 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.153080    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:58.264773 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.264745    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-workload-certs\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.264889 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.264778    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-token\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.264889 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.264807    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-envoy\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.264889 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.264839    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-workload-socket\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.264889 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.264873    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-data\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.265043 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.264898    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istiod-ca-cert\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.265043 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.264934    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhxzt\" (UniqueName: \"kubernetes.io/projected/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-kube-api-access-jhxzt\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.265043 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.264974    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-podinfo\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.265043 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.264998    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-credential-socket\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.365871 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.365847    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-podinfo\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.365963 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.365878    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-credential-socket\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.365963 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.365930    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-workload-certs\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.365963 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.365946    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-token\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.366117 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.365969    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-envoy\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.366117 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.366068    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-workload-socket\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.366117 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.366104    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-data\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.366250 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.366126    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istiod-ca-cert\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.366250 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.366175    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhxzt\" (UniqueName: \"kubernetes.io/projected/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-kube-api-access-jhxzt\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.366495 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.366472    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-workload-certs\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.366570 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.366501    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-credential-socket\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.366629 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.366607    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-data\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.366679 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.366656    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-workload-socket\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.367061 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.367035    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istiod-ca-cert\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.368378 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.368341    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-envoy\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.368493 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.368474    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-podinfo\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.373856 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.373830    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-token\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.374075 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.374058    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhxzt\" (UniqueName: \"kubernetes.io/projected/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-kube-api-access-jhxzt\") pod \"e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") " pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.439511 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.439491    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:41:58.511236 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.511140    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:58.583856 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.583830    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"]
Jul 16 09:41:58.585500 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:41:58.585473    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd21c81_1f00_4eef_ad6a_dedcbdc81283.slice/crio-05108b9462afb321c70d3031d4d7fb6035ab7fc6af6b4bc427a72eae857bccb9 WatchSource:0}: Error finding container 05108b9462afb321c70d3031d4d7fb6035ab7fc6af6b4bc427a72eae857bccb9: Status 404 returned error can't find the container with id 05108b9462afb321c70d3031d4d7fb6035ab7fc6af6b4bc427a72eae857bccb9
Jul 16 09:41:58.587992 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.587978    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:41:58.995778 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:58.995742    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556" event={"ID":"0dd21c81-1f00-4eef-ad6a-dedcbdc81283","Type":"ContainerStarted","Data":"05108b9462afb321c70d3031d4d7fb6035ab7fc6af6b4bc427a72eae857bccb9"}
Jul 16 09:41:59.103537 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:59.103506    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:41:59.204573 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:41:59.204539    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:01.206137 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:01.206101    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:01.206467 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:01.206169    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:01.206467 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:01.206197    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:02.014081 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:02.014041    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556" event={"ID":"0dd21c81-1f00-4eef-ad6a-dedcbdc81283","Type":"ContainerStarted","Data":"9bad9b96733ba855d0cf9c208a371da00b95c07b92600241bd64ecab3a49735e"}
Jul 16 09:42:02.038372 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:02.038310    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556" podStartSLOduration=1.420557921 podStartE2EDuration="4.038295001s" totalImagesPullingTime="2.61773708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:42:02.035648859 +0000 UTC m=+2229.859500459" watchObservedRunningTime="2026-07-16 09:42:02.038295001 +0000 UTC m=+2229.862146569"
Jul 16 09:42:02.439796 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:02.439763    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:42:02.444544 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:02.444517    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:42:03.007946 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.007918    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:03.020276 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.020253    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:42:03.021330 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.021311    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:42:03.190887 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.190854    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"]
Jul 16 09:42:03.194838 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.194822    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:03.197988 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.197967    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 09:42:03.198885 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.198868    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 09:42:03.199491 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.199474    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vp4zf\""
Jul 16 09:42:03.201079 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.201059    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:03.201872 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.201552    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-73e67e-serving-cert\""
Jul 16 09:42:03.216212 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.216183    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"]
Jul 16 09:42:03.221526 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.221503    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shntc\" (UniqueName: \"kubernetes.io/projected/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-kube-api-access-shntc\") pod \"maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6\" (UID: \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:03.221748 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.221728    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-maas-api-tls\") pod \"maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6\" (UID: \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:03.221865 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.221848    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-openshift-service-ca\") pod \"maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6\" (UID: \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:03.323173 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.323075    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-openshift-service-ca\") pod \"maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6\" (UID: \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:03.323173 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.323156    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shntc\" (UniqueName: \"kubernetes.io/projected/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-kube-api-access-shntc\") pod \"maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6\" (UID: \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:03.323463 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.323211    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-maas-api-tls\") pod \"maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6\" (UID: \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:03.323463 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:42:03.323329    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-serving-cert: secret "maas-api-e2e-api-a-73e67e-serving-cert" not found
Jul 16 09:42:03.323463 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:42:03.323450    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-maas-api-tls podName:d1e59f33-6960-4b77-b6e0-78cc8848e0aa nodeName:}" failed. No retries permitted until 2026-07-16 09:42:03.823427824 +0000 UTC m=+2231.647279373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-maas-api-tls") pod "maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6" (UID: "d1e59f33-6960-4b77-b6e0-78cc8848e0aa") : secret "maas-api-e2e-api-a-73e67e-serving-cert" not found
Jul 16 09:42:03.323726 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.323706    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-openshift-service-ca\") pod \"maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6\" (UID: \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:03.352037 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.352010    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shntc\" (UniqueName: \"kubernetes.io/projected/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-kube-api-access-shntc\") pod \"maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6\" (UID: \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:03.367546 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.367521    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:03.826150 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:03.826109    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-maas-api-tls\") pod \"maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6\" (UID: \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:03.826565 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:42:03.826244    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-serving-cert: secret "maas-api-e2e-api-a-73e67e-serving-cert" not found
Jul 16 09:42:03.826565 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:42:03.826303    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-maas-api-tls podName:d1e59f33-6960-4b77-b6e0-78cc8848e0aa nodeName:}" failed. No retries permitted until 2026-07-16 09:42:04.826286638 +0000 UTC m=+2232.650138193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-maas-api-tls") pod "maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6" (UID: "d1e59f33-6960-4b77-b6e0-78cc8848e0aa") : secret "maas-api-e2e-api-a-73e67e-serving-cert" not found
Jul 16 09:42:04.030615 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:04.030575    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:04.222237 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:04.222210    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:04.836153 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:04.836122    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-maas-api-tls\") pod \"maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6\" (UID: \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:04.838673 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:04.838648    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-maas-api-tls\") pod \"maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6\" (UID: \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:05.005432 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:05.005402    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:05.138548 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:05.138521    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"]
Jul 16 09:42:05.140225 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:42:05.140189    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e59f33_6960_4b77_b6e0_78cc8848e0aa.slice/crio-269016d664606331baac9d430d494018cc2f1d9391fc7172b78eef912bbb8681 WatchSource:0}: Error finding container 269016d664606331baac9d430d494018cc2f1d9391fc7172b78eef912bbb8681: Status 404 returned error can't find the container with id 269016d664606331baac9d430d494018cc2f1d9391fc7172b78eef912bbb8681
Jul 16 09:42:06.038257 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:06.038226    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6" event={"ID":"d1e59f33-6960-4b77-b6e0-78cc8848e0aa","Type":"ContainerStarted","Data":"ba534ab71cd1f4c4f7882b8c8b4822f8da02afc8acb4646a1d96575b49441033"}
Jul 16 09:42:06.038634 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:06.038278    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6" event={"ID":"d1e59f33-6960-4b77-b6e0-78cc8848e0aa","Type":"ContainerStarted","Data":"269016d664606331baac9d430d494018cc2f1d9391fc7172b78eef912bbb8681"}
Jul 16 09:42:06.038634 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:06.038302    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:06.056475 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:06.056432    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6" podStartSLOduration=2.6478691960000003 podStartE2EDuration="3.056417802s" totalImagesPullingTime="408.548606ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:42:06.054446793 +0000 UTC m=+2233.878298411" watchObservedRunningTime="2026-07-16 09:42:06.056417802 +0000 UTC m=+2233.880269370"
Jul 16 09:42:06.853739 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:06.853700    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:42:08.481563 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:08.481531    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:08.939509 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:08.939475    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:09.207871 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.207793    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"]
Jul 16 09:42:09.212323 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.212301    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.215299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.215281    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-d109ac-openshift-default-dockercfg-md9pb\""
Jul 16 09:42:09.247371 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.241120    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"]
Jul 16 09:42:09.247932 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.247902    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:09.271519 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.271486    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e57bc9-d265-4741-87fe-e97e7611299d-istiod-ca-cert\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.271726 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.271542    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-workload-certs\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.271726 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.271611    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-credential-socket\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.271726 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.271640    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-envoy\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.271726 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.271673    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw7wl\" (UniqueName: \"kubernetes.io/projected/e8e57bc9-d265-4741-87fe-e97e7611299d-kube-api-access-fw7wl\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.271905 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.271737    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-workload-socket\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.271905 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.271763    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-podinfo\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.271905 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.271782    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-data\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.271905 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.271833    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-token\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.373020 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.372981    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-workload-socket\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.373020 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.373020    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-podinfo\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.373251 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.373045    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-data\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.373251 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.373086    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-token\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.373251 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.373145    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e57bc9-d265-4741-87fe-e97e7611299d-istiod-ca-cert\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.373251 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.373197    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-workload-certs\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.373251 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.373244    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-credential-socket\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.373546 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.373273    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-envoy\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.373546 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.373307    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw7wl\" (UniqueName: \"kubernetes.io/projected/e8e57bc9-d265-4741-87fe-e97e7611299d-kube-api-access-fw7wl\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.373546 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.373498    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-workload-socket\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.373692 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.373550    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-workload-certs\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.373692 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.373571    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-data\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.373801 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.373782    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-credential-socket\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.374032 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.374014    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e57bc9-d265-4741-87fe-e97e7611299d-istiod-ca-cert\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.375987 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.375961    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-podinfo\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.376106 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.376002    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-envoy\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.385894 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.385872    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw7wl\" (UniqueName: \"kubernetes.io/projected/e8e57bc9-d265-4741-87fe-e97e7611299d-kube-api-access-fw7wl\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.386135 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.386116    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-token\") pod \"e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") " pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.415016 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.414995    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:09.541665 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.541556    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:09.712981 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.712957    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"]
Jul 16 09:42:09.714445 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:42:09.714418    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e57bc9_d265_4741_87fe_e97e7611299d.slice/crio-097677744f5bdc15accc6851dfc758f5aa3fcdf59f83f4568cdfdf3a2ee8077f WatchSource:0}: Error finding container 097677744f5bdc15accc6851dfc758f5aa3fcdf59f83f4568cdfdf3a2ee8077f: Status 404 returned error can't find the container with id 097677744f5bdc15accc6851dfc758f5aa3fcdf59f83f4568cdfdf3a2ee8077f
Jul 16 09:42:09.737286 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.736467    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:09.737286 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.736558    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:09.737286 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:09.736599    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:10.064100 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:10.064047    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl" event={"ID":"e8e57bc9-d265-4741-87fe-e97e7611299d","Type":"ContainerStarted","Data":"03b56adb024cc34de99db8fe9d3658b521fe209e21aac3b11100e807d952c515"}
Jul 16 09:42:10.064290 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:10.064115    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl" event={"ID":"e8e57bc9-d265-4741-87fe-e97e7611299d","Type":"ContainerStarted","Data":"097677744f5bdc15accc6851dfc758f5aa3fcdf59f83f4568cdfdf3a2ee8077f"}
Jul 16 09:42:10.084202 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:10.084127    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl" podStartSLOduration=1.0841071740000001 podStartE2EDuration="1.084107174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:42:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:42:10.082437543 +0000 UTC m=+2237.906289112" watchObservedRunningTime="2026-07-16 09:42:10.084107174 +0000 UTC m=+2237.907958745"
Jul 16 09:42:10.542271 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:10.542237    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:10.547422 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:10.547398    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:10.962753 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:10.962717    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:11.050892 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:11.050855    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:11.070423 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:11.070394    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:11.071714 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:11.071693    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:11.142147 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:11.142089    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:11.410817 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:11.410724    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:11.723197 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:11.723173    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:11.826494 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:11.826469    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:12.050876 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:12.050812    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:15.096230 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:15.096199    2556 generic.go:356] "Generic (PLEG): container finished" podID="0dd21c81-1f00-4eef-ad6a-dedcbdc81283" containerID="9bad9b96733ba855d0cf9c208a371da00b95c07b92600241bd64ecab3a49735e" exitCode=0
Jul 16 09:42:15.096644 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:15.096247    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556" event={"ID":"0dd21c81-1f00-4eef-ad6a-dedcbdc81283","Type":"ContainerDied","Data":"9bad9b96733ba855d0cf9c208a371da00b95c07b92600241bd64ecab3a49735e"}
Jul 16 09:42:15.096688 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:15.096644    2556 scope.go:117] "RemoveContainer" containerID="9bad9b96733ba855d0cf9c208a371da00b95c07b92600241bd64ecab3a49735e"
Jul 16 09:42:15.097633 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:15.097603    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:15.097721 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:15.097668    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:15.097721 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:15.097701    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:16.103645 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:16.103611    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556" event={"ID":"0dd21c81-1f00-4eef-ad6a-dedcbdc81283","Type":"ContainerStarted","Data":"70f14f2c66650d5f340a7a0690eb24174a2090a58cdba749878832ed8da693ec"}
Jul 16 09:42:16.440438 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:16.440398    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:42:16.441778 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:16.441750    2556 patch_prober.go:28] interesting pod/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 16 09:42:16.441916 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:16.441808    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556" podUID="0dd21c81-1f00-4eef-ad6a-dedcbdc81283" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 16 09:42:16.459944 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:16.459919    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:17.440087 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:17.440046    2556 patch_prober.go:28] interesting pod/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 16 09:42:17.440596 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:17.440119    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556" podUID="0dd21c81-1f00-4eef-ad6a-dedcbdc81283" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 16 09:42:18.021150 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:18.021107    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:42:18.440649 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:18.440614    2556 patch_prober.go:28] interesting pod/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 16 09:42:18.441024 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:18.440673    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556" podUID="0dd21c81-1f00-4eef-ad6a-dedcbdc81283" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 16 09:42:19.440829 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:19.440792    2556 patch_prober.go:28] interesting pod/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 16 09:42:19.441222 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:19.440845    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556" podUID="0dd21c81-1f00-4eef-ad6a-dedcbdc81283" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 16 09:42:20.257093 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:20.257060    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:42:20.443505 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:20.443476    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:42:20.444490 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:20.444468    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:42:24.776677 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:24.776643    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:24.872931 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:24.872905    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:24.974090 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:24.974062    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:27.112487 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:27.112452    2556 patch_prober.go:28] interesting pod/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 09:42:27.112869 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:27.112505    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl" podUID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 09:42:29.183711 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:29.183678    2556 generic.go:356] "Generic (PLEG): container finished" podID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerID="03b56adb024cc34de99db8fe9d3658b521fe209e21aac3b11100e807d952c515" exitCode=0
Jul 16 09:42:29.184149 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:29.183753    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl" event={"ID":"e8e57bc9-d265-4741-87fe-e97e7611299d","Type":"ContainerDied","Data":"03b56adb024cc34de99db8fe9d3658b521fe209e21aac3b11100e807d952c515"}
Jul 16 09:42:29.184149 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:29.184114    2556 scope.go:117] "RemoveContainer" containerID="03b56adb024cc34de99db8fe9d3658b521fe209e21aac3b11100e807d952c515"
Jul 16 09:42:29.185056 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:29.185031    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:29.185124 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:29.185110    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:29.185161 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:29.185147    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:30.196810 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.196778    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl" event={"ID":"e8e57bc9-d265-4741-87fe-e97e7611299d","Type":"ContainerStarted","Data":"510322ea429ed8e4fb78b473ec376fcb7c5ac63c24527302746569071eb4125d"}
Jul 16 09:42:30.303492 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.303460    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"]
Jul 16 09:42:30.303723 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.303675    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6" podUID="d1e59f33-6960-4b77-b6e0-78cc8848e0aa" containerName="maas-api" containerID="cri-o://ba534ab71cd1f4c4f7882b8c8b4822f8da02afc8acb4646a1d96575b49441033" gracePeriod=30
Jul 16 09:42:30.333619 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.331961    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:30.547373 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.545402    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:30.547373 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.545534    2556 patch_prober.go:28] interesting pod/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 16 09:42:30.547373 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.545580    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl" podUID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 16 09:42:30.603034 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.603012    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:30.699826 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.699798    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-openshift-service-ca\") pod \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\" (UID: \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\") "
Jul 16 09:42:30.699985 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.699852    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shntc\" (UniqueName: \"kubernetes.io/projected/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-kube-api-access-shntc\") pod \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\" (UID: \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\") "
Jul 16 09:42:30.699985 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.699908    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-maas-api-tls\") pod \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\" (UID: \"d1e59f33-6960-4b77-b6e0-78cc8848e0aa\") "
Jul 16 09:42:30.700142 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.700116    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d1e59f33-6960-4b77-b6e0-78cc8848e0aa" (UID: "d1e59f33-6960-4b77-b6e0-78cc8848e0aa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:42:30.701985 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.701954    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d1e59f33-6960-4b77-b6e0-78cc8848e0aa" (UID: "d1e59f33-6960-4b77-b6e0-78cc8848e0aa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:42:30.702093 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.702026    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-kube-api-access-shntc" (OuterVolumeSpecName: "kube-api-access-shntc") pod "d1e59f33-6960-4b77-b6e0-78cc8848e0aa" (UID: "d1e59f33-6960-4b77-b6e0-78cc8848e0aa"). InnerVolumeSpecName "kube-api-access-shntc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:42:30.740850 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.740818    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:30.800932 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.800913    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-openshift-service-ca\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:30.800932 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.800933    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shntc\" (UniqueName: \"kubernetes.io/projected/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-kube-api-access-shntc\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:30.801077 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:30.800944    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1e59f33-6960-4b77-b6e0-78cc8848e0aa-maas-api-tls\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:31.203868 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:31.203837    2556 generic.go:356] "Generic (PLEG): container finished" podID="d1e59f33-6960-4b77-b6e0-78cc8848e0aa" containerID="ba534ab71cd1f4c4f7882b8c8b4822f8da02afc8acb4646a1d96575b49441033" exitCode=0
Jul 16 09:42:31.204334 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:31.203889    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"
Jul 16 09:42:31.204334 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:31.203920    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6" event={"ID":"d1e59f33-6960-4b77-b6e0-78cc8848e0aa","Type":"ContainerDied","Data":"ba534ab71cd1f4c4f7882b8c8b4822f8da02afc8acb4646a1d96575b49441033"}
Jul 16 09:42:31.204334 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:31.203975    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6" event={"ID":"d1e59f33-6960-4b77-b6e0-78cc8848e0aa","Type":"ContainerDied","Data":"269016d664606331baac9d430d494018cc2f1d9391fc7172b78eef912bbb8681"}
Jul 16 09:42:31.204334 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:31.203996    2556 scope.go:117] "RemoveContainer" containerID="ba534ab71cd1f4c4f7882b8c8b4822f8da02afc8acb4646a1d96575b49441033"
Jul 16 09:42:31.213569 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:31.213552    2556 scope.go:117] "RemoveContainer" containerID="ba534ab71cd1f4c4f7882b8c8b4822f8da02afc8acb4646a1d96575b49441033"
Jul 16 09:42:31.213823 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:42:31.213804    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba534ab71cd1f4c4f7882b8c8b4822f8da02afc8acb4646a1d96575b49441033\": container with ID starting with ba534ab71cd1f4c4f7882b8c8b4822f8da02afc8acb4646a1d96575b49441033 not found: ID does not exist" containerID="ba534ab71cd1f4c4f7882b8c8b4822f8da02afc8acb4646a1d96575b49441033"
Jul 16 09:42:31.213892 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:31.213831    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba534ab71cd1f4c4f7882b8c8b4822f8da02afc8acb4646a1d96575b49441033"} err="failed to get container status \"ba534ab71cd1f4c4f7882b8c8b4822f8da02afc8acb4646a1d96575b49441033\": rpc error: code = NotFound desc = could not find container \"ba534ab71cd1f4c4f7882b8c8b4822f8da02afc8acb4646a1d96575b49441033\": container with ID starting with ba534ab71cd1f4c4f7882b8c8b4822f8da02afc8acb4646a1d96575b49441033 not found: ID does not exist"
Jul 16 09:42:31.226855 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:31.226825    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"]
Jul 16 09:42:31.236788 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:31.236755    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-73e67e-7c8b84b976-dmjq6"]
Jul 16 09:42:31.542387 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:31.542280    2556 patch_prober.go:28] interesting pod/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 16 09:42:31.542532 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:31.542380    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl" podUID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 16 09:42:32.519314 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:32.519230    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:32.542881 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:32.542844    2556 patch_prober.go:28] interesting pod/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 16 09:42:32.543042 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:32.542917    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl" podUID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 16 09:42:32.620116 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:32.620073    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:32.743374 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:32.742679    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1e59f33-6960-4b77-b6e0-78cc8848e0aa" path="/var/lib/kubelet/pods/d1e59f33-6960-4b77-b6e0-78cc8848e0aa/volumes"
Jul 16 09:42:33.542335 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:33.542295    2556 patch_prober.go:28] interesting pod/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 16 09:42:33.542780 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:33.542382    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl" podUID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 16 09:42:34.545421 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:34.545391    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:34.545913 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:34.545897    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:34.546429 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:34.546410    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:35.556423 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:35.556389    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:42:36.340004 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:36.339971    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:36.439512 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:36.439483    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:36.593072 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:36.592994    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"]
Jul 16 09:42:36.593461 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:36.593237    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556" podUID="0dd21c81-1f00-4eef-ad6a-dedcbdc81283" containerName="istio-proxy" containerID="cri-o://70f14f2c66650d5f340a7a0690eb24174a2090a58cdba749878832ed8da693ec" gracePeriod=30
Jul 16 09:42:36.616634 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:36.616604    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:36.865225 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:36.865143    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:37.316758 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:37.316723    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:41.846206 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.846184    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:42:41.910935 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.910870    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-workload-socket\") pod \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") "
Jul 16 09:42:41.910935 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.910903    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-token\") pod \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") "
Jul 16 09:42:41.910935 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.910919    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-credential-socket\") pod \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") "
Jul 16 09:42:41.911244 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.910951    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istiod-ca-cert\") pod \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") "
Jul 16 09:42:41.911244 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.910981    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-workload-certs\") pod \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") "
Jul 16 09:42:41.911244 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.911017    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhxzt\" (UniqueName: \"kubernetes.io/projected/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-kube-api-access-jhxzt\") pod \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") "
Jul 16 09:42:41.911244 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.911064    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-podinfo\") pod \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") "
Jul 16 09:42:41.911244 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.911095    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-envoy\") pod \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") "
Jul 16 09:42:41.911244 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.911117    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-data\") pod \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\" (UID: \"0dd21c81-1f00-4eef-ad6a-dedcbdc81283\") "
Jul 16 09:42:41.911244 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.911137    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0dd21c81-1f00-4eef-ad6a-dedcbdc81283" (UID: "0dd21c81-1f00-4eef-ad6a-dedcbdc81283"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:41.911632 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.911232    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0dd21c81-1f00-4eef-ad6a-dedcbdc81283" (UID: "0dd21c81-1f00-4eef-ad6a-dedcbdc81283"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:41.911632 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.911313    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0dd21c81-1f00-4eef-ad6a-dedcbdc81283" (UID: "0dd21c81-1f00-4eef-ad6a-dedcbdc81283"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:41.911632 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.911441    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0dd21c81-1f00-4eef-ad6a-dedcbdc81283" (UID: "0dd21c81-1f00-4eef-ad6a-dedcbdc81283"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:42:41.911632 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.911623    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-workload-socket\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:41.911778 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.911645    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-credential-socket\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:41.911778 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.911659    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istiod-ca-cert\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:41.911778 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.911672    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-workload-certs\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:41.912137 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.912113    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-data" (OuterVolumeSpecName: "istio-data") pod "0dd21c81-1f00-4eef-ad6a-dedcbdc81283" (UID: "0dd21c81-1f00-4eef-ad6a-dedcbdc81283"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:41.913166 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.913144    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0dd21c81-1f00-4eef-ad6a-dedcbdc81283" (UID: "0dd21c81-1f00-4eef-ad6a-dedcbdc81283"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 09:42:41.913272 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.913253    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0dd21c81-1f00-4eef-ad6a-dedcbdc81283" (UID: "0dd21c81-1f00-4eef-ad6a-dedcbdc81283"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:41.913603 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.913582    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-token" (OuterVolumeSpecName: "istio-token") pod "0dd21c81-1f00-4eef-ad6a-dedcbdc81283" (UID: "0dd21c81-1f00-4eef-ad6a-dedcbdc81283"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:42:41.913688 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:41.913616    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-kube-api-access-jhxzt" (OuterVolumeSpecName: "kube-api-access-jhxzt") pod "0dd21c81-1f00-4eef-ad6a-dedcbdc81283" (UID: "0dd21c81-1f00-4eef-ad6a-dedcbdc81283"). InnerVolumeSpecName "kube-api-access-jhxzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:42:42.012927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.012899    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-token\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:42.012927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.012921    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhxzt\" (UniqueName: \"kubernetes.io/projected/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-kube-api-access-jhxzt\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:42.012927 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.012931    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-podinfo\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:42.013124 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.012939    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-envoy\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:42.013124 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.012947    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dd21c81-1f00-4eef-ad6a-dedcbdc81283-istio-data\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:42.275435 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.275397    2556 generic.go:356] "Generic (PLEG): container finished" podID="0dd21c81-1f00-4eef-ad6a-dedcbdc81283" containerID="70f14f2c66650d5f340a7a0690eb24174a2090a58cdba749878832ed8da693ec" exitCode=0
Jul 16 09:42:42.275616 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.275449    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"
Jul 16 09:42:42.275616 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.275478    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556" event={"ID":"0dd21c81-1f00-4eef-ad6a-dedcbdc81283","Type":"ContainerDied","Data":"70f14f2c66650d5f340a7a0690eb24174a2090a58cdba749878832ed8da693ec"}
Jul 16 09:42:42.275616 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.275535    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556" event={"ID":"0dd21c81-1f00-4eef-ad6a-dedcbdc81283","Type":"ContainerDied","Data":"05108b9462afb321c70d3031d4d7fb6035ab7fc6af6b4bc427a72eae857bccb9"}
Jul 16 09:42:42.275616 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.275558    2556 scope.go:117] "RemoveContainer" containerID="70f14f2c66650d5f340a7a0690eb24174a2090a58cdba749878832ed8da693ec"
Jul 16 09:42:42.284980 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.284963    2556 scope.go:117] "RemoveContainer" containerID="9bad9b96733ba855d0cf9c208a371da00b95c07b92600241bd64ecab3a49735e"
Jul 16 09:42:42.292916 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.292899    2556 scope.go:117] "RemoveContainer" containerID="70f14f2c66650d5f340a7a0690eb24174a2090a58cdba749878832ed8da693ec"
Jul 16 09:42:42.293150 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:42:42.293132    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f14f2c66650d5f340a7a0690eb24174a2090a58cdba749878832ed8da693ec\": container with ID starting with 70f14f2c66650d5f340a7a0690eb24174a2090a58cdba749878832ed8da693ec not found: ID does not exist" containerID="70f14f2c66650d5f340a7a0690eb24174a2090a58cdba749878832ed8da693ec"
Jul 16 09:42:42.293190 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.293160    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f14f2c66650d5f340a7a0690eb24174a2090a58cdba749878832ed8da693ec"} err="failed to get container status \"70f14f2c66650d5f340a7a0690eb24174a2090a58cdba749878832ed8da693ec\": rpc error: code = NotFound desc = could not find container \"70f14f2c66650d5f340a7a0690eb24174a2090a58cdba749878832ed8da693ec\": container with ID starting with 70f14f2c66650d5f340a7a0690eb24174a2090a58cdba749878832ed8da693ec not found: ID does not exist"
Jul 16 09:42:42.293190 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.293175    2556 scope.go:117] "RemoveContainer" containerID="9bad9b96733ba855d0cf9c208a371da00b95c07b92600241bd64ecab3a49735e"
Jul 16 09:42:42.293412 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:42:42.293397    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bad9b96733ba855d0cf9c208a371da00b95c07b92600241bd64ecab3a49735e\": container with ID starting with 9bad9b96733ba855d0cf9c208a371da00b95c07b92600241bd64ecab3a49735e not found: ID does not exist" containerID="9bad9b96733ba855d0cf9c208a371da00b95c07b92600241bd64ecab3a49735e"
Jul 16 09:42:42.293456 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.293416    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bad9b96733ba855d0cf9c208a371da00b95c07b92600241bd64ecab3a49735e"} err="failed to get container status \"9bad9b96733ba855d0cf9c208a371da00b95c07b92600241bd64ecab3a49735e\": rpc error: code = NotFound desc = could not find container \"9bad9b96733ba855d0cf9c208a371da00b95c07b92600241bd64ecab3a49735e\": container with ID starting with 9bad9b96733ba855d0cf9c208a371da00b95c07b92600241bd64ecab3a49735e not found: ID does not exist"
Jul 16 09:42:42.299467 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.299445    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"]
Jul 16 09:42:42.303996 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.303977    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-73e67e-openshift-default-7696bf9f7-bd556"]
Jul 16 09:42:42.718362 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:42.718306    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dd21c81-1f00-4eef-ad6a-dedcbdc81283" path="/var/lib/kubelet/pods/0dd21c81-1f00-4eef-ad6a-dedcbdc81283/volumes"
Jul 16 09:42:43.066845 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:43.066738    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:43.212432 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:43.212395    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:45.054407 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:45.054379    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:42:48.949660 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:48.949627    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:49.048783 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:49.048751    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:49.151960 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:49.151929    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"]
Jul 16 09:42:49.152209 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:49.152184    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl" podUID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerName="istio-proxy" containerID="cri-o://510322ea429ed8e4fb78b473ec376fcb7c5ac63c24527302746569071eb4125d" gracePeriod=30
Jul 16 09:42:49.192215 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:49.192187    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:49.398700 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:49.398617    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:49.548751 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:49.548717    2556 patch_prober.go:28] interesting pod/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 16 09:42:49.548923 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:49.548780    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl" podUID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 09:42:49.755175 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:49.755144    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:50.054185 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.054098    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"]
Jul 16 09:42:50.054767 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.054743    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd21c81-1f00-4eef-ad6a-dedcbdc81283" containerName="istio-proxy"
Jul 16 09:42:50.054912 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.054806    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd21c81-1f00-4eef-ad6a-dedcbdc81283" containerName="istio-proxy"
Jul 16 09:42:50.054912 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.054844    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e59f33-6960-4b77-b6e0-78cc8848e0aa" containerName="maas-api"
Jul 16 09:42:50.054912 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.054854    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e59f33-6960-4b77-b6e0-78cc8848e0aa" containerName="maas-api"
Jul 16 09:42:50.054912 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.054869    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd21c81-1f00-4eef-ad6a-dedcbdc81283" containerName="istio-proxy"
Jul 16 09:42:50.054912 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.054876    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd21c81-1f00-4eef-ad6a-dedcbdc81283" containerName="istio-proxy"
Jul 16 09:42:50.055160 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.054984    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dd21c81-1f00-4eef-ad6a-dedcbdc81283" containerName="istio-proxy"
Jul 16 09:42:50.055160 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.055000    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1e59f33-6960-4b77-b6e0-78cc8848e0aa" containerName="maas-api"
Jul 16 09:42:50.058125 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.058104    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.060710 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.060691    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0b4ce8-openshift-default-dockercfg-fgw8t\""
Jul 16 09:42:50.071009 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.070987    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"]
Jul 16 09:42:50.082926 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.082902    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:50.186369 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.183574    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-workload-socket\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.186369 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.183665    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-credential-socket\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.186369 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.183698    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-istio-data\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.186369 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.183754    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-istio-envoy\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.186369 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.183800    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66p22\" (UniqueName: \"kubernetes.io/projected/28698bc7-c904-47da-9b88-86f236f64ff7-kube-api-access-66p22\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.186369 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.183885    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28698bc7-c904-47da-9b88-86f236f64ff7-istio-podinfo\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.186369 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.183910    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28698bc7-c904-47da-9b88-86f236f64ff7-istiod-ca-cert\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.186369 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.183957    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-workload-certs\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.186369 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.183987    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28698bc7-c904-47da-9b88-86f236f64ff7-istio-token\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.285386 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.285335    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-credential-socket\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.285386 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.285386    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-istio-data\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.285597 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.285414    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-istio-envoy\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.285597 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.285438    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66p22\" (UniqueName: \"kubernetes.io/projected/28698bc7-c904-47da-9b88-86f236f64ff7-kube-api-access-66p22\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.285597 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.285481    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28698bc7-c904-47da-9b88-86f236f64ff7-istio-podinfo\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.285597 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.285497    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28698bc7-c904-47da-9b88-86f236f64ff7-istiod-ca-cert\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.285597 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.285513    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-workload-certs\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.285850 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.285628    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28698bc7-c904-47da-9b88-86f236f64ff7-istio-token\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.285850 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.285669    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-workload-socket\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.285850 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.285796    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-credential-socket\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.286013 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.285851    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-istio-data\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.286013 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.285872    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-workload-certs\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.286013 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.285969    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-workload-socket\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.286197 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.286177    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28698bc7-c904-47da-9b88-86f236f64ff7-istiod-ca-cert\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.287808 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.287785    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-istio-envoy\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.288043 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.288024    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28698bc7-c904-47da-9b88-86f236f64ff7-istio-podinfo\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.294566 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.294539    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66p22\" (UniqueName: \"kubernetes.io/projected/28698bc7-c904-47da-9b88-86f236f64ff7-kube-api-access-66p22\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.296894 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.296875    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28698bc7-c904-47da-9b88-86f236f64ff7-istio-token\") pod \"e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") " pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.368550 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.368495    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:50.485962 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.485933    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:50.507014 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.506992    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"]
Jul 16 09:42:50.508255 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:42:50.508230    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28698bc7_c904_47da_9b88_86f236f64ff7.slice/crio-7d991a38aaf4c0d5547ad3acc65e3f842df49371c5326c59d33ff40196a35c89 WatchSource:0}: Error finding container 7d991a38aaf4c0d5547ad3acc65e3f842df49371c5326c59d33ff40196a35c89: Status 404 returned error can't find the container with id 7d991a38aaf4c0d5547ad3acc65e3f842df49371c5326c59d33ff40196a35c89
Jul 16 09:42:50.510319 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.510292    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:50.510413 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.510398    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:50.510456 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:50.510433    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:51.329530 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:51.329493    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw" event={"ID":"28698bc7-c904-47da-9b88-86f236f64ff7","Type":"ContainerStarted","Data":"ea8c62b80c5203852a793f3d758fdf525160f9915147b789237e2570bcb24b82"}
Jul 16 09:42:51.329887 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:51.329555    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw" event={"ID":"28698bc7-c904-47da-9b88-86f236f64ff7","Type":"ContainerStarted","Data":"7d991a38aaf4c0d5547ad3acc65e3f842df49371c5326c59d33ff40196a35c89"}
Jul 16 09:42:51.356511 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:51.356465    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw" podStartSLOduration=1.356450981 podStartE2EDuration="1.356450981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:42:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:42:51.354178661 +0000 UTC m=+2279.178030232" watchObservedRunningTime="2026-07-16 09:42:51.356450981 +0000 UTC m=+2279.180302549"
Jul 16 09:42:51.369624 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:51.369602    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:51.374583 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:51.374563    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:52.254723 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:52.254693    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:52.335955 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:52.335920    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:52.336837 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:52.336819    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:42:52.366952 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:52.366919    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:52.480719 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:52.480684    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:52.825977 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:52.825946    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:53.145737 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:53.145660    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:53.242327 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:53.242299    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:54.348038 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.348006    2556 generic.go:356] "Generic (PLEG): container finished" podID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerID="510322ea429ed8e4fb78b473ec376fcb7c5ac63c24527302746569071eb4125d" exitCode=0
Jul 16 09:42:54.348431 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.348083    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl" event={"ID":"e8e57bc9-d265-4741-87fe-e97e7611299d","Type":"ContainerDied","Data":"510322ea429ed8e4fb78b473ec376fcb7c5ac63c24527302746569071eb4125d"}
Jul 16 09:42:54.348431 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.348233    2556 scope.go:117] "RemoveContainer" containerID="03b56adb024cc34de99db8fe9d3658b521fe209e21aac3b11100e807d952c515"
Jul 16 09:42:54.404286 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.404263    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:54.524440 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.524410    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e57bc9-d265-4741-87fe-e97e7611299d-istiod-ca-cert\") pod \"e8e57bc9-d265-4741-87fe-e97e7611299d\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") "
Jul 16 09:42:54.524440 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.524443    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-workload-certs\") pod \"e8e57bc9-d265-4741-87fe-e97e7611299d\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") "
Jul 16 09:42:54.524643 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.524459    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-workload-socket\") pod \"e8e57bc9-d265-4741-87fe-e97e7611299d\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") "
Jul 16 09:42:54.524643 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.524474    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-data\") pod \"e8e57bc9-d265-4741-87fe-e97e7611299d\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") "
Jul 16 09:42:54.524643 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.524632    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-credential-socket\") pod \"e8e57bc9-d265-4741-87fe-e97e7611299d\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") "
Jul 16 09:42:54.524787 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.524669    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-envoy\") pod \"e8e57bc9-d265-4741-87fe-e97e7611299d\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") "
Jul 16 09:42:54.524787 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.524710    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e8e57bc9-d265-4741-87fe-e97e7611299d" (UID: "e8e57bc9-d265-4741-87fe-e97e7611299d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:54.524787 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.524736    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e8e57bc9-d265-4741-87fe-e97e7611299d" (UID: "e8e57bc9-d265-4741-87fe-e97e7611299d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:54.524787 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.524725    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-podinfo\") pod \"e8e57bc9-d265-4741-87fe-e97e7611299d\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") "
Jul 16 09:42:54.524988 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.524800    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-token\") pod \"e8e57bc9-d265-4741-87fe-e97e7611299d\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") "
Jul 16 09:42:54.524988 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.524846    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw7wl\" (UniqueName: \"kubernetes.io/projected/e8e57bc9-d265-4741-87fe-e97e7611299d-kube-api-access-fw7wl\") pod \"e8e57bc9-d265-4741-87fe-e97e7611299d\" (UID: \"e8e57bc9-d265-4741-87fe-e97e7611299d\") "
Jul 16 09:42:54.524988 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.524909    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e8e57bc9-d265-4741-87fe-e97e7611299d" (UID: "e8e57bc9-d265-4741-87fe-e97e7611299d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:54.524988 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.524934    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e57bc9-d265-4741-87fe-e97e7611299d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e8e57bc9-d265-4741-87fe-e97e7611299d" (UID: "e8e57bc9-d265-4741-87fe-e97e7611299d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:42:54.525219 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.525199    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8e57bc9-d265-4741-87fe-e97e7611299d-istiod-ca-cert\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:54.525269 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.525225    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-workload-certs\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:54.525269 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.525239    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-workload-socket\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:54.525269 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.525253    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-credential-socket\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:54.525419 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.525314    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-data" (OuterVolumeSpecName: "istio-data") pod "e8e57bc9-d265-4741-87fe-e97e7611299d" (UID: "e8e57bc9-d265-4741-87fe-e97e7611299d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:54.526805 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.526770    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e8e57bc9-d265-4741-87fe-e97e7611299d" (UID: "e8e57bc9-d265-4741-87fe-e97e7611299d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:54.526920 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.526826    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8e57bc9-d265-4741-87fe-e97e7611299d" (UID: "e8e57bc9-d265-4741-87fe-e97e7611299d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:42:54.527215 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.527191    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e8e57bc9-d265-4741-87fe-e97e7611299d" (UID: "e8e57bc9-d265-4741-87fe-e97e7611299d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 09:42:54.527282 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.527196    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e57bc9-d265-4741-87fe-e97e7611299d-kube-api-access-fw7wl" (OuterVolumeSpecName: "kube-api-access-fw7wl") pod "e8e57bc9-d265-4741-87fe-e97e7611299d" (UID: "e8e57bc9-d265-4741-87fe-e97e7611299d"). InnerVolumeSpecName "kube-api-access-fw7wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:42:54.626177 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.626138    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-data\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:54.626177 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.626174    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-envoy\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:54.626323 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.626186    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-podinfo\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:54.626323 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.626199    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8e57bc9-d265-4741-87fe-e97e7611299d-istio-token\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:54.626323 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:54.626211    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw7wl\" (UniqueName: \"kubernetes.io/projected/e8e57bc9-d265-4741-87fe-e97e7611299d-kube-api-access-fw7wl\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:42:55.354719 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:55.354691    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"
Jul 16 09:42:55.355162 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:55.354732    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl" event={"ID":"e8e57bc9-d265-4741-87fe-e97e7611299d","Type":"ContainerDied","Data":"097677744f5bdc15accc6851dfc758f5aa3fcdf59f83f4568cdfdf3a2ee8077f"}
Jul 16 09:42:55.355162 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:55.354797    2556 scope.go:117] "RemoveContainer" containerID="510322ea429ed8e4fb78b473ec376fcb7c5ac63c24527302746569071eb4125d"
Jul 16 09:42:55.374165 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:55.374142    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"]
Jul 16 09:42:55.379423 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:55.379405    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-d109ac-openshift-default-f66b6c585-x45xl"]
Jul 16 09:42:56.718928 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:56.718895    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e57bc9-d265-4741-87fe-e97e7611299d" path="/var/lib/kubelet/pods/e8e57bc9-d265-4741-87fe-e97e7611299d/volumes"
Jul 16 09:42:57.772137 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:57.772110    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:58.089064 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.088988    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:58.367733 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.367630    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"]
Jul 16 09:42:58.368420 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.368398    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerName="istio-proxy"
Jul 16 09:42:58.368420 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.368420    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerName="istio-proxy"
Jul 16 09:42:58.368613 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.368551    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerName="istio-proxy"
Jul 16 09:42:58.368613 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.368567    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dd21c81-1f00-4eef-ad6a-dedcbdc81283" containerName="istio-proxy"
Jul 16 09:42:58.370890 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.370866    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.373109 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.373089    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-8577c1-openshift-default-dockercfg-2jxkr\""
Jul 16 09:42:58.382878 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.382857    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"]
Jul 16 09:42:58.412697 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.412659    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:58.457940 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.457918    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-workload-socket\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.458053 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.457951    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-token\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.458053 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.457982    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-envoy\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.458130 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.458078    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-data\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.458130 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.458115    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjqdt\" (UniqueName: \"kubernetes.io/projected/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-kube-api-access-rjqdt\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.458194 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.458148    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-credential-socket\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.458194 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.458185    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-podinfo\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.458255 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.458218    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istiod-ca-cert\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.458255 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.458246    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-workload-certs\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.559227 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.559194    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-workload-socket\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.559227 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.559232    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-token\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.559493 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.559266    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-envoy\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.559493 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.559298    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-data\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.559493 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.559315    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjqdt\" (UniqueName: \"kubernetes.io/projected/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-kube-api-access-rjqdt\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.559493 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.559342    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-credential-socket\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.559493 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.559406    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-podinfo\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.559493 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.559433    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istiod-ca-cert\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.559493 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.559464    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-workload-certs\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.559866 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.559761    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-workload-socket\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.559866 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.559773    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-data\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.559979 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.559923    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-workload-certs\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.559979 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.559963    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-credential-socket\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.560373 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.560331    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istiod-ca-cert\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.562049 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.562017    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-envoy\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.562322 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.562300    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-podinfo\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.563234 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.563216    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:42:58.567640 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.567613    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-token\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.568025 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.568009    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjqdt\" (UniqueName: \"kubernetes.io/projected/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-kube-api-access-rjqdt\") pod \"e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") " pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.682063 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.682036    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:58.824166 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.824135    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"]
Jul 16 09:42:58.826367 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:42:58.826327    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d978c64_95cf_4bf6_ad4d_f706c7143fe7.slice/crio-2b3e779d2010fc13c0ead7547be68d06db02c2705db1fad44a05683323d3bb2a WatchSource:0}: Error finding container 2b3e779d2010fc13c0ead7547be68d06db02c2705db1fad44a05683323d3bb2a: Status 404 returned error can't find the container with id 2b3e779d2010fc13c0ead7547be68d06db02c2705db1fad44a05683323d3bb2a
Jul 16 09:42:58.828795 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.828758    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:58.828894 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.828877    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:58.828947 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.828933    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:42:58.971582 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:58.971501    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:42:59.387595 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:59.387508    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr" event={"ID":"3d978c64-95cf-4bf6-ad4d-f706c7143fe7","Type":"ContainerStarted","Data":"1ca91c3da0c297c2faef621b97d963fde9d3c8c4ecb136856fdc0c84be280fc0"}
Jul 16 09:42:59.387741 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:59.387594    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr" event={"ID":"3d978c64-95cf-4bf6-ad4d-f706c7143fe7","Type":"ContainerStarted","Data":"2b3e779d2010fc13c0ead7547be68d06db02c2705db1fad44a05683323d3bb2a"}
Jul 16 09:42:59.413155 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:59.413106    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr" podStartSLOduration=1.413090956 podStartE2EDuration="1.413090956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:42:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:42:59.411387251 +0000 UTC m=+2287.235238836" watchObservedRunningTime="2026-07-16 09:42:59.413090956 +0000 UTC m=+2287.236942605"
Jul 16 09:42:59.682518 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:59.682482    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:42:59.687417 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:42:59.687394    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:43:00.330033 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:00.329997    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:43:00.395492 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:00.395464    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:43:00.396522 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:00.396501    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:43:00.433284 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:00.433252    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:43:00.533565 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:00.533536    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:43:00.686258 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:00.686227    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:43:01.215196 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:01.215164    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:43:01.315890 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:01.315858    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:43:05.816515 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:05.816478    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:43:07.337282 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:07.337246    2556 patch_prober.go:28] interesting pod/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 16 09:43:07.337934 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:07.337901    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw" podUID="28698bc7-c904-47da-9b88-86f236f64ff7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 16 09:43:07.444783 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:07.444753    2556 generic.go:356] "Generic (PLEG): container finished" podID="28698bc7-c904-47da-9b88-86f236f64ff7" containerID="ea8c62b80c5203852a793f3d758fdf525160f9915147b789237e2570bcb24b82" exitCode=0
Jul 16 09:43:07.444944 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:07.444832    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw" event={"ID":"28698bc7-c904-47da-9b88-86f236f64ff7","Type":"ContainerDied","Data":"ea8c62b80c5203852a793f3d758fdf525160f9915147b789237e2570bcb24b82"}
Jul 16 09:43:07.445216 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:07.445200    2556 scope.go:117] "RemoveContainer" containerID="ea8c62b80c5203852a793f3d758fdf525160f9915147b789237e2570bcb24b82"
Jul 16 09:43:07.446203 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:07.446180    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:43:07.446268 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:07.446256    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:43:07.446304 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:07.446290    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:43:08.476259 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:08.476218    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw" event={"ID":"28698bc7-c904-47da-9b88-86f236f64ff7","Type":"ContainerStarted","Data":"3e1b8dfd72f5aebc626364746c1fbd9e484694ad12fbb718034fc1947f9694c1"}
Jul 16 09:43:09.272177 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:09.272151    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:43:09.369395 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:09.369336    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:43:09.369655 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:09.369634    2556 patch_prober.go:28] interesting pod/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 16 09:43:09.369720 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:09.369681    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw" podUID="28698bc7-c904-47da-9b88-86f236f64ff7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 16 09:43:10.369203 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:10.369162    2556 patch_prober.go:28] interesting pod/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 16 09:43:10.369619 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:10.369229    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw" podUID="28698bc7-c904-47da-9b88-86f236f64ff7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 16 09:43:10.767864 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:10.767834    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:43:11.369008 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:11.368975    2556 patch_prober.go:28] interesting pod/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 16 09:43:11.369175 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:11.369043    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw" podUID="28698bc7-c904-47da-9b88-86f236f64ff7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 16 09:43:12.369127 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:12.369086    2556 patch_prober.go:28] interesting pod/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 16 09:43:12.369570 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:12.369164    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw" podUID="28698bc7-c904-47da-9b88-86f236f64ff7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 16 09:43:13.373274 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:13.373241    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:43:13.373738 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:13.373594    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:43:13.374116 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:13.374101    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:43:13.508854 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:13.508823    2556 generic.go:356] "Generic (PLEG): container finished" podID="3d978c64-95cf-4bf6-ad4d-f706c7143fe7" containerID="1ca91c3da0c297c2faef621b97d963fde9d3c8c4ecb136856fdc0c84be280fc0" exitCode=0
Jul 16 09:43:13.509016 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:13.508902    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr" event={"ID":"3d978c64-95cf-4bf6-ad4d-f706c7143fe7","Type":"ContainerDied","Data":"1ca91c3da0c297c2faef621b97d963fde9d3c8c4ecb136856fdc0c84be280fc0"}
Jul 16 09:43:13.509503 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:13.509485    2556 scope.go:117] "RemoveContainer" containerID="1ca91c3da0c297c2faef621b97d963fde9d3c8c4ecb136856fdc0c84be280fc0"
Jul 16 09:43:13.510553 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:13.510517    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:43:13.510681 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:13.510601    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:43:13.510681 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:13.510649    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:43:13.939464 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:13.939435    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:43:14.042339 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:14.042311    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:43:14.519736 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:14.519689    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr" event={"ID":"3d978c64-95cf-4bf6-ad4d-f706c7143fe7","Type":"ContainerStarted","Data":"5b4abb898b45898143fadc84f49c916cc00ea3167137810e82337b0b47d9fb72"}
Jul 16 09:43:14.682323 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:14.682281    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:43:14.683459 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:14.683434    2556 patch_prober.go:28] interesting pod/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 16 09:43:14.683587 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:14.683481    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr" podUID="3d978c64-95cf-4bf6-ad4d-f706c7143fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 16 09:43:15.395480 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:15.395451    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:43:15.683451 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:15.683417    2556 patch_prober.go:28] interesting pod/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 16 09:43:15.683820 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:15.683468    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr" podUID="3d978c64-95cf-4bf6-ad4d-f706c7143fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 16 09:43:16.682763 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:16.682725    2556 patch_prober.go:28] interesting pod/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 16 09:43:16.682952 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:16.682801    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr" podUID="3d978c64-95cf-4bf6-ad4d-f706c7143fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 16 09:43:17.683190 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:17.683155    2556 patch_prober.go:28] interesting pod/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 16 09:43:17.683581 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:17.683217    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr" podUID="3d978c64-95cf-4bf6-ad4d-f706c7143fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 16 09:43:18.687987 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:18.687955    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:43:18.689061 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:18.689040    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:43:22.099808 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:22.099779    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:43:22.201725 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:22.201696    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:43:23.907842 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:23.907812    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:43:27.451052 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:27.451019    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:43:58.980976 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:58.980945    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"]
Jul 16 09:43:58.981621 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:58.981599    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerName="istio-proxy"
Jul 16 09:43:58.981621 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:58.981622    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerName="istio-proxy"
Jul 16 09:43:58.981768 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:58.981723    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e57bc9-d265-4741-87fe-e97e7611299d" containerName="istio-proxy"
Jul 16 09:43:58.984594 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:58.984572    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:58.987649 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:58.987622    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8577c1\"/\"default-dockercfg-x6s97\""
Jul 16 09:43:58.987735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:58.987699    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8577c1\"/\"auth-test-model-8577c1-kserve-self-signed-certs\""
Jul 16 09:43:58.987795 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:58.987636    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8577c1\"/\"kube-root-ca.crt\""
Jul 16 09:43:58.987863 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:58.987622    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8577c1\"/\"openshift-service-ca.crt\""
Jul 16 09:43:58.995646 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:58.995628    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"]
Jul 16 09:43:59.001671 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.001643    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:43:59.111012 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.110982    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-tmp-dir\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.111163 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.111041    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-home\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.111163 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.111060    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-dshm\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.111163 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.111121    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-model-cache\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.111286 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.111160    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/792d9ab6-f736-42a7-bd9c-6c77936d6a67-tls-certs\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.111286 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.111181    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g86lm\" (UniqueName: \"kubernetes.io/projected/792d9ab6-f736-42a7-bd9c-6c77936d6a67-kube-api-access-g86lm\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.212036 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.212002    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-home\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.212213 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.212041    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-dshm\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.212213 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.212085    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-model-cache\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.212213 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.212116    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/792d9ab6-f736-42a7-bd9c-6c77936d6a67-tls-certs\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.212213 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.212138    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g86lm\" (UniqueName: \"kubernetes.io/projected/792d9ab6-f736-42a7-bd9c-6c77936d6a67-kube-api-access-g86lm\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.212213 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.212208    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-tmp-dir\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.212535 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.212419    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-home\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.212535 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.212479    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-model-cache\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.212635 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.212569    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-tmp-dir\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.214343 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.214317    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-dshm\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.214680 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.214664    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/792d9ab6-f736-42a7-bd9c-6c77936d6a67-tls-certs\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.220019 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.219994    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g86lm\" (UniqueName: \"kubernetes.io/projected/792d9ab6-f736-42a7-bd9c-6c77936d6a67-kube-api-access-g86lm\") pod \"auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") " pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.294892 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.294830    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:43:59.461762 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.461724    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"]
Jul 16 09:43:59.463788 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:43:59.463755    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod792d9ab6_f736_42a7_bd9c_6c77936d6a67.slice/crio-d58f8f134b16967538784687d38bff2b26e795d947da22ad7b78aad863ca3c99 WatchSource:0}: Error finding container d58f8f134b16967538784687d38bff2b26e795d947da22ad7b78aad863ca3c99: Status 404 returned error can't find the container with id d58f8f134b16967538784687d38bff2b26e795d947da22ad7b78aad863ca3c99
Jul 16 09:43:59.785656 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.785625    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk" event={"ID":"792d9ab6-f736-42a7-bd9c-6c77936d6a67","Type":"ContainerStarted","Data":"52edfbe70dba0822ffe9226f99320128ca36f5714ad960727cfc3f8516dad3fc"}
Jul 16 09:43:59.785849 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.785672    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk" event={"ID":"792d9ab6-f736-42a7-bd9c-6c77936d6a67","Type":"ContainerStarted","Data":"d58f8f134b16967538784687d38bff2b26e795d947da22ad7b78aad863ca3c99"}
Jul 16 09:43:59.804723 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:43:59.804676    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk" podStartSLOduration=1.804659244 podStartE2EDuration="1.804659244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:43:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:43:59.801986312 +0000 UTC m=+2347.625837874" watchObservedRunningTime="2026-07-16 09:43:59.804659244 +0000 UTC m=+2347.628510813"
Jul 16 09:44:02.659838 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:44:02.659797    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:44:06.133228 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:44:06.133198    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:44:09.294978 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:44:09.294948    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:44:09.295344 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:44:09.294997    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:44:09.307283 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:44:09.307260    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:44:09.856656 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:44:09.856631    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:44:12.908153 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:44:12.908112    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:44:13.003552 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:44:13.003517    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:44:16.954755 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:44:16.954719    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:44:34.349694 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:44:34.349655    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:44:44.938563 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:44:44.938502    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:44:48.855776 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:44:48.855739    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:44:52.849939 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:44:52.849903    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:44:52.860456 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:44:52.860434    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:45:00.142498 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:00.142467    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0b4ce8-29736585-q2ppw"]
Jul 16 09:45:00.146478 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:00.146454    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0b4ce8-29736585-q2ppw"
Jul 16 09:45:00.149207 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:00.149182    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtlcb\""
Jul 16 09:45:00.157247 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:00.157222    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0b4ce8-29736585-q2ppw"
Jul 16 09:45:00.159768 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:00.159742    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0b4ce8-29736585-q2ppw"]
Jul 16 09:45:00.294860 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:00.294837    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0b4ce8-29736585-q2ppw"]
Jul 16 09:45:00.297174 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:45:00.297145    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0aefa99_7e24_45bf_af45_f777d03f8693.slice/crio-06baad42e36339a1b220c16bbf0c7f179641592083a5614877ef032e4ad081ab WatchSource:0}: Error finding container 06baad42e36339a1b220c16bbf0c7f179641592083a5614877ef032e4ad081ab: Status 404 returned error can't find the container with id 06baad42e36339a1b220c16bbf0c7f179641592083a5614877ef032e4ad081ab
Jul 16 09:45:01.136576 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:01.136540    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0b4ce8-29736585-q2ppw" event={"ID":"f0aefa99-7e24-45bf-af45-f777d03f8693","Type":"ContainerStarted","Data":"08e1682f3cede3943f1ce3dd3557d6eaeb32458db896b20b6ad00b636990131d"}
Jul 16 09:45:01.136755 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:01.136601    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0b4ce8-29736585-q2ppw" event={"ID":"f0aefa99-7e24-45bf-af45-f777d03f8693","Type":"ContainerStarted","Data":"06baad42e36339a1b220c16bbf0c7f179641592083a5614877ef032e4ad081ab"}
Jul 16 09:45:01.153698 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:01.153645    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0b4ce8-29736585-q2ppw" podStartSLOduration=1.15362972 podStartE2EDuration="1.15362972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:45:01.151876546 +0000 UTC m=+2408.975728116" watchObservedRunningTime="2026-07-16 09:45:01.15362972 +0000 UTC m=+2408.977481285"
Jul 16 09:45:02.149553 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:02.149517    2556 generic.go:356] "Generic (PLEG): container finished" podID="f0aefa99-7e24-45bf-af45-f777d03f8693" containerID="08e1682f3cede3943f1ce3dd3557d6eaeb32458db896b20b6ad00b636990131d" exitCode=0
Jul 16 09:45:02.149736 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:02.149562    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0b4ce8-29736585-q2ppw" event={"ID":"f0aefa99-7e24-45bf-af45-f777d03f8693","Type":"ContainerDied","Data":"08e1682f3cede3943f1ce3dd3557d6eaeb32458db896b20b6ad00b636990131d"}
Jul 16 09:45:03.299805 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:03.299783    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0b4ce8-29736585-q2ppw"
Jul 16 09:45:04.161453 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:04.161417    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0b4ce8-29736585-q2ppw" event={"ID":"f0aefa99-7e24-45bf-af45-f777d03f8693","Type":"ContainerDied","Data":"06baad42e36339a1b220c16bbf0c7f179641592083a5614877ef032e4ad081ab"}
Jul 16 09:45:04.161453 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:04.161436    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0b4ce8-29736585-q2ppw"
Jul 16 09:45:04.161670 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:04.161469    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06baad42e36339a1b220c16bbf0c7f179641592083a5614877ef032e4ad081ab"
Jul 16 09:45:07.254824 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:07.254788    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:45:26.663126 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:26.663051    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:45:45.348859 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:45.348823    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:45:56.328166 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:56.328129    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:45:56.428159 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:45:56.428131    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:46:04.449790 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:04.449753    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:46:07.914286 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:07.914255    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:46:08.770397 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:08.770338    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"]
Jul 16 09:46:08.791572 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:08.791551    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:46:15.119485 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:15.119455    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:46:15.411609 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:15.411581    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:46:22.556455 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:22.556421    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:46:23.792499 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:23.792451    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk" podUID="792d9ab6-f736-42a7-bd9c-6c77936d6a67" containerName="main" containerID="cri-o://52edfbe70dba0822ffe9226f99320128ca36f5714ad960727cfc3f8516dad3fc" gracePeriod=45
Jul 16 09:46:24.052512 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.052459    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:46:24.152439 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.152410    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-home\") pod \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") "
Jul 16 09:46:24.152613 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.152454    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-dshm\") pod \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") "
Jul 16 09:46:24.152613 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.152471    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/792d9ab6-f736-42a7-bd9c-6c77936d6a67-tls-certs\") pod \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") "
Jul 16 09:46:24.152613 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.152486    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-tmp-dir\") pod \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") "
Jul 16 09:46:24.152790 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.152614    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-model-cache\") pod \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") "
Jul 16 09:46:24.152790 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.152645    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g86lm\" (UniqueName: \"kubernetes.io/projected/792d9ab6-f736-42a7-bd9c-6c77936d6a67-kube-api-access-g86lm\") pod \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\" (UID: \"792d9ab6-f736-42a7-bd9c-6c77936d6a67\") "
Jul 16 09:46:24.152790 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.152695    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-home" (OuterVolumeSpecName: "home") pod "792d9ab6-f736-42a7-bd9c-6c77936d6a67" (UID: "792d9ab6-f736-42a7-bd9c-6c77936d6a67"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:46:24.152790 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.152755    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "792d9ab6-f736-42a7-bd9c-6c77936d6a67" (UID: "792d9ab6-f736-42a7-bd9c-6c77936d6a67"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:46:24.153001 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.152843    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-model-cache" (OuterVolumeSpecName: "model-cache") pod "792d9ab6-f736-42a7-bd9c-6c77936d6a67" (UID: "792d9ab6-f736-42a7-bd9c-6c77936d6a67"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:46:24.153001 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.152986    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-model-cache\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:46:24.153001 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.152998    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-home\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:46:24.153152 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.153012    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-tmp-dir\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:46:24.154633 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.154611    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-dshm" (OuterVolumeSpecName: "dshm") pod "792d9ab6-f736-42a7-bd9c-6c77936d6a67" (UID: "792d9ab6-f736-42a7-bd9c-6c77936d6a67"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:46:24.154756 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.154713    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/792d9ab6-f736-42a7-bd9c-6c77936d6a67-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "792d9ab6-f736-42a7-bd9c-6c77936d6a67" (UID: "792d9ab6-f736-42a7-bd9c-6c77936d6a67"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:46:24.154834 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.154812    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/792d9ab6-f736-42a7-bd9c-6c77936d6a67-kube-api-access-g86lm" (OuterVolumeSpecName: "kube-api-access-g86lm") pod "792d9ab6-f736-42a7-bd9c-6c77936d6a67" (UID: "792d9ab6-f736-42a7-bd9c-6c77936d6a67"). InnerVolumeSpecName "kube-api-access-g86lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:46:24.253822 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.253797    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/792d9ab6-f736-42a7-bd9c-6c77936d6a67-dshm\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:46:24.253822 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.253821    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/792d9ab6-f736-42a7-bd9c-6c77936d6a67-tls-certs\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:46:24.253973 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.253836    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g86lm\" (UniqueName: \"kubernetes.io/projected/792d9ab6-f736-42a7-bd9c-6c77936d6a67-kube-api-access-g86lm\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:46:24.629604 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.629575    2556 generic.go:356] "Generic (PLEG): container finished" podID="792d9ab6-f736-42a7-bd9c-6c77936d6a67" containerID="52edfbe70dba0822ffe9226f99320128ca36f5714ad960727cfc3f8516dad3fc" exitCode=0
Jul 16 09:46:24.629782 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.629615    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk" event={"ID":"792d9ab6-f736-42a7-bd9c-6c77936d6a67","Type":"ContainerDied","Data":"52edfbe70dba0822ffe9226f99320128ca36f5714ad960727cfc3f8516dad3fc"}
Jul 16 09:46:24.629782 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.629625    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"
Jul 16 09:46:24.629782 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.629643    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk" event={"ID":"792d9ab6-f736-42a7-bd9c-6c77936d6a67","Type":"ContainerDied","Data":"d58f8f134b16967538784687d38bff2b26e795d947da22ad7b78aad863ca3c99"}
Jul 16 09:46:24.629782 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.629660    2556 scope.go:117] "RemoveContainer" containerID="52edfbe70dba0822ffe9226f99320128ca36f5714ad960727cfc3f8516dad3fc"
Jul 16 09:46:24.645440 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.645421    2556 scope.go:117] "RemoveContainer" containerID="52edfbe70dba0822ffe9226f99320128ca36f5714ad960727cfc3f8516dad3fc"
Jul 16 09:46:24.645674 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:46:24.645654    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52edfbe70dba0822ffe9226f99320128ca36f5714ad960727cfc3f8516dad3fc\": container with ID starting with 52edfbe70dba0822ffe9226f99320128ca36f5714ad960727cfc3f8516dad3fc not found: ID does not exist" containerID="52edfbe70dba0822ffe9226f99320128ca36f5714ad960727cfc3f8516dad3fc"
Jul 16 09:46:24.645726 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.645683    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52edfbe70dba0822ffe9226f99320128ca36f5714ad960727cfc3f8516dad3fc"} err="failed to get container status \"52edfbe70dba0822ffe9226f99320128ca36f5714ad960727cfc3f8516dad3fc\": rpc error: code = NotFound desc = could not find container \"52edfbe70dba0822ffe9226f99320128ca36f5714ad960727cfc3f8516dad3fc\": container with ID starting with 52edfbe70dba0822ffe9226f99320128ca36f5714ad960727cfc3f8516dad3fc not found: ID does not exist"
Jul 16 09:46:24.654623 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.654602    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"]
Jul 16 09:46:24.661003 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.660984    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/auth-test-model-8577c1-kserve-5b8dd7dddc-tgsqk"]
Jul 16 09:46:24.719684 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:24.719656    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="792d9ab6-f736-42a7-bd9c-6c77936d6a67" path="/var/lib/kubelet/pods/792d9ab6-f736-42a7-bd9c-6c77936d6a67/volumes"
Jul 16 09:46:37.184762 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.184727    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"]
Jul 16 09:46:37.185159 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.185146    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="792d9ab6-f736-42a7-bd9c-6c77936d6a67" containerName="main"
Jul 16 09:46:37.185204 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.185161    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="792d9ab6-f736-42a7-bd9c-6c77936d6a67" containerName="main"
Jul 16 09:46:37.185204 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.185189    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0aefa99-7e24-45bf-af45-f777d03f8693" containerName="cleanup"
Jul 16 09:46:37.185204 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.185195    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0aefa99-7e24-45bf-af45-f777d03f8693" containerName="cleanup"
Jul 16 09:46:37.185302 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.185265    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="792d9ab6-f736-42a7-bd9c-6c77936d6a67" containerName="main"
Jul 16 09:46:37.185302 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.185274    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0aefa99-7e24-45bf-af45-f777d03f8693" containerName="cleanup"
Jul 16 09:46:37.188201 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.188184    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.190541 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.190524    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8577c1\"/\"kube-root-ca.crt\""
Jul 16 09:46:37.191450 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.191404    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8577c1\"/\"default-dockercfg-x6s97\""
Jul 16 09:46:37.191544 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.191433    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8577c1\"/\"openshift-service-ca.crt\""
Jul 16 09:46:37.191600 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.191507    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8577c1\"/\"sub-test-model-8577c1-kserve-self-signed-certs\""
Jul 16 09:46:37.198774 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.198744    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"]
Jul 16 09:46:37.211259 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.211234    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:46:37.270291 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.270254    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-home\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.270451 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.270376    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wktj4\" (UniqueName: \"kubernetes.io/projected/c24cd697-3895-4db5-a1fb-4e3e96262a08-kube-api-access-wktj4\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.270451 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.270445    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-dshm\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.270587 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.270470    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c24cd697-3895-4db5-a1fb-4e3e96262a08-tls-certs\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.270587 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.270543    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-tmp-dir\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.270587 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.270575    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-model-cache\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.371680 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.371651    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-dshm\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.371680 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.371680    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c24cd697-3895-4db5-a1fb-4e3e96262a08-tls-certs\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.371902 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.371832    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-tmp-dir\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.371902 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.371876    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-model-cache\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.372008 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.371935    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-home\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.372059 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.372006    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wktj4\" (UniqueName: \"kubernetes.io/projected/c24cd697-3895-4db5-a1fb-4e3e96262a08-kube-api-access-wktj4\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.372227 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.372163    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-tmp-dir\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.372308 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.372227    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-model-cache\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.372308 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.372279    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-home\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.373911 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.373883    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-dshm\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.374187 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.374171    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c24cd697-3895-4db5-a1fb-4e3e96262a08-tls-certs\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.395396 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.395376    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wktj4\" (UniqueName: \"kubernetes.io/projected/c24cd697-3895-4db5-a1fb-4e3e96262a08-kube-api-access-wktj4\") pod \"sub-test-model-8577c1-kserve-5d6778448f-f6s94\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") " pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.498642 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.498576    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:37.641922 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.641897    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"]
Jul 16 09:46:37.642221 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:46:37.642192    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc24cd697_3895_4db5_a1fb_4e3e96262a08.slice/crio-3f3e9a579edd67769cbe4a488ff6de27f1c6c750c0c98d25b61beb1a5dfae79a WatchSource:0}: Error finding container 3f3e9a579edd67769cbe4a488ff6de27f1c6c750c0c98d25b61beb1a5dfae79a: Status 404 returned error can't find the container with id 3f3e9a579edd67769cbe4a488ff6de27f1c6c750c0c98d25b61beb1a5dfae79a
Jul 16 09:46:37.704736 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.704704    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94" event={"ID":"c24cd697-3895-4db5-a1fb-4e3e96262a08","Type":"ContainerStarted","Data":"6c03d4b4c1b2edff97619dcac645a4b3769f5ea266d817a17470af3853160c49"}
Jul 16 09:46:37.704840 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.704746    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94" event={"ID":"c24cd697-3895-4db5-a1fb-4e3e96262a08","Type":"ContainerStarted","Data":"3f3e9a579edd67769cbe4a488ff6de27f1c6c750c0c98d25b61beb1a5dfae79a"}
Jul 16 09:46:37.722654 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:37.722606    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94" podStartSLOduration=0.722586386 podStartE2EDuration="722.586386ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:46:37.72187179 +0000 UTC m=+2505.545723365" watchObservedRunningTime="2026-07-16 09:46:37.722586386 +0000 UTC m=+2505.546437959"
Jul 16 09:46:41.463829 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:41.463794    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:46:47.499501 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:47.499418    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:47.499962 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:47.499492    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:47.512461 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:47.512435    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:47.774660 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:47.774593    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:46:57.155276 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:46:57.155245    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:47:17.364899 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:17.364867    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:47:23.894054 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:23.894017    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:47:24.686071 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:24.686038    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"]
Jul 16 09:47:24.706049 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:24.706019    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:47:36.259577 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:36.259541    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:47:39.225915 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:39.225886    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:47:39.705979 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:39.705945    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94" podUID="c24cd697-3895-4db5-a1fb-4e3e96262a08" containerName="main" containerID="cri-o://6c03d4b4c1b2edff97619dcac645a4b3769f5ea266d817a17470af3853160c49" gracePeriod=45
Jul 16 09:47:39.971995 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:39.971930    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:47:40.059426 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.059381    2556 generic.go:356] "Generic (PLEG): container finished" podID="c24cd697-3895-4db5-a1fb-4e3e96262a08" containerID="6c03d4b4c1b2edff97619dcac645a4b3769f5ea266d817a17470af3853160c49" exitCode=0
Jul 16 09:47:40.059426 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.059410    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"
Jul 16 09:47:40.059609 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.059449    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94" event={"ID":"c24cd697-3895-4db5-a1fb-4e3e96262a08","Type":"ContainerDied","Data":"6c03d4b4c1b2edff97619dcac645a4b3769f5ea266d817a17470af3853160c49"}
Jul 16 09:47:40.059609 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.059487    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94" event={"ID":"c24cd697-3895-4db5-a1fb-4e3e96262a08","Type":"ContainerDied","Data":"3f3e9a579edd67769cbe4a488ff6de27f1c6c750c0c98d25b61beb1a5dfae79a"}
Jul 16 09:47:40.059609 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.059505    2556 scope.go:117] "RemoveContainer" containerID="6c03d4b4c1b2edff97619dcac645a4b3769f5ea266d817a17470af3853160c49"
Jul 16 09:47:40.068785 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.068771    2556 scope.go:117] "RemoveContainer" containerID="6c03d4b4c1b2edff97619dcac645a4b3769f5ea266d817a17470af3853160c49"
Jul 16 09:47:40.069022 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:47:40.069004    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c03d4b4c1b2edff97619dcac645a4b3769f5ea266d817a17470af3853160c49\": container with ID starting with 6c03d4b4c1b2edff97619dcac645a4b3769f5ea266d817a17470af3853160c49 not found: ID does not exist" containerID="6c03d4b4c1b2edff97619dcac645a4b3769f5ea266d817a17470af3853160c49"
Jul 16 09:47:40.069077 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.069031    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c03d4b4c1b2edff97619dcac645a4b3769f5ea266d817a17470af3853160c49"} err="failed to get container status \"6c03d4b4c1b2edff97619dcac645a4b3769f5ea266d817a17470af3853160c49\": rpc error: code = NotFound desc = could not find container \"6c03d4b4c1b2edff97619dcac645a4b3769f5ea266d817a17470af3853160c49\": container with ID starting with 6c03d4b4c1b2edff97619dcac645a4b3769f5ea266d817a17470af3853160c49 not found: ID does not exist"
Jul 16 09:47:40.113557 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.113535    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c24cd697-3895-4db5-a1fb-4e3e96262a08-tls-certs\") pod \"c24cd697-3895-4db5-a1fb-4e3e96262a08\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") "
Jul 16 09:47:40.113676 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.113593    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-home\") pod \"c24cd697-3895-4db5-a1fb-4e3e96262a08\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") "
Jul 16 09:47:40.113676 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.113609    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-dshm\") pod \"c24cd697-3895-4db5-a1fb-4e3e96262a08\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") "
Jul 16 09:47:40.113676 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.113627    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-model-cache\") pod \"c24cd697-3895-4db5-a1fb-4e3e96262a08\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") "
Jul 16 09:47:40.113833 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.113777    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-tmp-dir\") pod \"c24cd697-3895-4db5-a1fb-4e3e96262a08\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") "
Jul 16 09:47:40.113833 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.113809    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-model-cache" (OuterVolumeSpecName: "model-cache") pod "c24cd697-3895-4db5-a1fb-4e3e96262a08" (UID: "c24cd697-3895-4db5-a1fb-4e3e96262a08"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:47:40.113833 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.113822    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-home" (OuterVolumeSpecName: "home") pod "c24cd697-3895-4db5-a1fb-4e3e96262a08" (UID: "c24cd697-3895-4db5-a1fb-4e3e96262a08"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:47:40.114005 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.113825    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wktj4\" (UniqueName: \"kubernetes.io/projected/c24cd697-3895-4db5-a1fb-4e3e96262a08-kube-api-access-wktj4\") pod \"c24cd697-3895-4db5-a1fb-4e3e96262a08\" (UID: \"c24cd697-3895-4db5-a1fb-4e3e96262a08\") "
Jul 16 09:47:40.114059 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.113997    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c24cd697-3895-4db5-a1fb-4e3e96262a08" (UID: "c24cd697-3895-4db5-a1fb-4e3e96262a08"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:47:40.114212 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.114195    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-home\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:47:40.114277 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.114216    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-model-cache\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:47:40.114277 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.114229    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-tmp-dir\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:47:40.115769 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.115748    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c24cd697-3895-4db5-a1fb-4e3e96262a08-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c24cd697-3895-4db5-a1fb-4e3e96262a08" (UID: "c24cd697-3895-4db5-a1fb-4e3e96262a08"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:47:40.115867 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.115791    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-dshm" (OuterVolumeSpecName: "dshm") pod "c24cd697-3895-4db5-a1fb-4e3e96262a08" (UID: "c24cd697-3895-4db5-a1fb-4e3e96262a08"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:47:40.115867 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.115841    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c24cd697-3895-4db5-a1fb-4e3e96262a08-kube-api-access-wktj4" (OuterVolumeSpecName: "kube-api-access-wktj4") pod "c24cd697-3895-4db5-a1fb-4e3e96262a08" (UID: "c24cd697-3895-4db5-a1fb-4e3e96262a08"). InnerVolumeSpecName "kube-api-access-wktj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:47:40.215680 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.215649    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c24cd697-3895-4db5-a1fb-4e3e96262a08-dshm\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:47:40.215680 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.215678    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wktj4\" (UniqueName: \"kubernetes.io/projected/c24cd697-3895-4db5-a1fb-4e3e96262a08-kube-api-access-wktj4\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:47:40.215680 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.215689    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c24cd697-3895-4db5-a1fb-4e3e96262a08-tls-certs\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:47:40.382280 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.382245    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"]
Jul 16 09:47:40.386935 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.386911    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/sub-test-model-8577c1-kserve-5d6778448f-f6s94"]
Jul 16 09:47:40.719063 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:40.719030    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c24cd697-3895-4db5-a1fb-4e3e96262a08" path="/var/lib/kubelet/pods/c24cd697-3895-4db5-a1fb-4e3e96262a08/volumes"
Jul 16 09:47:51.551876 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:47:51.551844    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:48:12.720593 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:48:12.720468    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:48:14.814552 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:48:14.814522    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:48:14.915149 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:48:14.915122    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:48:16.960827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:48:16.960753    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:48:22.916806 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:48:22.916774    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:48:23.017751 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:48:23.017720    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:48:32.177847 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:48:32.177815    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:48:53.965748 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:48:53.965708    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:48:55.921022 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:48:55.920920    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:48:56.022204 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:48:56.022180    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:48:58.356703 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:48:58.356664    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:48:59.181607 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:48:59.181570    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:00.189470 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:00.189439    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7358-140321205175728"]
Jul 16 09:49:00.189872 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:00.189856    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c24cd697-3895-4db5-a1fb-4e3e96262a08" containerName="main"
Jul 16 09:49:00.189916 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:00.189875    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24cd697-3895-4db5-a1fb-4e3e96262a08" containerName="main"
Jul 16 09:49:00.189950 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:00.189944    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c24cd697-3895-4db5-a1fb-4e3e96262a08" containerName="main"
Jul 16 09:49:00.193211 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:00.193194    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205175728"
Jul 16 09:49:00.195813 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:00.195795    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nftdn\""
Jul 16 09:49:00.200198 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:00.200172    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7358-140321205175728"]
Jul 16 09:49:00.293901 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:00.293870    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r64vf\" (UniqueName: \"kubernetes.io/projected/f64a3cee-ffb8-43de-bca6-7086691ceab6-kube-api-access-r64vf\") pod \"test-curl-7358-140321205175728\" (UID: \"f64a3cee-ffb8-43de-bca6-7086691ceab6\") " pod="opendatahub/test-curl-7358-140321205175728"
Jul 16 09:49:00.394558 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:00.394529    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r64vf\" (UniqueName: \"kubernetes.io/projected/f64a3cee-ffb8-43de-bca6-7086691ceab6-kube-api-access-r64vf\") pod \"test-curl-7358-140321205175728\" (UID: \"f64a3cee-ffb8-43de-bca6-7086691ceab6\") " pod="opendatahub/test-curl-7358-140321205175728"
Jul 16 09:49:00.402834 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:00.402813    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r64vf\" (UniqueName: \"kubernetes.io/projected/f64a3cee-ffb8-43de-bca6-7086691ceab6-kube-api-access-r64vf\") pod \"test-curl-7358-140321205175728\" (UID: \"f64a3cee-ffb8-43de-bca6-7086691ceab6\") " pod="opendatahub/test-curl-7358-140321205175728"
Jul 16 09:49:00.503171 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:00.503110    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205175728"
Jul 16 09:49:00.641851 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:00.641809    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7358-140321205175728"]
Jul 16 09:49:00.644042 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:49:00.644016    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf64a3cee_ffb8_43de_bca6_7086691ceab6.slice/crio-b5e962212ac94ad9467ca76e9c745197442bcba7da6579753d710502cacfbd0d WatchSource:0}: Error finding container b5e962212ac94ad9467ca76e9c745197442bcba7da6579753d710502cacfbd0d: Status 404 returned error can't find the container with id b5e962212ac94ad9467ca76e9c745197442bcba7da6579753d710502cacfbd0d
Jul 16 09:49:00.645416 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:00.645397    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:49:01.531092 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:01.531056    2556 generic.go:356] "Generic (PLEG): container finished" podID="f64a3cee-ffb8-43de-bca6-7086691ceab6" containerID="f356eec361d262b7b18e2e7c781fefc5ed53d38da7e21825f431c7a8e3fced0f" exitCode=0
Jul 16 09:49:01.531500 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:01.531114    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7358-140321205175728" event={"ID":"f64a3cee-ffb8-43de-bca6-7086691ceab6","Type":"ContainerDied","Data":"f356eec361d262b7b18e2e7c781fefc5ed53d38da7e21825f431c7a8e3fced0f"}
Jul 16 09:49:01.531500 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:01.531152    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7358-140321205175728" event={"ID":"f64a3cee-ffb8-43de-bca6-7086691ceab6","Type":"ContainerStarted","Data":"b5e962212ac94ad9467ca76e9c745197442bcba7da6579753d710502cacfbd0d"}
Jul 16 09:49:02.675182 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:02.675156    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205175728"
Jul 16 09:49:02.693842 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:02.693812    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7358-140321205175728_f64a3cee-ffb8-43de-bca6-7086691ceab6/test-curl-7358-140321205175728/0.log"
Jul 16 09:49:02.714937 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:02.714897    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r64vf\" (UniqueName: \"kubernetes.io/projected/f64a3cee-ffb8-43de-bca6-7086691ceab6-kube-api-access-r64vf\") pod \"f64a3cee-ffb8-43de-bca6-7086691ceab6\" (UID: \"f64a3cee-ffb8-43de-bca6-7086691ceab6\") "
Jul 16 09:49:02.717569 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:02.717530    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f64a3cee-ffb8-43de-bca6-7086691ceab6-kube-api-access-r64vf" (OuterVolumeSpecName: "kube-api-access-r64vf") pod "f64a3cee-ffb8-43de-bca6-7086691ceab6" (UID: "f64a3cee-ffb8-43de-bca6-7086691ceab6"). InnerVolumeSpecName "kube-api-access-r64vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:49:02.722960 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:02.722927    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7358-140321205175728"]
Jul 16 09:49:02.723083 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:02.722973    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7358-140321205175728"]
Jul 16 09:49:02.816014 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:02.815929    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r64vf\" (UniqueName: \"kubernetes.io/projected/f64a3cee-ffb8-43de-bca6-7086691ceab6-kube-api-access-r64vf\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:02.844308 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:02.844271    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7358-140321205344048"]
Jul 16 09:49:02.844757 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:02.844739    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64a3cee-ffb8-43de-bca6-7086691ceab6" containerName="test-curl-7358-140321205175728"
Jul 16 09:49:02.844836 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:02.844760    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64a3cee-ffb8-43de-bca6-7086691ceab6" containerName="test-curl-7358-140321205175728"
Jul 16 09:49:02.844898 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:02.844881    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f64a3cee-ffb8-43de-bca6-7086691ceab6" containerName="test-curl-7358-140321205175728"
Jul 16 09:49:02.848067 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:02.848042    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205344048"
Jul 16 09:49:02.854204 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:02.854183    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7358-140321205344048"]
Jul 16 09:49:02.917078 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:02.917036    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9gjd\" (UniqueName: \"kubernetes.io/projected/84d14773-8bba-4153-bc64-55c2677527e9-kube-api-access-f9gjd\") pod \"test-curl-7358-140321205344048\" (UID: \"84d14773-8bba-4153-bc64-55c2677527e9\") " pod="opendatahub/test-curl-7358-140321205344048"
Jul 16 09:49:03.018135 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:03.018095    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9gjd\" (UniqueName: \"kubernetes.io/projected/84d14773-8bba-4153-bc64-55c2677527e9-kube-api-access-f9gjd\") pod \"test-curl-7358-140321205344048\" (UID: \"84d14773-8bba-4153-bc64-55c2677527e9\") " pod="opendatahub/test-curl-7358-140321205344048"
Jul 16 09:49:03.027917 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:03.027892    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9gjd\" (UniqueName: \"kubernetes.io/projected/84d14773-8bba-4153-bc64-55c2677527e9-kube-api-access-f9gjd\") pod \"test-curl-7358-140321205344048\" (UID: \"84d14773-8bba-4153-bc64-55c2677527e9\") " pod="opendatahub/test-curl-7358-140321205344048"
Jul 16 09:49:03.158775 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:03.158682    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205344048"
Jul 16 09:49:03.293806 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:03.293778    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7358-140321205344048"]
Jul 16 09:49:03.294735 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:49:03.294708    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84d14773_8bba_4153_bc64_55c2677527e9.slice/crio-6d51e01a0a1c98106c8d539eec0dbe0ede33f2d5dbd199e8484826ae20dbb4f9 WatchSource:0}: Error finding container 6d51e01a0a1c98106c8d539eec0dbe0ede33f2d5dbd199e8484826ae20dbb4f9: Status 404 returned error can't find the container with id 6d51e01a0a1c98106c8d539eec0dbe0ede33f2d5dbd199e8484826ae20dbb4f9
Jul 16 09:49:03.544631 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:03.544604    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205175728"
Jul 16 09:49:03.544812 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:03.544638    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5e962212ac94ad9467ca76e9c745197442bcba7da6579753d710502cacfbd0d"
Jul 16 09:49:03.545886 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:03.545857    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7358-140321205344048" event={"ID":"84d14773-8bba-4153-bc64-55c2677527e9","Type":"ContainerStarted","Data":"6d51e01a0a1c98106c8d539eec0dbe0ede33f2d5dbd199e8484826ae20dbb4f9"}
Jul 16 09:49:03.549522 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:49:03.549498    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7358-140321205175728\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="f64a3cee-ffb8-43de-bca6-7086691ceab6" pod="opendatahub/test-curl-7358-140321205175728"
Jul 16 09:49:04.553409 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:04.553340    2556 generic.go:356] "Generic (PLEG): container finished" podID="84d14773-8bba-4153-bc64-55c2677527e9" containerID="63a385a75e471b9e8b786d427f8c90511671693e5fc7718417218fd6af048c28" exitCode=0
Jul 16 09:49:04.553409 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:04.553388    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7358-140321205344048" event={"ID":"84d14773-8bba-4153-bc64-55c2677527e9","Type":"ContainerDied","Data":"63a385a75e471b9e8b786d427f8c90511671693e5fc7718417218fd6af048c28"}
Jul 16 09:49:04.555828 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:49:04.555806    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7358-140321205175728\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="f64a3cee-ffb8-43de-bca6-7086691ceab6" pod="opendatahub/test-curl-7358-140321205175728"
Jul 16 09:49:04.719695 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:04.719662    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f64a3cee-ffb8-43de-bca6-7086691ceab6" path="/var/lib/kubelet/pods/f64a3cee-ffb8-43de-bca6-7086691ceab6/volumes"
Jul 16 09:49:05.693279 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:05.693257    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205344048"
Jul 16 09:49:05.714177 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:05.714155    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7358-140321205344048_84d14773-8bba-4153-bc64-55c2677527e9/test-curl-7358-140321205344048/0.log"
Jul 16 09:49:05.738896 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:05.738865    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7358-140321205344048"]
Jul 16 09:49:05.741155 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:05.741129    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7358-140321205344048"]
Jul 16 09:49:05.741394 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:05.741374    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9gjd\" (UniqueName: \"kubernetes.io/projected/84d14773-8bba-4153-bc64-55c2677527e9-kube-api-access-f9gjd\") pod \"84d14773-8bba-4153-bc64-55c2677527e9\" (UID: \"84d14773-8bba-4153-bc64-55c2677527e9\") "
Jul 16 09:49:05.743406 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:05.743385    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84d14773-8bba-4153-bc64-55c2677527e9-kube-api-access-f9gjd" (OuterVolumeSpecName: "kube-api-access-f9gjd") pod "84d14773-8bba-4153-bc64-55c2677527e9" (UID: "84d14773-8bba-4153-bc64-55c2677527e9"). InnerVolumeSpecName "kube-api-access-f9gjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:49:05.842502 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:05.842446    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9gjd\" (UniqueName: \"kubernetes.io/projected/84d14773-8bba-4153-bc64-55c2677527e9-kube-api-access-f9gjd\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:05.903003 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:05.902981    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7358-140321205208384"]
Jul 16 09:49:05.903396 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:05.903383    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d14773-8bba-4153-bc64-55c2677527e9" containerName="test-curl-7358-140321205344048"
Jul 16 09:49:05.903443 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:05.903397    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d14773-8bba-4153-bc64-55c2677527e9" containerName="test-curl-7358-140321205344048"
Jul 16 09:49:05.903475 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:05.903469    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="84d14773-8bba-4153-bc64-55c2677527e9" containerName="test-curl-7358-140321205344048"
Jul 16 09:49:05.906557 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:05.906544    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:05.910889 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:05.910867    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7358-140321205208384"]
Jul 16 09:49:05.943483 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:05.943459    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czd6v\" (UniqueName: \"kubernetes.io/projected/205754fa-0d93-4496-87a1-29a4e92566b2-kube-api-access-czd6v\") pod \"test-curl-7358-140321205208384\" (UID: \"205754fa-0d93-4496-87a1-29a4e92566b2\") " pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:06.043894 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:06.043871    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czd6v\" (UniqueName: \"kubernetes.io/projected/205754fa-0d93-4496-87a1-29a4e92566b2-kube-api-access-czd6v\") pod \"test-curl-7358-140321205208384\" (UID: \"205754fa-0d93-4496-87a1-29a4e92566b2\") " pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:06.052487 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:06.052459    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czd6v\" (UniqueName: \"kubernetes.io/projected/205754fa-0d93-4496-87a1-29a4e92566b2-kube-api-access-czd6v\") pod \"test-curl-7358-140321205208384\" (UID: \"205754fa-0d93-4496-87a1-29a4e92566b2\") " pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:06.217177 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:06.217148    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:06.348201 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:06.348176    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7358-140321205208384"]
Jul 16 09:49:06.349692 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:49:06.349668    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod205754fa_0d93_4496_87a1_29a4e92566b2.slice/crio-47eb9581699f68ac3f259a05f5e5b77f3c750f6b5b6273427e50559c31890a1d WatchSource:0}: Error finding container 47eb9581699f68ac3f259a05f5e5b77f3c750f6b5b6273427e50559c31890a1d: Status 404 returned error can't find the container with id 47eb9581699f68ac3f259a05f5e5b77f3c750f6b5b6273427e50559c31890a1d
Jul 16 09:49:06.565811 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:06.565731    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7358-140321205208384" event={"ID":"205754fa-0d93-4496-87a1-29a4e92566b2","Type":"ContainerStarted","Data":"47eb9581699f68ac3f259a05f5e5b77f3c750f6b5b6273427e50559c31890a1d"}
Jul 16 09:49:06.566986 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:06.566967    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d51e01a0a1c98106c8d539eec0dbe0ede33f2d5dbd199e8484826ae20dbb4f9"
Jul 16 09:49:06.567103 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:06.566987    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205344048"
Jul 16 09:49:06.577438 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:49:06.577413    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7358-140321205344048\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="84d14773-8bba-4153-bc64-55c2677527e9" pod="opendatahub/test-curl-7358-140321205344048"
Jul 16 09:49:06.720245 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:06.720208    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84d14773-8bba-4153-bc64-55c2677527e9" path="/var/lib/kubelet/pods/84d14773-8bba-4153-bc64-55c2677527e9/volumes"
Jul 16 09:49:07.574576 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:07.574543    2556 generic.go:356] "Generic (PLEG): container finished" podID="205754fa-0d93-4496-87a1-29a4e92566b2" containerID="51fd4e1670255694299fb64c3470886c8b5de22bb08c9436f825f6cc78dc9cc5" exitCode=0
Jul 16 09:49:07.574758 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:07.574589    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7358-140321205208384" event={"ID":"205754fa-0d93-4496-87a1-29a4e92566b2","Type":"ContainerDied","Data":"51fd4e1670255694299fb64c3470886c8b5de22bb08c9436f825f6cc78dc9cc5"}
Jul 16 09:49:08.720826 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:08.720803    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:08.744476 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:08.739616    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7358-140321205208384_205754fa-0d93-4496-87a1-29a4e92566b2/test-curl-7358-140321205208384/0.log"
Jul 16 09:49:08.761826 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:08.761795    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7358-140321205208384"]
Jul 16 09:49:08.765860 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:08.765830    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7358-140321205208384"]
Jul 16 09:49:08.768455 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:08.768437    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czd6v\" (UniqueName: \"kubernetes.io/projected/205754fa-0d93-4496-87a1-29a4e92566b2-kube-api-access-czd6v\") pod \"205754fa-0d93-4496-87a1-29a4e92566b2\" (UID: \"205754fa-0d93-4496-87a1-29a4e92566b2\") "
Jul 16 09:49:08.770400 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:08.770377    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/205754fa-0d93-4496-87a1-29a4e92566b2-kube-api-access-czd6v" (OuterVolumeSpecName: "kube-api-access-czd6v") pod "205754fa-0d93-4496-87a1-29a4e92566b2" (UID: "205754fa-0d93-4496-87a1-29a4e92566b2"). InnerVolumeSpecName "kube-api-access-czd6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:49:08.869824 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:08.869756    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czd6v\" (UniqueName: \"kubernetes.io/projected/205754fa-0d93-4496-87a1-29a4e92566b2-kube-api-access-czd6v\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:08.894733 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:08.894702    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7358-140321205208384"]
Jul 16 09:49:08.895178 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:08.895160    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="205754fa-0d93-4496-87a1-29a4e92566b2" containerName="test-curl-7358-140321205208384"
Jul 16 09:49:08.895224 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:08.895181    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="205754fa-0d93-4496-87a1-29a4e92566b2" containerName="test-curl-7358-140321205208384"
Jul 16 09:49:08.895266 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:08.895255    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="205754fa-0d93-4496-87a1-29a4e92566b2" containerName="test-curl-7358-140321205208384"
Jul 16 09:49:08.898404 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:08.898390    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:08.904427 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:08.904408    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7358-140321205208384"]
Jul 16 09:49:08.971032 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:08.971006    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsgqj\" (UniqueName: \"kubernetes.io/projected/15782b1a-6899-47e2-b3db-d609672650c8-kube-api-access-gsgqj\") pod \"test-curl-7358-140321205208384\" (UID: \"15782b1a-6899-47e2-b3db-d609672650c8\") " pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:09.072465 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:09.072434    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsgqj\" (UniqueName: \"kubernetes.io/projected/15782b1a-6899-47e2-b3db-d609672650c8-kube-api-access-gsgqj\") pod \"test-curl-7358-140321205208384\" (UID: \"15782b1a-6899-47e2-b3db-d609672650c8\") " pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:09.080781 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:09.080752    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsgqj\" (UniqueName: \"kubernetes.io/projected/15782b1a-6899-47e2-b3db-d609672650c8-kube-api-access-gsgqj\") pod \"test-curl-7358-140321205208384\" (UID: \"15782b1a-6899-47e2-b3db-d609672650c8\") " pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:09.208296 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:09.208263    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:09.343168 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:09.343144    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7358-140321205208384"]
Jul 16 09:49:09.344791 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:49:09.344763    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15782b1a_6899_47e2_b3db_d609672650c8.slice/crio-251db4608e6866bf8108cf0b7e05f870d4687627a9f8327035246d92e6d89cea WatchSource:0}: Error finding container 251db4608e6866bf8108cf0b7e05f870d4687627a9f8327035246d92e6d89cea: Status 404 returned error can't find the container with id 251db4608e6866bf8108cf0b7e05f870d4687627a9f8327035246d92e6d89cea
Jul 16 09:49:09.550454 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:09.550384    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:49:09.588016 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:09.587982    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7358-140321205208384" event={"ID":"15782b1a-6899-47e2-b3db-d609672650c8","Type":"ContainerStarted","Data":"251db4608e6866bf8108cf0b7e05f870d4687627a9f8327035246d92e6d89cea"}
Jul 16 09:49:09.589185 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:09.589166    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:09.589299 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:09.589170    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47eb9581699f68ac3f259a05f5e5b77f3c750f6b5b6273427e50559c31890a1d"
Jul 16 09:49:09.600391 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:09.600362    2556 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7358-140321205208384" oldPodUID="205754fa-0d93-4496-87a1-29a4e92566b2" podUID="15782b1a-6899-47e2-b3db-d609672650c8"
Jul 16 09:49:10.596165 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:10.596130    2556 generic.go:356] "Generic (PLEG): container finished" podID="15782b1a-6899-47e2-b3db-d609672650c8" containerID="fdacd1bca329b6cfdab7d7b06bfa05f6ddbc360ad9043dbe2f6543d34bceb910" exitCode=0
Jul 16 09:49:10.596548 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:10.596189    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7358-140321205208384" event={"ID":"15782b1a-6899-47e2-b3db-d609672650c8","Type":"ContainerDied","Data":"fdacd1bca329b6cfdab7d7b06bfa05f6ddbc360ad9043dbe2f6543d34bceb910"}
Jul 16 09:49:10.719412 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:10.719383    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="205754fa-0d93-4496-87a1-29a4e92566b2" path="/var/lib/kubelet/pods/205754fa-0d93-4496-87a1-29a4e92566b2/volumes"
Jul 16 09:49:11.736666 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:11.736641    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:11.758444 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:11.758403    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7358-140321205208384_15782b1a-6899-47e2-b3db-d609672650c8/test-curl-7358-140321205208384/0.log"
Jul 16 09:49:11.784652 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:11.784628    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7358-140321205208384"]
Jul 16 09:49:11.788763 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:11.788741    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7358-140321205208384"]
Jul 16 09:49:11.797933 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:11.797914    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsgqj\" (UniqueName: \"kubernetes.io/projected/15782b1a-6899-47e2-b3db-d609672650c8-kube-api-access-gsgqj\") pod \"15782b1a-6899-47e2-b3db-d609672650c8\" (UID: \"15782b1a-6899-47e2-b3db-d609672650c8\") "
Jul 16 09:49:11.799867 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:11.799847    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15782b1a-6899-47e2-b3db-d609672650c8-kube-api-access-gsgqj" (OuterVolumeSpecName: "kube-api-access-gsgqj") pod "15782b1a-6899-47e2-b3db-d609672650c8" (UID: "15782b1a-6899-47e2-b3db-d609672650c8"). InnerVolumeSpecName "kube-api-access-gsgqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:49:11.899468 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:11.899413    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsgqj\" (UniqueName: \"kubernetes.io/projected/15782b1a-6899-47e2-b3db-d609672650c8-kube-api-access-gsgqj\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:11.915304 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:11.915279    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7358-140321205209392"]
Jul 16 09:49:11.915682 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:11.915669    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15782b1a-6899-47e2-b3db-d609672650c8" containerName="test-curl-7358-140321205208384"
Jul 16 09:49:11.915734 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:11.915683    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="15782b1a-6899-47e2-b3db-d609672650c8" containerName="test-curl-7358-140321205208384"
Jul 16 09:49:11.915774 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:11.915769    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="15782b1a-6899-47e2-b3db-d609672650c8" containerName="test-curl-7358-140321205208384"
Jul 16 09:49:11.918659 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:11.918646    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:11.923100 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:11.923078    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7358-140321205209392"]
Jul 16 09:49:11.999994 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:11.999962    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl7kt\" (UniqueName: \"kubernetes.io/projected/1796acf4-3734-4642-8c88-1daf5e282733-kube-api-access-jl7kt\") pod \"test-curl-7358-140321205209392\" (UID: \"1796acf4-3734-4642-8c88-1daf5e282733\") " pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:12.100925 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:12.100886    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7kt\" (UniqueName: \"kubernetes.io/projected/1796acf4-3734-4642-8c88-1daf5e282733-kube-api-access-jl7kt\") pod \"test-curl-7358-140321205209392\" (UID: \"1796acf4-3734-4642-8c88-1daf5e282733\") " pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:12.109989 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:12.109963    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl7kt\" (UniqueName: \"kubernetes.io/projected/1796acf4-3734-4642-8c88-1daf5e282733-kube-api-access-jl7kt\") pod \"test-curl-7358-140321205209392\" (UID: \"1796acf4-3734-4642-8c88-1daf5e282733\") " pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:12.229480 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:12.229446    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:12.358993 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:12.358965    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7358-140321205209392"]
Jul 16 09:49:12.360285 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:49:12.360258    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1796acf4_3734_4642_8c88_1daf5e282733.slice/crio-2b659ea46a3ca59ffc8ccded03e606201649288fde95e46f69fa8e5be5568e53 WatchSource:0}: Error finding container 2b659ea46a3ca59ffc8ccded03e606201649288fde95e46f69fa8e5be5568e53: Status 404 returned error can't find the container with id 2b659ea46a3ca59ffc8ccded03e606201649288fde95e46f69fa8e5be5568e53
Jul 16 09:49:12.615472 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:12.615389    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7358-140321205209392" event={"ID":"1796acf4-3734-4642-8c88-1daf5e282733","Type":"ContainerStarted","Data":"2b659ea46a3ca59ffc8ccded03e606201649288fde95e46f69fa8e5be5568e53"}
Jul 16 09:49:12.616813 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:12.616783    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="251db4608e6866bf8108cf0b7e05f870d4687627a9f8327035246d92e6d89cea"
Jul 16 09:49:12.616813 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:12.616810    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:12.626832 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:49:12.626807    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7358-140321205208384\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="15782b1a-6899-47e2-b3db-d609672650c8" pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:12.717891 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:49:12.717856    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7358-140321205208384\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="15782b1a-6899-47e2-b3db-d609672650c8" pod="opendatahub/test-curl-7358-140321205208384"
Jul 16 09:49:12.719765 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:12.719737    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15782b1a-6899-47e2-b3db-d609672650c8" path="/var/lib/kubelet/pods/15782b1a-6899-47e2-b3db-d609672650c8/volumes"
Jul 16 09:49:13.624538 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:13.624494    2556 generic.go:356] "Generic (PLEG): container finished" podID="1796acf4-3734-4642-8c88-1daf5e282733" containerID="c3e62b90f779b7c2a34114cb3dfcc62f38aa2a228b6cb68708e83e396e153ec4" exitCode=0
Jul 16 09:49:13.624981 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:13.624573    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7358-140321205209392" event={"ID":"1796acf4-3734-4642-8c88-1daf5e282733","Type":"ContainerDied","Data":"c3e62b90f779b7c2a34114cb3dfcc62f38aa2a228b6cb68708e83e396e153ec4"}
Jul 16 09:49:13.739449 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:13.739416    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:13.843770 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:13.843739    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:14.768510 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:14.768479    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:14.788191 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:14.788168    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7358-140321205209392_1796acf4-3734-4642-8c88-1daf5e282733/test-curl-7358-140321205209392/0.log"
Jul 16 09:49:14.811715 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:14.811693    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7358-140321205209392"]
Jul 16 09:49:14.815399 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:14.815377    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7358-140321205209392"]
Jul 16 09:49:14.825758 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:14.825737    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl7kt\" (UniqueName: \"kubernetes.io/projected/1796acf4-3734-4642-8c88-1daf5e282733-kube-api-access-jl7kt\") pod \"1796acf4-3734-4642-8c88-1daf5e282733\" (UID: \"1796acf4-3734-4642-8c88-1daf5e282733\") "
Jul 16 09:49:14.827722 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:14.827701    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1796acf4-3734-4642-8c88-1daf5e282733-kube-api-access-jl7kt" (OuterVolumeSpecName: "kube-api-access-jl7kt") pod "1796acf4-3734-4642-8c88-1daf5e282733" (UID: "1796acf4-3734-4642-8c88-1daf5e282733"). InnerVolumeSpecName "kube-api-access-jl7kt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:49:14.927104 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:14.927082    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl7kt\" (UniqueName: \"kubernetes.io/projected/1796acf4-3734-4642-8c88-1daf5e282733-kube-api-access-jl7kt\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:15.637118 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:15.637084    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:15.637269 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:15.637136    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b659ea46a3ca59ffc8ccded03e606201649288fde95e46f69fa8e5be5568e53"
Jul 16 09:49:15.646724 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:49:15.646695    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7358-140321205209392\" is forbidden: User \"system:node:ip-10-0-130-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-231.ec2.internal' and this object" podUID="1796acf4-3734-4642-8c88-1daf5e282733" pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:16.718559 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:16.718518    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1796acf4-3734-4642-8c88-1daf5e282733" path="/var/lib/kubelet/pods/1796acf4-3734-4642-8c88-1daf5e282733/volumes"
Jul 16 09:49:18.984526 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:18.984489    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:24.710210 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:24.710171    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0b4ce8-29736585-q2ppw"]
Jul 16 09:49:24.714934 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:24.714904    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:24.718913 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:24.718884    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0b4ce8-29736585-q2ppw"]
Jul 16 09:49:24.926642 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:24.926613    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:26.718114 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:26.718081    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0aefa99-7e24-45bf-af45-f777d03f8693" path="/var/lib/kubelet/pods/f0aefa99-7e24-45bf-af45-f777d03f8693/volumes"
Jul 16 09:49:28.655891 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:28.655858    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:49:30.711757 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:30.711721    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:30.815373 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:30.815324    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:30.961984 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:30.961902    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"]
Jul 16 09:49:30.962389 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:30.962309    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw" podUID="28698bc7-c904-47da-9b88-86f236f64ff7" containerName="istio-proxy" containerID="cri-o://3e1b8dfd72f5aebc626364746c1fbd9e484694ad12fbb718034fc1947f9694c1" gracePeriod=30
Jul 16 09:49:30.977541 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:30.977495    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:31.194586 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:31.194547    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:31.697183 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:31.697153    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:36.231978 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.231922    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:49:36.417616 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.417585    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-workload-socket\") pod \"28698bc7-c904-47da-9b88-86f236f64ff7\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") "
Jul 16 09:49:36.417616 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.417619    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28698bc7-c904-47da-9b88-86f236f64ff7-istio-token\") pod \"28698bc7-c904-47da-9b88-86f236f64ff7\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") "
Jul 16 09:49:36.417852 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.417634    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28698bc7-c904-47da-9b88-86f236f64ff7-istiod-ca-cert\") pod \"28698bc7-c904-47da-9b88-86f236f64ff7\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") "
Jul 16 09:49:36.417852 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.417668    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66p22\" (UniqueName: \"kubernetes.io/projected/28698bc7-c904-47da-9b88-86f236f64ff7-kube-api-access-66p22\") pod \"28698bc7-c904-47da-9b88-86f236f64ff7\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") "
Jul 16 09:49:36.417852 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.417696    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-credential-socket\") pod \"28698bc7-c904-47da-9b88-86f236f64ff7\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") "
Jul 16 09:49:36.417852 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.417710    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-istio-data\") pod \"28698bc7-c904-47da-9b88-86f236f64ff7\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") "
Jul 16 09:49:36.417852 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.417733    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-workload-certs\") pod \"28698bc7-c904-47da-9b88-86f236f64ff7\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") "
Jul 16 09:49:36.417852 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.417758    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28698bc7-c904-47da-9b88-86f236f64ff7-istio-podinfo\") pod \"28698bc7-c904-47da-9b88-86f236f64ff7\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") "
Jul 16 09:49:36.417852 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.417780    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-istio-envoy\") pod \"28698bc7-c904-47da-9b88-86f236f64ff7\" (UID: \"28698bc7-c904-47da-9b88-86f236f64ff7\") "
Jul 16 09:49:36.418215 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.417873    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "28698bc7-c904-47da-9b88-86f236f64ff7" (UID: "28698bc7-c904-47da-9b88-86f236f64ff7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:36.418215 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.418078    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "28698bc7-c904-47da-9b88-86f236f64ff7" (UID: "28698bc7-c904-47da-9b88-86f236f64ff7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:36.418215 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.418166    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28698bc7-c904-47da-9b88-86f236f64ff7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "28698bc7-c904-47da-9b88-86f236f64ff7" (UID: "28698bc7-c904-47da-9b88-86f236f64ff7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:49:36.418215 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.418171    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-workload-socket\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:36.418215 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.418162    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "28698bc7-c904-47da-9b88-86f236f64ff7" (UID: "28698bc7-c904-47da-9b88-86f236f64ff7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:36.418849 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.418826    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-istio-data" (OuterVolumeSpecName: "istio-data") pod "28698bc7-c904-47da-9b88-86f236f64ff7" (UID: "28698bc7-c904-47da-9b88-86f236f64ff7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:36.420071 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.420045    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "28698bc7-c904-47da-9b88-86f236f64ff7" (UID: "28698bc7-c904-47da-9b88-86f236f64ff7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:36.420071 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.420061    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/28698bc7-c904-47da-9b88-86f236f64ff7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "28698bc7-c904-47da-9b88-86f236f64ff7" (UID: "28698bc7-c904-47da-9b88-86f236f64ff7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 09:49:36.420278 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.420255    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28698bc7-c904-47da-9b88-86f236f64ff7-istio-token" (OuterVolumeSpecName: "istio-token") pod "28698bc7-c904-47da-9b88-86f236f64ff7" (UID: "28698bc7-c904-47da-9b88-86f236f64ff7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:49:36.420323 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.420314    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28698bc7-c904-47da-9b88-86f236f64ff7-kube-api-access-66p22" (OuterVolumeSpecName: "kube-api-access-66p22") pod "28698bc7-c904-47da-9b88-86f236f64ff7" (UID: "28698bc7-c904-47da-9b88-86f236f64ff7"). InnerVolumeSpecName "kube-api-access-66p22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:49:36.519335 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.519266    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28698bc7-c904-47da-9b88-86f236f64ff7-istio-token\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:36.519335 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.519291    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28698bc7-c904-47da-9b88-86f236f64ff7-istiod-ca-cert\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:36.519335 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.519301    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66p22\" (UniqueName: \"kubernetes.io/projected/28698bc7-c904-47da-9b88-86f236f64ff7-kube-api-access-66p22\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:36.519335 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.519309    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-credential-socket\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:36.519335 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.519317    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-istio-data\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:36.519335 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.519325    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-workload-certs\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:36.519335 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.519333    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28698bc7-c904-47da-9b88-86f236f64ff7-istio-podinfo\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:36.519669 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.519342    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28698bc7-c904-47da-9b88-86f236f64ff7-istio-envoy\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:36.765201 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.765171    2556 generic.go:356] "Generic (PLEG): container finished" podID="28698bc7-c904-47da-9b88-86f236f64ff7" containerID="3e1b8dfd72f5aebc626364746c1fbd9e484694ad12fbb718034fc1947f9694c1" exitCode=0
Jul 16 09:49:36.765329 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.765216    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw" event={"ID":"28698bc7-c904-47da-9b88-86f236f64ff7","Type":"ContainerDied","Data":"3e1b8dfd72f5aebc626364746c1fbd9e484694ad12fbb718034fc1947f9694c1"}
Jul 16 09:49:36.765329 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.765253    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw" event={"ID":"28698bc7-c904-47da-9b88-86f236f64ff7","Type":"ContainerDied","Data":"7d991a38aaf4c0d5547ad3acc65e3f842df49371c5326c59d33ff40196a35c89"}
Jul 16 09:49:36.765329 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.765281    2556 scope.go:117] "RemoveContainer" containerID="3e1b8dfd72f5aebc626364746c1fbd9e484694ad12fbb718034fc1947f9694c1"
Jul 16 09:49:36.765329 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.765219    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"
Jul 16 09:49:36.774808 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.774787    2556 scope.go:117] "RemoveContainer" containerID="ea8c62b80c5203852a793f3d758fdf525160f9915147b789237e2570bcb24b82"
Jul 16 09:49:36.783184 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.783168    2556 scope.go:117] "RemoveContainer" containerID="3e1b8dfd72f5aebc626364746c1fbd9e484694ad12fbb718034fc1947f9694c1"
Jul 16 09:49:36.783455 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:49:36.783432    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e1b8dfd72f5aebc626364746c1fbd9e484694ad12fbb718034fc1947f9694c1\": container with ID starting with 3e1b8dfd72f5aebc626364746c1fbd9e484694ad12fbb718034fc1947f9694c1 not found: ID does not exist" containerID="3e1b8dfd72f5aebc626364746c1fbd9e484694ad12fbb718034fc1947f9694c1"
Jul 16 09:49:36.783557 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.783472    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e1b8dfd72f5aebc626364746c1fbd9e484694ad12fbb718034fc1947f9694c1"} err="failed to get container status \"3e1b8dfd72f5aebc626364746c1fbd9e484694ad12fbb718034fc1947f9694c1\": rpc error: code = NotFound desc = could not find container \"3e1b8dfd72f5aebc626364746c1fbd9e484694ad12fbb718034fc1947f9694c1\": container with ID starting with 3e1b8dfd72f5aebc626364746c1fbd9e484694ad12fbb718034fc1947f9694c1 not found: ID does not exist"
Jul 16 09:49:36.783557 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.783489    2556 scope.go:117] "RemoveContainer" containerID="ea8c62b80c5203852a793f3d758fdf525160f9915147b789237e2570bcb24b82"
Jul 16 09:49:36.783744 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:49:36.783729    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea8c62b80c5203852a793f3d758fdf525160f9915147b789237e2570bcb24b82\": container with ID starting with ea8c62b80c5203852a793f3d758fdf525160f9915147b789237e2570bcb24b82 not found: ID does not exist" containerID="ea8c62b80c5203852a793f3d758fdf525160f9915147b789237e2570bcb24b82"
Jul 16 09:49:36.783789 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.783749    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea8c62b80c5203852a793f3d758fdf525160f9915147b789237e2570bcb24b82"} err="failed to get container status \"ea8c62b80c5203852a793f3d758fdf525160f9915147b789237e2570bcb24b82\": rpc error: code = NotFound desc = could not find container \"ea8c62b80c5203852a793f3d758fdf525160f9915147b789237e2570bcb24b82\": container with ID starting with ea8c62b80c5203852a793f3d758fdf525160f9915147b789237e2570bcb24b82 not found: ID does not exist"
Jul 16 09:49:36.784587 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.784567    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"]
Jul 16 09:49:36.789761 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:36.789741    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0b4ce8-openshift-default-5f87f48c4c-pp7cw"]
Jul 16 09:49:37.406430 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:37.406399    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:37.982622 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:37.982590    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:38.718400 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:38.718339    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28698bc7-c904-47da-9b88-86f236f64ff7" path="/var/lib/kubelet/pods/28698bc7-c904-47da-9b88-86f236f64ff7/volumes"
Jul 16 09:49:41.855930 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:41.855893    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qsxp7"]
Jul 16 09:49:43.578908 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:43.578879    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:43.677338 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:43.677305    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:43.854096 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:43.854014    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"]
Jul 16 09:49:43.854289 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:43.854244    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr" podUID="3d978c64-95cf-4bf6-ad4d-f706c7143fe7" containerName="istio-proxy" containerID="cri-o://5b4abb898b45898143fadc84f49c916cc00ea3167137810e82337b0b47d9fb72" gracePeriod=30
Jul 16 09:49:43.878735 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:43.878708    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:44.103059 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:44.103032    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:49:48.690468 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:48.690384    2556 patch_prober.go:28] interesting pod/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 09:49:48.690468 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:48.690458    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr" podUID="3d978c64-95cf-4bf6-ad4d-f706c7143fe7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 09:49:49.107285 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.107259    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:49:49.115581 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.115562    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-workload-socket\") pod \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") "
Jul 16 09:49:49.115676 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.115590    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-token\") pod \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") "
Jul 16 09:49:49.115676 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.115606    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-podinfo\") pod \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") "
Jul 16 09:49:49.115676 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.115649    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-envoy\") pod \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") "
Jul 16 09:49:49.115799 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.115777    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istiod-ca-cert\") pod \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") "
Jul 16 09:49:49.115852 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.115820    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d978c64-95cf-4bf6-ad4d-f706c7143fe7" (UID: "3d978c64-95cf-4bf6-ad4d-f706c7143fe7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:49.115852 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.115829    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-data\") pod \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") "
Jul 16 09:49:49.115960 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.115882    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-credential-socket\") pod \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") "
Jul 16 09:49:49.115960 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.115933    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-workload-certs\") pod \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") "
Jul 16 09:49:49.116068 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.116000    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjqdt\" (UniqueName: \"kubernetes.io/projected/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-kube-api-access-rjqdt\") pod \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\" (UID: \"3d978c64-95cf-4bf6-ad4d-f706c7143fe7\") "
Jul 16 09:49:49.116148 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.116122    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d978c64-95cf-4bf6-ad4d-f706c7143fe7" (UID: "3d978c64-95cf-4bf6-ad4d-f706c7143fe7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:49.116212 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.116142    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d978c64-95cf-4bf6-ad4d-f706c7143fe7" (UID: "3d978c64-95cf-4bf6-ad4d-f706c7143fe7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:49:49.116395 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.116328    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-workload-socket\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:49.116395 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.116380    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istiod-ca-cert\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:49.116532 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.116396    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-credential-socket\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:49.116532 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.116401    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d978c64-95cf-4bf6-ad4d-f706c7143fe7" (UID: "3d978c64-95cf-4bf6-ad4d-f706c7143fe7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:49.116702 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.116675    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d978c64-95cf-4bf6-ad4d-f706c7143fe7" (UID: "3d978c64-95cf-4bf6-ad4d-f706c7143fe7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:49.117825 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.117793    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d978c64-95cf-4bf6-ad4d-f706c7143fe7" (UID: "3d978c64-95cf-4bf6-ad4d-f706c7143fe7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 09:49:49.117920 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.117829    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d978c64-95cf-4bf6-ad4d-f706c7143fe7" (UID: "3d978c64-95cf-4bf6-ad4d-f706c7143fe7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:49:49.117920 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.117856    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d978c64-95cf-4bf6-ad4d-f706c7143fe7" (UID: "3d978c64-95cf-4bf6-ad4d-f706c7143fe7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:49.118017 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.118002    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-kube-api-access-rjqdt" (OuterVolumeSpecName: "kube-api-access-rjqdt") pod "3d978c64-95cf-4bf6-ad4d-f706c7143fe7" (UID: "3d978c64-95cf-4bf6-ad4d-f706c7143fe7"). InnerVolumeSpecName "kube-api-access-rjqdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:49:49.217593 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.217516    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-token\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:49.217593 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.217542    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-podinfo\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:49.217593 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.217552    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-envoy\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:49.217593 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.217564    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-istio-data\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:49.217593 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.217576    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-workload-certs\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:49.217593 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.217584    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjqdt\" (UniqueName: \"kubernetes.io/projected/3d978c64-95cf-4bf6-ad4d-f706c7143fe7-kube-api-access-rjqdt\") on node \"ip-10-0-130-231.ec2.internal\" DevicePath \"\""
Jul 16 09:49:49.848599 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.848566    2556 generic.go:356] "Generic (PLEG): container finished" podID="3d978c64-95cf-4bf6-ad4d-f706c7143fe7" containerID="5b4abb898b45898143fadc84f49c916cc00ea3167137810e82337b0b47d9fb72" exitCode=0
Jul 16 09:49:49.848987 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.848617    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"
Jul 16 09:49:49.848987 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.848618    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr" event={"ID":"3d978c64-95cf-4bf6-ad4d-f706c7143fe7","Type":"ContainerDied","Data":"5b4abb898b45898143fadc84f49c916cc00ea3167137810e82337b0b47d9fb72"}
Jul 16 09:49:49.848987 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.848734    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr" event={"ID":"3d978c64-95cf-4bf6-ad4d-f706c7143fe7","Type":"ContainerDied","Data":"2b3e779d2010fc13c0ead7547be68d06db02c2705db1fad44a05683323d3bb2a"}
Jul 16 09:49:49.848987 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.848764    2556 scope.go:117] "RemoveContainer" containerID="5b4abb898b45898143fadc84f49c916cc00ea3167137810e82337b0b47d9fb72"
Jul 16 09:49:49.859087 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.859072    2556 scope.go:117] "RemoveContainer" containerID="1ca91c3da0c297c2faef621b97d963fde9d3c8c4ecb136856fdc0c84be280fc0"
Jul 16 09:49:49.867463 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.867443    2556 scope.go:117] "RemoveContainer" containerID="5b4abb898b45898143fadc84f49c916cc00ea3167137810e82337b0b47d9fb72"
Jul 16 09:49:49.867678 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:49:49.867662    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b4abb898b45898143fadc84f49c916cc00ea3167137810e82337b0b47d9fb72\": container with ID starting with 5b4abb898b45898143fadc84f49c916cc00ea3167137810e82337b0b47d9fb72 not found: ID does not exist" containerID="5b4abb898b45898143fadc84f49c916cc00ea3167137810e82337b0b47d9fb72"
Jul 16 09:49:49.867738 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.867685    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b4abb898b45898143fadc84f49c916cc00ea3167137810e82337b0b47d9fb72"} err="failed to get container status \"5b4abb898b45898143fadc84f49c916cc00ea3167137810e82337b0b47d9fb72\": rpc error: code = NotFound desc = could not find container \"5b4abb898b45898143fadc84f49c916cc00ea3167137810e82337b0b47d9fb72\": container with ID starting with 5b4abb898b45898143fadc84f49c916cc00ea3167137810e82337b0b47d9fb72 not found: ID does not exist"
Jul 16 09:49:49.867738 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.867700    2556 scope.go:117] "RemoveContainer" containerID="1ca91c3da0c297c2faef621b97d963fde9d3c8c4ecb136856fdc0c84be280fc0"
Jul 16 09:49:49.867933 ip-10-0-130-231 kubenswrapper[2556]: E0716 09:49:49.867916    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ca91c3da0c297c2faef621b97d963fde9d3c8c4ecb136856fdc0c84be280fc0\": container with ID starting with 1ca91c3da0c297c2faef621b97d963fde9d3c8c4ecb136856fdc0c84be280fc0 not found: ID does not exist" containerID="1ca91c3da0c297c2faef621b97d963fde9d3c8c4ecb136856fdc0c84be280fc0"
Jul 16 09:49:49.867976 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.867939    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca91c3da0c297c2faef621b97d963fde9d3c8c4ecb136856fdc0c84be280fc0"} err="failed to get container status \"1ca91c3da0c297c2faef621b97d963fde9d3c8c4ecb136856fdc0c84be280fc0\": rpc error: code = NotFound desc = could not find container \"1ca91c3da0c297c2faef621b97d963fde9d3c8c4ecb136856fdc0c84be280fc0\": container with ID starting with 1ca91c3da0c297c2faef621b97d963fde9d3c8c4ecb136856fdc0c84be280fc0 not found: ID does not exist"
Jul 16 09:49:49.876474 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.876447    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"]
Jul 16 09:49:49.883124 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.883105    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-8577c1-openshift-default-847669755f-xh8cr"]
Jul 16 09:49:49.998960 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:49.998930    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-429pl_e39d1c52-32ee-4793-91b9-8ceaba429e5b/manager/0.log"
Jul 16 09:49:50.115531 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:50.115460    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wkcpp_492ca2c5-62be-4a5d-99cd-e2446d9a8e4a/manager/0.log"
Jul 16 09:49:50.470564 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:50.470537    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-98swb_8212d9f4-fa08-4b40-b085-83a5eec26f92/manager/0.log"
Jul 16 09:49:50.712061 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:50.712033    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d64bd87c6-mqf2j_f4189701-b40d-4f00-b8dd-4415a6d53e6e/copy-manifests/0.log"
Jul 16 09:49:50.718451 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:50.718425    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d978c64-95cf-4bf6-ad4d-f706c7143fe7" path="/var/lib/kubelet/pods/3d978c64-95cf-4bf6-ad4d-f706c7143fe7/volumes"
Jul 16 09:49:50.723703 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:50.723651    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d64bd87c6-mqf2j_f4189701-b40d-4f00-b8dd-4415a6d53e6e/manager/0.log"
Jul 16 09:49:51.332097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:51.332066    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736570-4tnh9_45aff672-4d97-4b76-b0a5-ef968b0e0e51/cleanup/0.log"
Jul 16 09:49:52.357824 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:52.357786    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597_7fc1b602-ed45-4019-82bd-ae191e6a51c2/extract/0.log"
Jul 16 09:49:52.367043 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:52.367022    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597_7fc1b602-ed45-4019-82bd-ae191e6a51c2/util/0.log"
Jul 16 09:49:52.373899 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:52.373875    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597_7fc1b602-ed45-4019-82bd-ae191e6a51c2/pull/0.log"
Jul 16 09:49:52.487096 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:52.487073    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf_d43e22e5-3903-4879-a8b8-25f7ccfd3f80/util/0.log"
Jul 16 09:49:52.493679 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:52.493655    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf_d43e22e5-3903-4879-a8b8-25f7ccfd3f80/pull/0.log"
Jul 16 09:49:52.499612 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:52.499592    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf_d43e22e5-3903-4879-a8b8-25f7ccfd3f80/extract/0.log"
Jul 16 09:49:52.611423 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:52.611325    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p_3b87cf89-a5e5-43e9-a542-bc85c3af0d3a/extract/0.log"
Jul 16 09:49:52.616823 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:52.616802    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p_3b87cf89-a5e5-43e9-a542-bc85c3af0d3a/util/0.log"
Jul 16 09:49:52.622696 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:52.622671    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p_3b87cf89-a5e5-43e9-a542-bc85c3af0d3a/pull/0.log"
Jul 16 09:49:52.735008 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:52.734984    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks_fb53d53e-8e13-4560-a62f-80c30f22950e/util/0.log"
Jul 16 09:49:52.742399 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:52.742374    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks_fb53d53e-8e13-4560-a62f-80c30f22950e/pull/0.log"
Jul 16 09:49:52.748888 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:52.748863    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks_fb53d53e-8e13-4560-a62f-80c30f22950e/extract/0.log"
Jul 16 09:49:52.890533 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:52.890464    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:49:52.901864 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:52.901845    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwv9_40819698-f872-4fc6-a82d-f81196572c63/ovn-acl-logging/0.log"
Jul 16 09:49:53.022947 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:53.022926    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5lv6j_ff91031d-8108-4bad-9e5d-03e71afca261/manager/0.log"
Jul 16 09:49:53.149589 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:53.149503    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-gthjp_a10edabc-b532-4b0c-b5d6-52d2239ec79b/manager/0.log"
Jul 16 09:49:53.258217 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:53.258192    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-n4z8f_e677dc77-0d3d-4398-bcb7-51b06d4c7ca0/kuadrant-console-plugin/0.log"
Jul 16 09:49:53.389310 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:53.389286    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bgsjn_b078d349-85dd-4b86-942b-f082811ed203/registry-server/0.log"
Jul 16 09:49:53.632835 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:53.632806    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qsxp7_1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5/limitador/0.log"
Jul 16 09:49:53.749434 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:53.749377    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9nqwb_cb1be6b2-a6f5-4440-992a-e98cd244e5e7/manager/0.log"
Jul 16 09:49:54.366097 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:54.366068    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86ccb4d5cb-4ht5d_1f18adc4-a5df-41b4-a39d-c38a0c3365af/kube-auth-proxy/0.log"
Jul 16 09:49:54.966866 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:54.966840    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67bcfd8b64-c689b_bfa44217-2dd9-4774-8030-59a4a3754b6c/router/0.log"
Jul 16 09:49:55.553805 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:55.553780    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-dc5vz_7d20d949-9893-4a42-85f7-517502714697/main/0.log"
Jul 16 09:49:55.676093 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:55.676072    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj6twh_71b5d215-27a9-42e8-9ef1-b674c2a83c98/main/0.log"
Jul 16 09:49:55.792869 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:49:55.792848    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-8955q_3056af29-6909-408e-be7d-9e7d28c4db17/main/0.log"
Jul 16 09:50:01.406219 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:01.406185    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:50:01.496416 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:01.496382    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:50:02.870795 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:02.870763    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log" limit=1024
Jul 16 09:50:04.501934 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:04.501898    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w6rvh_6526b2dd-27b6-4b19-860e-dcb145d1803b/global-pull-secret-syncer/0.log"
Jul 16 09:50:04.559657 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:04.559620    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hg7sb_83250eb6-4c2f-4fc2-8200-f8bb30fa93e6/konnectivity-agent/0.log"
Jul 16 09:50:04.654484 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:04.654453    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-231.ec2.internal_164f37f8c5097726cc0dfd83f2773660/haproxy/0.log"
Jul 16 09:50:08.694029 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:08.694001    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597_7fc1b602-ed45-4019-82bd-ae191e6a51c2/extract/0.log"
Jul 16 09:50:08.720930 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:08.720906    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597_7fc1b602-ed45-4019-82bd-ae191e6a51c2/util/0.log"
Jul 16 09:50:08.744765 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:08.744731    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p5597_7fc1b602-ed45-4019-82bd-ae191e6a51c2/pull/0.log"
Jul 16 09:50:08.779393 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:08.779370    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf_d43e22e5-3903-4879-a8b8-25f7ccfd3f80/extract/0.log"
Jul 16 09:50:08.801055 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:08.800998    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf_d43e22e5-3903-4879-a8b8-25f7ccfd3f80/util/0.log"
Jul 16 09:50:08.828764 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:08.828746    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bw9jf_d43e22e5-3903-4879-a8b8-25f7ccfd3f80/pull/0.log"
Jul 16 09:50:08.852573 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:08.852556    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p_3b87cf89-a5e5-43e9-a542-bc85c3af0d3a/extract/0.log"
Jul 16 09:50:08.885247 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:08.885229    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p_3b87cf89-a5e5-43e9-a542-bc85c3af0d3a/util/0.log"
Jul 16 09:50:08.913079 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:08.913062    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zwg4p_3b87cf89-a5e5-43e9-a542-bc85c3af0d3a/pull/0.log"
Jul 16 09:50:08.941006 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:08.940986    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks_fb53d53e-8e13-4560-a62f-80c30f22950e/extract/0.log"
Jul 16 09:50:08.970658 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:08.970639    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks_fb53d53e-8e13-4560-a62f-80c30f22950e/util/0.log"
Jul 16 09:50:08.997635 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:08.997605    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17tvks_fb53d53e-8e13-4560-a62f-80c30f22950e/pull/0.log"
Jul 16 09:50:09.423797 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:09.423771    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5lv6j_ff91031d-8108-4bad-9e5d-03e71afca261/manager/0.log"
Jul 16 09:50:09.461801 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:09.461784    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-gthjp_a10edabc-b532-4b0c-b5d6-52d2239ec79b/manager/0.log"
Jul 16 09:50:09.496012 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:09.495993    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-n4z8f_e677dc77-0d3d-4398-bcb7-51b06d4c7ca0/kuadrant-console-plugin/0.log"
Jul 16 09:50:09.544918 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:09.544901    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bgsjn_b078d349-85dd-4b86-942b-f082811ed203/registry-server/0.log"
Jul 16 09:50:09.729125 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:09.729053    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qsxp7_1e3c5bcd-5fc8-4042-a6a6-ac2ac990b1a5/limitador/0.log"
Jul 16 09:50:09.796596 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:09.796570    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9nqwb_cb1be6b2-a6f5-4440-992a-e98cd244e5e7/manager/0.log"
Jul 16 09:50:11.575477 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:11.575407    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9vsfg_e2757296-21d1-41e8-87df-8a91675ac30e/kube-state-metrics/0.log"
Jul 16 09:50:11.598456 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:11.598432    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9vsfg_e2757296-21d1-41e8-87df-8a91675ac30e/kube-rbac-proxy-main/0.log"
Jul 16 09:50:11.624975 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:11.624955    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9vsfg_e2757296-21d1-41e8-87df-8a91675ac30e/kube-rbac-proxy-self/0.log"
Jul 16 09:50:11.817146 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:11.817119    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p42cn_88d752ab-85cf-45db-a183-69b7fe7dba91/node-exporter/0.log"
Jul 16 09:50:11.843060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:11.842999    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p42cn_88d752ab-85cf-45db-a183-69b7fe7dba91/kube-rbac-proxy/0.log"
Jul 16 09:50:11.874054 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:11.874037    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p42cn_88d752ab-85cf-45db-a183-69b7fe7dba91/init-textfile/0.log"
Jul 16 09:50:12.027902 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:12.027878    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-2rkf4_9531550f-e7e9-45b1-9150-4cfcbd7c9c58/kube-rbac-proxy-main/0.log"
Jul 16 09:50:12.054749 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:12.054731    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-2rkf4_9531550f-e7e9-45b1-9150-4cfcbd7c9c58/kube-rbac-proxy-self/0.log"
Jul 16 09:50:12.081306 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:12.081278    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-2rkf4_9531550f-e7e9-45b1-9150-4cfcbd7c9c58/openshift-state-metrics/0.log"
Jul 16 09:50:12.322195 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:12.322168    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-q4s49_82e995ba-71e5-4466-873b-e94402391a32/prometheus-operator/0.log"
Jul 16 09:50:12.346571 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:12.346550    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-q4s49_82e995ba-71e5-4466-873b-e94402391a32/kube-rbac-proxy/0.log"
Jul 16 09:50:12.371843 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:12.371824    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-xxh4b_afbdc34c-42b2-4fa8-af4c-c93c59ae3d14/prometheus-operator-admission-webhook/0.log"
Jul 16 09:50:12.406584 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:12.406566    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dfb8c8f9c-tp6kn_fd51500e-ae0a-4796-b497-5da8825a2640/telemeter-client/0.log"
Jul 16 09:50:12.441044 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:12.441025    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dfb8c8f9c-tp6kn_fd51500e-ae0a-4796-b497-5da8825a2640/reload/0.log"
Jul 16 09:50:12.463946 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:12.463932    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dfb8c8f9c-tp6kn_fd51500e-ae0a-4796-b497-5da8825a2640/kube-rbac-proxy/0.log"
Jul 16 09:50:13.721906 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.721874    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"]
Jul 16 09:50:13.722248 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.722227    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1796acf4-3734-4642-8c88-1daf5e282733" containerName="test-curl-7358-140321205209392"
Jul 16 09:50:13.722248 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.722237    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1796acf4-3734-4642-8c88-1daf5e282733" containerName="test-curl-7358-140321205209392"
Jul 16 09:50:13.722332 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.722254    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d978c64-95cf-4bf6-ad4d-f706c7143fe7" containerName="istio-proxy"
Jul 16 09:50:13.722332 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.722259    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d978c64-95cf-4bf6-ad4d-f706c7143fe7" containerName="istio-proxy"
Jul 16 09:50:13.722332 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.722278    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28698bc7-c904-47da-9b88-86f236f64ff7" containerName="istio-proxy"
Jul 16 09:50:13.722332 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.722284    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="28698bc7-c904-47da-9b88-86f236f64ff7" containerName="istio-proxy"
Jul 16 09:50:13.722332 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.722292    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28698bc7-c904-47da-9b88-86f236f64ff7" containerName="istio-proxy"
Jul 16 09:50:13.722332 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.722297    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="28698bc7-c904-47da-9b88-86f236f64ff7" containerName="istio-proxy"
Jul 16 09:50:13.722544 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.722367    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="28698bc7-c904-47da-9b88-86f236f64ff7" containerName="istio-proxy"
Jul 16 09:50:13.722544 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.722377    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d978c64-95cf-4bf6-ad4d-f706c7143fe7" containerName="istio-proxy"
Jul 16 09:50:13.722544 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.722385    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d978c64-95cf-4bf6-ad4d-f706c7143fe7" containerName="istio-proxy"
Jul 16 09:50:13.722544 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.722391    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="28698bc7-c904-47da-9b88-86f236f64ff7" containerName="istio-proxy"
Jul 16 09:50:13.722544 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.722397    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1796acf4-3734-4642-8c88-1daf5e282733" containerName="test-curl-7358-140321205209392"
Jul 16 09:50:13.725452 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.725436    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.728411 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.728392    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xc7d7\"/\"kube-root-ca.crt\""
Jul 16 09:50:13.729083 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.729068    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xc7d7\"/\"default-dockercfg-54m6m\""
Jul 16 09:50:13.729127 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.729112    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xc7d7\"/\"openshift-service-ca.crt\""
Jul 16 09:50:13.736823 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.736801    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"]
Jul 16 09:50:13.817392 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.817329    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29af2498-7742-4a44-b2d3-ddfa163adf0f-proc\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.817392 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.817401    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29af2498-7742-4a44-b2d3-ddfa163adf0f-lib-modules\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.817603 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.817430    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29af2498-7742-4a44-b2d3-ddfa163adf0f-sys\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.817603 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.817451    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqcg5\" (UniqueName: \"kubernetes.io/projected/29af2498-7742-4a44-b2d3-ddfa163adf0f-kube-api-access-kqcg5\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.817603 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.817526    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29af2498-7742-4a44-b2d3-ddfa163adf0f-podres\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.918483 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.918434    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqcg5\" (UniqueName: \"kubernetes.io/projected/29af2498-7742-4a44-b2d3-ddfa163adf0f-kube-api-access-kqcg5\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.918691 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.918500    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29af2498-7742-4a44-b2d3-ddfa163adf0f-podres\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.918691 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.918566    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29af2498-7742-4a44-b2d3-ddfa163adf0f-proc\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.918691 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.918587    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29af2498-7742-4a44-b2d3-ddfa163adf0f-lib-modules\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.918691 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.918628    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29af2498-7742-4a44-b2d3-ddfa163adf0f-sys\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.918691 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.918654    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29af2498-7742-4a44-b2d3-ddfa163adf0f-proc\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.918902 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.918697    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29af2498-7742-4a44-b2d3-ddfa163adf0f-sys\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.918902 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.918702    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29af2498-7742-4a44-b2d3-ddfa163adf0f-podres\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.918902 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.918798    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29af2498-7742-4a44-b2d3-ddfa163adf0f-lib-modules\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:13.926925 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:13.926897    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqcg5\" (UniqueName: \"kubernetes.io/projected/29af2498-7742-4a44-b2d3-ddfa163adf0f-kube-api-access-kqcg5\") pod \"perf-node-gather-daemonset-7l982\" (UID: \"29af2498-7742-4a44-b2d3-ddfa163adf0f\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:14.036745 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:14.036659    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:14.174371 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:14.174321    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"]
Jul 16 09:50:14.175978 ip-10-0-130-231 kubenswrapper[2556]: W0716 09:50:14.175942    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod29af2498_7742_4a44_b2d3_ddfa163adf0f.slice/crio-8757016a4fbffbcc7a0c0e85d0ac3c9b1bb5baef90a24813dfedbce77dcd1b80 WatchSource:0}: Error finding container 8757016a4fbffbcc7a0c0e85d0ac3c9b1bb5baef90a24813dfedbce77dcd1b80: Status 404 returned error can't find the container with id 8757016a4fbffbcc7a0c0e85d0ac3c9b1bb5baef90a24813dfedbce77dcd1b80
Jul 16 09:50:14.861252 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:14.861222    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-dc7b8fc55-gmvtg_6939bcb3-4e29-4d2e-a87c-5f6c5bf5b9fc/console/0.log"
Jul 16 09:50:14.989733 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:14.989699    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982" event={"ID":"29af2498-7742-4a44-b2d3-ddfa163adf0f","Type":"ContainerStarted","Data":"63b1a0c5ea9d86cc8ea9c122a4e7a13b7cb40f2284b60ebe70d9941655ca5acc"}
Jul 16 09:50:14.989893 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:14.989752    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982" event={"ID":"29af2498-7742-4a44-b2d3-ddfa163adf0f","Type":"ContainerStarted","Data":"8757016a4fbffbcc7a0c0e85d0ac3c9b1bb5baef90a24813dfedbce77dcd1b80"}
Jul 16 09:50:14.989893 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:14.989821    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:15.007472 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:15.007431    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982" podStartSLOduration=2.007417568 podStartE2EDuration="2.007417568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:50:15.00493569 +0000 UTC m=+2722.828787269" watchObservedRunningTime="2026-07-16 09:50:15.007417568 +0000 UTC m=+2722.831269136"
Jul 16 09:50:16.482574 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:16.482532    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cngmn_bc732aed-8a79-4e68-bc65-f2eec109b398/dns/0.log"
Jul 16 09:50:16.508130 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:16.508106    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cngmn_bc732aed-8a79-4e68-bc65-f2eec109b398/kube-rbac-proxy/0.log"
Jul 16 09:50:16.689811 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:16.689775    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xm6zn_d4e101a1-6ad1-4a51-9cf2-cc73c46c849a/dns-node-resolver/0.log"
Jul 16 09:50:17.328336 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:17.328293    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xst8k_07047c0e-998f-4081-b64e-d285a6d5750a/node-ca/0.log"
Jul 16 09:50:18.438695 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:18.438670    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86ccb4d5cb-4ht5d_1f18adc4-a5df-41b4-a39d-c38a0c3365af/kube-auth-proxy/0.log"
Jul 16 09:50:18.642745 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:18.642715    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67bcfd8b64-c689b_bfa44217-2dd9-4774-8030-59a4a3754b6c/router/0.log"
Jul 16 09:50:19.361936 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:19.361895    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r4nxb_364f1f1a-63c3-4132-a787-1d516c2ee60a/serve-healthcheck-canary/0.log"
Jul 16 09:50:19.906827 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:19.906803    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g8rpt_3d0169f2-e8bd-4351-936c-f387521d6175/kube-rbac-proxy/0.log"
Jul 16 09:50:19.935121 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:19.935095    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g8rpt_3d0169f2-e8bd-4351-936c-f387521d6175/exporter/0.log"
Jul 16 09:50:19.978525 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:19.978502    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g8rpt_3d0169f2-e8bd-4351-936c-f387521d6175/extractor/0.log"
Jul 16 09:50:21.005267 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:21.005243    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-7l982"
Jul 16 09:50:22.353039 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:22.353015    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-429pl_e39d1c52-32ee-4793-91b9-8ceaba429e5b/manager/0.log"
Jul 16 09:50:22.492116 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:22.492087    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wkcpp_492ca2c5-62be-4a5d-99cd-e2446d9a8e4a/manager/0.log"
Jul 16 09:50:22.744600 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:22.744570    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-98swb_8212d9f4-fa08-4b40-b085-83a5eec26f92/manager/0.log"
Jul 16 09:50:22.887636 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:22.887608    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d64bd87c6-mqf2j_f4189701-b40d-4f00-b8dd-4415a6d53e6e/manager/0.log"
Jul 16 09:50:22.909586 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:22.909557    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d64bd87c6-mqf2j_f4189701-b40d-4f00-b8dd-4415a6d53e6e/copy-manifests/0.log"
Jul 16 09:50:23.608475 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:23.608449    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86ccb4d5cb-4ht5d_1f18adc4-a5df-41b4-a39d-c38a0c3365af/kube-auth-proxy/0.log"
Jul 16 09:50:23.934647 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:23.934623    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67bcfd8b64-c689b_bfa44217-2dd9-4774-8030-59a4a3754b6c/router/0.log"
Jul 16 09:50:24.395782 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:24.395759    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rjf2p_c261b85e-4f4c-45af-9310-dcd689a29a04/openshift-lws-operator/0.log"
Jul 16 09:50:25.472145 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:25.472121    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86ccb4d5cb-4ht5d_1f18adc4-a5df-41b4-a39d-c38a0c3365af/kube-auth-proxy/0.log"
Jul 16 09:50:25.653060 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:25.653034    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67bcfd8b64-c689b_bfa44217-2dd9-4774-8030-59a4a3754b6c/router/0.log"
Jul 16 09:50:29.998839 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:29.998809    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-7h5tp_a8c3e4dc-5cd5-4ee5-98df-312d867b3933/kube-storage-version-migrator-operator/1.log"
Jul 16 09:50:29.999636 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:29.999618    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-7h5tp_a8c3e4dc-5cd5-4ee5-98df-312d867b3933/kube-storage-version-migrator-operator/0.log"
Jul 16 09:50:30.998767 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:30.998730    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9hs7m_7ea846f2-1826-41e4-bf80-1c42f1c001c7/kube-multus/0.log"
Jul 16 09:50:31.217153 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:31.217122    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgr75_2f695655-2301-4d69-a98f-fc51b8aeea13/kube-multus-additional-cni-plugins/0.log"
Jul 16 09:50:31.244539 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:31.244514    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgr75_2f695655-2301-4d69-a98f-fc51b8aeea13/egress-router-binary-copy/0.log"
Jul 16 09:50:31.282731 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:31.282710    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgr75_2f695655-2301-4d69-a98f-fc51b8aeea13/cni-plugins/0.log"
Jul 16 09:50:31.315788 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:31.315766    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgr75_2f695655-2301-4d69-a98f-fc51b8aeea13/bond-cni-plugin/0.log"
Jul 16 09:50:31.348233 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:31.348215    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgr75_2f695655-2301-4d69-a98f-fc51b8aeea13/routeoverride-cni/0.log"
Jul 16 09:50:31.374674 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:31.374654    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgr75_2f695655-2301-4d69-a98f-fc51b8aeea13/whereabouts-cni-bincopy/0.log"
Jul 16 09:50:31.400435 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:31.400419    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgr75_2f695655-2301-4d69-a98f-fc51b8aeea13/whereabouts-cni/0.log"
Jul 16 09:50:31.807800 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:31.807771    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sbf5q_a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690/network-metrics-daemon/0.log"
Jul 16 09:50:31.834198 ip-10-0-130-231 kubenswrapper[2556]: I0716 09:50:31.834180    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sbf5q_a30f0ab4-d635-4c98-b9f2-a4d2a2cf6690/kube-rbac-proxy/0.log"