Aug 05 16:37:03.373869 ip-10-0-130-35 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 05 16:37:03.373881 ip-10-0-130-35 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 05 16:37:03.373890 ip-10-0-130-35 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 05 16:37:03.374181 ip-10-0-130-35 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 05 16:37:13.623485 ip-10-0-130-35 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 05 16:37:13.623500 ip-10-0-130-35 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5eade7fcdb2c4d51a1c6457b530022b6 --
Aug 05 16:39:05.449134 ip-10-0-130-35 systemd[1]: Starting Kubernetes Kubelet...
Aug 05 16:39:05.795391 ip-10-0-130-35 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:39:05.795391 ip-10-0-130-35 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 05 16:39:05.795391 ip-10-0-130-35 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:39:05.795391 ip-10-0-130-35 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 05 16:39:05.795996 ip-10-0-130-35 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:39:05.796377 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.796290    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 05 16:39:05.805034 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805009    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:39:05.805034 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805028    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:39:05.805034 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805035    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:39:05.805034 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805039    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805043    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805049    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805054    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805058    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805063    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805067    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805071    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805075    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805080    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805084    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805089    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805093    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805097    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805101    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805105    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805110    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805114    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805118    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:39:05.805280 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805122    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805127    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805131    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805135    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805139    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805144    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805148    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805153    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805157    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805161    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805175    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805180    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805185    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805189    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805193    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805198    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805203    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805207    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805212    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805216    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:39:05.806097 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805221    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805226    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805230    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805235    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805240    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805246    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805254    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805261    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805266    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805271    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805276    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805280    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805285    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805290    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805296    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805303    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805310    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805315    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805320    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:39:05.806976 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805325    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805329    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805333    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805339    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805344    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805348    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805352    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805357    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805363    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805368    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805373    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805378    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805382    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805386    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805390    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805394    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805399    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805404    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805409    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805413    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:39:05.807787 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805417    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805422    2575 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805427    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805432    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805436    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805440    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805444    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805449    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805453    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805458    2575 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805462    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805502    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805509    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805515    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805520    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805524    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805529    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.805533    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806714    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806724    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:39:05.808664 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806730    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806734    2575 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806740    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806744    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806749    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806755    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806759    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806764    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806768    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806773    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806777    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806781    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806786    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806790    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806795    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806822    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806829    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806834    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806839    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:39:05.809535 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806844    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806848    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806852    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806856    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806861    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806865    2575 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806872    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806878    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806883    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806888    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806892    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806897    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806903    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806909    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806914    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806919    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806926    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806930    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806935    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:39:05.810292 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806941    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806945    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806950    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806955    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806960    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806965    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806969    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806974    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806978    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806984    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806989    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806994    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.806998    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807002    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807006    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807010    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807015    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807019    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807024    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807029    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:39:05.810874 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807033    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807037    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807042    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807046    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807051    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807056    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807061    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807065    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807070    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807074    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807078    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807082    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807086    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807090    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807095    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807099    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807103    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807110    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807116    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807121    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:39:05.811565 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807125    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807129    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807133    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807139    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807144    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807149    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807153    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807157    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807161    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807166    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807170    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807174    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807179    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807183    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807187    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807192    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807197    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807202    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807206    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807800    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:39:05.812117 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807829    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807834    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807839    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807846    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807852    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807858    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807863    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807869    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807873    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807878    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807883    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807887    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807891    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807895    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807900    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807905    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807910    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807915    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807919    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:39:05.812726 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807926    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807932    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807937    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807942    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807947    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807951    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807956    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807960    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807965    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807975    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807979    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807983    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807988    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807993    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.807997    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808001    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808006    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808010    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808015    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808020    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:39:05.813237 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808025    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808029    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808034    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808038    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808043    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808047    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808052    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808056    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808060    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808065    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808073    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808077    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808082    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808086    2575 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808091    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808095    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808099    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808104    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808108    2575 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808113    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:39:05.814048 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808117    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808123    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808127    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808131    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808136    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808140    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808144    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808148    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808153    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808157    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808163    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808169    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808173    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808178    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808182    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808187    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808191    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808196    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808201    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:39:05.814906 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808205    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808210    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808214    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808219    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808224    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808228    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808232    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808237    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808241    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808246    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808250    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808254    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808258    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808262    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808268    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808273    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808277    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808281    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808286    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.808290    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:39:05.815689 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808390    2575 flags.go:64] FLAG: --address="0.0.0.0"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808402    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808413    2575 flags.go:64] FLAG: --anonymous-auth="true"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808420    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808427    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808433    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808440    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808447    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808452    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808457    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808463    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808468    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808474    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808479    2575 flags.go:64] FLAG: --cgroup-root=""
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808484    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808489    2575 flags.go:64] FLAG: --client-ca-file=""
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808495    2575 flags.go:64] FLAG: --cloud-provider="external"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808500    2575 flags.go:64] FLAG: --cluster-dns="[]"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808507    2575 flags.go:64] FLAG: --cluster-domain=""
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808512    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808517    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808523    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808528    2575 flags.go:64] FLAG: --container-log-max-files="5"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808535    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 05 16:39:05.816385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808540    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808545    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808553    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808558    2575 flags.go:64] FLAG: --contention-profiling="false"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808563    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808568    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808574    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808579    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808585    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808591    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808596    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808601    2575 flags.go:64] FLAG: --enable-load-reader="false"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808606    2575 flags.go:64] FLAG: --enable-server="true"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808611    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808620    2575 flags.go:64] FLAG: --event-burst="100"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808625    2575 flags.go:64] FLAG: --event-qps="50"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808630    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808636    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808641    2575 flags.go:64] FLAG: --eviction-hard=""
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808648    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808654    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808659    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808664    2575 flags.go:64] FLAG: --eviction-soft=""
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808669    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808674    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 05 16:39:05.816982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808679    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808684    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808689    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808694    2575 flags.go:64] FLAG: --fail-swap-on="true"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808699    2575 flags.go:64] FLAG: --feature-gates=""
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808706    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808711    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808716    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808722    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808728    2575 flags.go:64] FLAG: --healthz-port="10248"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808734    2575 flags.go:64] FLAG: --help="false"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808739    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-130-35.ec2.internal"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808745    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808750    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808755    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808760    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808767    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808771    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808776    2575 flags.go:64] FLAG: --image-service-endpoint=""
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808781    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808788    2575 flags.go:64] FLAG: --kube-api-burst="100"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808794    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808799    2575 flags.go:64] FLAG: --kube-api-qps="50"
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808820    2575 flags.go:64] FLAG: --kube-reserved=""
Aug 05 16:39:05.817601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808826    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808831    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808836    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808841    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808846    2575 flags.go:64] FLAG: --lock-file=""
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808851    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808856    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808861    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808871    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808877    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808882    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808887    2575 flags.go:64] FLAG: --logging-format="text"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808892    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808897    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808903    2575 flags.go:64] FLAG: --manifest-url=""
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808907    2575 flags.go:64] FLAG: --manifest-url-header=""
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808915    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808922    2575 flags.go:64] FLAG: --max-open-files="1000000"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808939    2575 flags.go:64] FLAG: --max-pods="110"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808944    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808949    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808954    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808959    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808964    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808969    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 05 16:39:05.818223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808974    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808986    2575 flags.go:64] FLAG: --node-status-max-images="50"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808991    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.808998    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809003    2575 flags.go:64] FLAG: --pod-cidr=""
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809008    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809019    2575 flags.go:64] FLAG: --pod-manifest-path=""
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809024    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809029    2575 flags.go:64] FLAG: --pods-per-core="0"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809034    2575 flags.go:64] FLAG: --port="10250"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809039    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809044    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ed13dc257de090f5"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809050    2575 flags.go:64] FLAG: --qos-reserved=""
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809055    2575 flags.go:64] FLAG: --read-only-port="10255"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809060    2575 flags.go:64] FLAG: --register-node="true"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809065    2575 flags.go:64] FLAG: --register-with-taints=""
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809071    2575 flags.go:64] FLAG: --registry-burst="10"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809077    2575 flags.go:64] FLAG: --registry-qps="5"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809082    2575 flags.go:64] FLAG: --reserved-cpus=""
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809087    2575 flags.go:64] FLAG: --reserved-memory=""
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809094    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809100    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809105    2575 flags.go:64] FLAG: --rotate-certificates="false"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809110    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809115    2575 flags.go:64] FLAG: --runonce="false"
Aug 05 16:39:05.818872 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809121    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809127    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809132    2575 flags.go:64] FLAG: --seccomp-default="false"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809138    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809143    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809148    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809154    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809159    2575 flags.go:64] FLAG: --storage-driver-password="root"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809164    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809169    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809176    2575 flags.go:64] FLAG: --storage-driver-user="root"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809181    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809186    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809192    2575 flags.go:64] FLAG: --system-cgroups=""
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809197    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809206    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809211    2575 flags.go:64] FLAG: --tls-cert-file=""
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809216    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809223    2575 flags.go:64] FLAG: --tls-min-version=""
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809228    2575 flags.go:64] FLAG: --tls-private-key-file=""
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809233    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809237    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809242    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809247    2575 flags.go:64] FLAG: --v="2"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809254    2575 flags.go:64] FLAG: --version="false"
Aug 05 16:39:05.819536 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809262    2575 flags.go:64] FLAG: --vmodule=""
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809269    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809274    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809459    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809466    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809471    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809476    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809482    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809487    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809491    2575 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809504    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809509    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809514    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809518    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809523    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809528    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809532    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809538    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809543    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809547    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:39:05.820187 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809551    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809556    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809560    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809565    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809569    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809574    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809579    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809583    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809589    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809593    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809597    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809602    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809606    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809612    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809616    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809621    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809626    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809630    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809635    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809642    2575 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:39:05.820684 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809646    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809650    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809654    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809659    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809664    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809668    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809673    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809678    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809682    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809688    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809693    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809697    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809702    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809708    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809714    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809719    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809724    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809728    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809733    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809738    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:39:05.821191 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809742    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809747    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809751    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809758    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809764    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809769    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809775    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809781    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809786    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809791    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809795    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809801    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809821    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809828    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809834    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809839    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809844    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809849    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809853    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:39:05.821686 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809858    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809862    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809868    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809873    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809878    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809883    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809887    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809891    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809896    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809900    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809905    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809909    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809914    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809918    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809922    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809927    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809932    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809936    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809940    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809945    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:39:05.822169 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809951    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:39:05.822650 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809955    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:39:05.822650 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.809959    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:39:05.822650 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.809968    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:39:05.822650 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.817762    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 05 16:39:05.822650 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.817776    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 05 16:39:05.822650 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.817795    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 05 16:39:05.822650 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.817801    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 05 16:39:05.822650 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817875    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:39:05.822650 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817880    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:39:05.822650 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817883    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:39:05.822650 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817886    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:39:05.822650 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817889    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:39:05.822650 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817892    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:39:05.822650 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817895    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817897    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817900    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817903    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817906    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817908    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817913    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817917    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817920    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817922    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817925    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817928    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817930    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817933    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817936    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817938    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817941    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817944    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817947    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817950    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:39:05.823025 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817953    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817955    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817957    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817961    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817964    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817967    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817969    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817972    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817974    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817977    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817980    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817982    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817985    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817987    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817990    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817993    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817995    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.817998    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818001    2575 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:39:05.823509 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818005    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818008    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818010    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818013    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818015    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818018    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818021    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818023    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818026    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818028    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818031    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818033    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818037    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818040    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818043    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818045    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818048    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818051    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818053    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:39:05.823995 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818057    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818060    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818063    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818066    2575 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818069    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818072    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818075    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818078    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818081    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818083    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818086    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818089    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818092    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818095    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818097    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818100    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818102    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818105    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818107    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818110    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:39:05.824467 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818112    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818115    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818117    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818120    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818123    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818126    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818129    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818132    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818134    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818137    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818139    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818157    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818161    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818164    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818167    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:39:05.825077 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.818172    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818315    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818319    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818322    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818326    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818330    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818333    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818336    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818339    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818342    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818344    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818347    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818350    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818353    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818355    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818357    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818360    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818362    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818365    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:39:05.825478 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818367    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818370    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818372    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818375    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818378    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818386    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818388    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818391    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818394    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818397    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818399    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818402    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818404    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818406    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818409    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818411    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818414    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818416    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818419    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818422    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:39:05.825977 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818424    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818426    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818429    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818432    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818434    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818438    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818441    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818444    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818446    2575 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818449    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818451    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818454    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818456    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818458    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818461    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818463    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818466    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818468    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818476    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:39:05.826479 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818480    2575 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818484    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818487    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818490    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818492    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818495    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818497    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818500    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818502    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818504    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818507    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818509    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818512    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818514    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818517    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818519    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818522    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818524    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818527    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:39:05.826988 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818529    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818532    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818535    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818537    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818539    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818542    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818544    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818547    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818549    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818552    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818555    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818557    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818560    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818569    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818572    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818575    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818577    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818580    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818582    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818585    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818587    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:39:05.827453 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818590    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:39:05.828031 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:05.818592    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:39:05.828031 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.818597    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:39:05.828031 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.818698    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 05 16:39:05.828031 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.821542    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 05 16:39:05.828031 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.822944    2575 server.go:1019] "Starting client certificate rotation"
Aug 05 16:39:05.828031 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.823075    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 16:39:05.828031 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.823110    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 16:39:05.828031 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.825375    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 16:39:05.829057 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.829042    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 16:39:05.839703 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.839686    2575 log.go:25] "Validated CRI v1 runtime API"
Aug 05 16:39:05.841847 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.841832    2575 log.go:25] "Validated CRI v1 image API"
Aug 05 16:39:05.842562 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.842545    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 05 16:39:05.847379 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.847356    2575 fs.go:135] Filesystem UUIDs: map[04ed9221-28e3-4890-a925-f375511d6eef:/dev/nvme0n1p3 336c1c79-da90-4ad2-a0d5-20f42b330307:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Aug 05 16:39:05.847451 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.847376    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 05 16:39:05.849951 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.849928    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 16:39:05.852611 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.852498    2575 manager.go:216] Machine: {Timestamp:2026-08-05 16:39:05.851245889 +0000 UTC m=+0.300792179 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107189 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28245d49b10ac679b2d4eb8fa4d821 SystemUUID:ec28245d-49b1-0ac6-79b2-d4eb8fa4d821 BootID:5eade7fc-db2c-4d51-a1c6-457b530022b6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a4:ed:49:f0:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a4:ed:49:f0:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:f6:6d:91:49:58 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 05 16:39:05.852611 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.852609    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 05 16:39:05.852721 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.852712    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 05 16:39:05.855450 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.855429    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 05 16:39:05.855583 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.855454    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-35.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 05 16:39:05.856198 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.856186    2575 topology_manager.go:138] "Creating topology manager with none policy"
Aug 05 16:39:05.856230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.856200    2575 container_manager_linux.go:309] "Creating device plugin manager"
Aug 05 16:39:05.856230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.856207    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 16:39:05.856825 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.856814    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 16:39:05.858321 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.858310    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 05 16:39:05.862896 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.862884    2575 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 16:39:05.863000 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.862991    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 05 16:39:05.863041 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.863019    2575 kubelet.go:486] "Attempting to sync node with API server"
Aug 05 16:39:05.863041 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.863028    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 05 16:39:05.863041 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.863039    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 05 16:39:05.863144 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.863047    2575 kubelet.go:398] "Adding apiserver pod source"
Aug 05 16:39:05.863144 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.863057    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 05 16:39:05.863421 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.863405    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 16:39:05.863485 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.863427    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 16:39:05.865337 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.865323    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 05 16:39:05.866892 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.866879    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 05 16:39:05.866947 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.866909    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 05 16:39:05.867569 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.867559    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 05 16:39:05.867612 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.867575    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 05 16:39:05.867612 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.867581    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 05 16:39:05.867612 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.867586    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 05 16:39:05.867612 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.867595    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 05 16:39:05.867612 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.867601    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 05 16:39:05.867612 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.867609    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 05 16:39:05.867612 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.867615    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 05 16:39:05.867799 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.867621    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 05 16:39:05.867799 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.867627    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 05 16:39:05.867799 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.867636    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 05 16:39:05.867799 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.867657    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 05 16:39:05.868304 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.868293    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 05 16:39:05.868338 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.868305    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 05 16:39:05.871342 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.871328    2575 server.go:1268] "Started kubelet"
Aug 05 16:39:05.871436 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.871391    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 05 16:39:05.871506 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.871481    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 05 16:39:05.871559 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.871525    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 05 16:39:05.872681 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.872662    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 05 16:39:05.872692 ip-10-0-130-35 systemd[1]: Started Kubernetes Kubelet.
Aug 05 16:39:05.877127 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:05.877089    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 05 16:39:05.877253 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:05.877229    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 05 16:39:05.877322 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.877268    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-35.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 05 16:39:05.877524 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:05.877502    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 05 16:39:05.877863 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.877845    2575 server.go:310] "Adding debug handlers to kubelet server"
Aug 05 16:39:05.880417 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:05.879517    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-35.ec2.internal.18c8f631c4ff60be  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-35.ec2.internal,UID:ip-10-0-130-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-35.ec2.internal,},FirstTimestamp:2026-08-05 16:39:05.871302846 +0000 UTC m=+0.320849136,LastTimestamp:2026-08-05 16:39:05.871302846 +0000 UTC m=+0.320849136,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-35.ec2.internal,}"
Aug 05 16:39:05.882434 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.882420    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 05 16:39:05.882499 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.882441    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 05 16:39:05.882558 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:05.882514    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Aug 05 16:39:05.883083 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.883063    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 05 16:39:05.883083 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.883061    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 05 16:39:05.883240 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.883089    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 05 16:39:05.883240 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.883210    2575 reconstruct.go:97] "Volume reconstruction finished"
Aug 05 16:39:05.883240 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.883218    2575 reconciler.go:29] "Reconciler: start to sync state"
Aug 05 16:39:05.883390 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.883371    2575 factory.go:55] Registering systemd factory
Aug 05 16:39:05.883390 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.883389    2575 factory.go:223] Registration of the systemd container factory successfully
Aug 05 16:39:05.883627 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.883597    2575 factory.go:153] Registering CRI-O factory
Aug 05 16:39:05.883627 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.883619    2575 factory.go:223] Registration of the crio container factory successfully
Aug 05 16:39:05.883757 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.883663    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 05 16:39:05.883757 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.883682    2575 factory.go:103] Registering Raw factory
Aug 05 16:39:05.883757 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.883696    2575 manager.go:1196] Started watching for new ooms in manager
Aug 05 16:39:05.884044 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.884034    2575 manager.go:349] Starting recovery of all containers
Aug 05 16:39:05.885540 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:05.885513    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 05 16:39:05.885646 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:05.885625    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 05 16:39:05.892271 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.892247    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zxd9l"
Aug 05 16:39:05.893305 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.893212    2575 manager.go:354] Recovery completed
Aug 05 16:39:05.898022 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.898002    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zxd9l"
Aug 05 16:39:05.898420 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.898406    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:39:05.900081 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.900067    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:39:05.900155 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.900097    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:39:05.900155 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.900111    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:39:05.900697 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.900686    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 05 16:39:05.900697 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.900696    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 05 16:39:05.900798 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.900701    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:39:05.900798 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.900712    2575 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 16:39:05.901401 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.901385    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:39:05.901471 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.901409    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:39:05.901471 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.901419    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:39:05.902296 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:05.902225    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-35.ec2.internal.18c8f631c6b6803c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-35.ec2.internal,UID:ip-10-0-130-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-35.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-35.ec2.internal,},FirstTimestamp:2026-08-05 16:39:05.900081212 +0000 UTC m=+0.349627507,LastTimestamp:2026-08-05 16:39:05.900081212 +0000 UTC m=+0.349627507,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-35.ec2.internal,}"
Aug 05 16:39:05.903330 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.903316    2575 policy_none.go:49] "None policy: Start"
Aug 05 16:39:05.903380 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.903338    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 05 16:39:05.903380 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.903353    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 05 16:39:05.905451 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.905437    2575 policy_none.go:47] "Start"
Aug 05 16:39:05.947975 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.947868    2575 manager.go:337] "Starting Device Plugin manager"
Aug 05 16:39:05.948063 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:05.947997    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 05 16:39:05.948063 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.948010    2575 server.go:87] "Starting device plugin registration server"
Aug 05 16:39:05.948240 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.948227    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 05 16:39:05.948295 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.948243    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 05 16:39:05.948350 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.948333    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 05 16:39:05.948426 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.948409    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 05 16:39:05.948426 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:05.948424    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 05 16:39:05.948900 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:05.948882    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 05 16:39:05.948973 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:05.948924    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-35.ec2.internal\" not found"
Aug 05 16:39:06.006315 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.006284    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 05 16:39:06.008404 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.007573    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 05 16:39:06.008404 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.007604    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 05 16:39:06.008404 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.007626    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 05 16:39:06.008404 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.007655    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 05 16:39:06.009689 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.009671    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:39:06.048654 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.048575    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:39:06.049349 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.049330    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:39:06.049420 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.049361    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:39:06.049420 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.049373    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:39:06.049420 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.049395    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.057542 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.057528    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.057592 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.057549    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-35.ec2.internal\": node \"ip-10-0-130-35.ec2.internal\" not found"
Aug 05 16:39:06.071187 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.071165    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Aug 05 16:39:06.108441 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.108424    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"]
Aug 05 16:39:06.108506 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.108480    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:39:06.109197 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.109183    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:39:06.109239 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.109214    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:39:06.109239 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.109224    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:39:06.111422 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.111410    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:39:06.111528 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.111516    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.111573 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.111544    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:39:06.112087 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.112071    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:39:06.112175 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.112099    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:39:06.112175 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.112076    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:39:06.112175 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.112111    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:39:06.112175 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.112133    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:39:06.112175 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.112146    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:39:06.114240 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.114227    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.114298 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.114250    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:39:06.115669 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.115654    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:39:06.115758 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.115682    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:39:06.115758 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.115693    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:39:06.136400 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.136379    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-35.ec2.internal\" not found" node="ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.140714 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.140699    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-35.ec2.internal\" not found" node="ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.172223 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.172205    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Aug 05 16:39:06.184686 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.184667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/08c34d8c3110c1c1697a169266e498d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal\" (UID: \"08c34d8c3110c1c1697a169266e498d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.184741 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.184690    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08c34d8c3110c1c1697a169266e498d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal\" (UID: \"08c34d8c3110c1c1697a169266e498d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.184741 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.184714    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c3a83236ec0dc10215cc696b78d0e7a5-config\") pod \"kube-apiserver-proxy-ip-10-0-130-35.ec2.internal\" (UID: \"c3a83236ec0dc10215cc696b78d0e7a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.272802 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.272780    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Aug 05 16:39:06.285694 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.285672    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/08c34d8c3110c1c1697a169266e498d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal\" (UID: \"08c34d8c3110c1c1697a169266e498d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.285783 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.285692    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/08c34d8c3110c1c1697a169266e498d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal\" (UID: \"08c34d8c3110c1c1697a169266e498d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.285783 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.285706    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08c34d8c3110c1c1697a169266e498d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal\" (UID: \"08c34d8c3110c1c1697a169266e498d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.285783 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.285724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c3a83236ec0dc10215cc696b78d0e7a5-config\") pod \"kube-apiserver-proxy-ip-10-0-130-35.ec2.internal\" (UID: \"c3a83236ec0dc10215cc696b78d0e7a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.285783 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.285759    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c3a83236ec0dc10215cc696b78d0e7a5-config\") pod \"kube-apiserver-proxy-ip-10-0-130-35.ec2.internal\" (UID: \"c3a83236ec0dc10215cc696b78d0e7a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.285783 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.285760    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08c34d8c3110c1c1697a169266e498d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal\" (UID: \"08c34d8c3110c1c1697a169266e498d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.373054 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.372973    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Aug 05 16:39:06.442232 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.442206    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.443398 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.443371    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.474529 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.474501    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Aug 05 16:39:06.580853 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.580790    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Aug 05 16:39:06.682666 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.682564    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Aug 05 16:39:06.747385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.747359    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:39:06.784399 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.784350    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.814108 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.814089    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 16:39:06.815899 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.815885    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.822616 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.822594    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 05 16:39:06.822734 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.822715    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 16:39:06.822787 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.822770    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 16:39:06.822832 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.822778    2575 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a52e101754a424248940b1d2464fcbfd-36ca29e8a8725d6f.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": read tcp 10.0.130.35:59764->18.213.33.115:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:06.863207 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.863183    2575 apiserver.go:52] "Watching apiserver"
Aug 05 16:39:06.880213 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.880181    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 05 16:39:06.882956 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.882928    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-8s4cc","openshift-dns/node-resolver-vzjpl","openshift-image-registry/node-ca-hj9wk","openshift-multus/multus-additional-cni-plugins-tlgqn","openshift-network-operator/iptables-alerter-cr6n5","openshift-ovn-kubernetes/ovnkube-node-v5rjf","kube-system/global-pull-secret-syncer-cjd4p","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal","openshift-multus/multus-5pvht","openshift-multus/network-metrics-daemon-8v7cz","openshift-network-diagnostics/network-check-target-hpls5","kube-system/konnectivity-agent-w5s4x"]
Aug 05 16:39:06.883092 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.882974    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 05 16:39:06.886416 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.886397    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.887635 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.887612    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-sysctl-conf\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.887729 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.887645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-systemd\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.887729 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.887670    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-lib-modules\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.887848 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.887733    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-var-lib-kubelet\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.887848 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.887758    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ce9c83a-cc80-4f79-99db-ed53da98f56b-tmp\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.887848 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.887787    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-sysconfig\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.887848 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.887809    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-host\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.887848 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.887846    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-kubernetes\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.888155 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.887866    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-run\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.888155 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.887895    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-tuned\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.888155 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.887922    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5lgd\" (UniqueName: \"kubernetes.io/projected/3ce9c83a-cc80-4f79-99db-ed53da98f56b-kube-api-access-h5lgd\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.888155 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.887962    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-modprobe-d\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.888155 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.887991    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-sysctl-d\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.888155 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.888022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-sys\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.889270 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.888792    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 05 16:39:06.889270 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.889261    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:39:06.889434 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.889402    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2wfzk\""
Aug 05 16:39:06.889668 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.889649    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vzjpl"
Aug 05 16:39:06.893072 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.893054    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hj9wk"
Aug 05 16:39:06.893530 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.893511    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 05 16:39:06.893621 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.893611    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 05 16:39:06.895562 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.895545    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 05 16:39:06.895967 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.895951    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:06.896263 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.896234    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 05 16:39:06.896359 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.896283    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m2jj7\""
Aug 05 16:39:06.896586 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.896567    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zmncd\""
Aug 05 16:39:06.897006 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.896988    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 05 16:39:06.898346 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.898330    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 05 16:39:06.898431 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.898410    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 05 16:39:06.898495 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.898478    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 05 16:39:06.898782 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.898767    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 05 16:39:06.898877 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.898862    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cr6n5"
Aug 05 16:39:06.899054 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.899034    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 05 16:39:06.899205 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.899188    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 16:39:06.899272 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.899255    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-66l9p\""
Aug 05 16:39:06.901897 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.901865    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.902898 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.902855    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 16:34:06 +0000 UTC" deadline="2028-01-21 19:15:37.488930345 +0000 UTC"
Aug 05 16:39:06.902898 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.902898    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12818h36m30.586035818s"
Aug 05 16:39:06.903171 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.903157    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 05 16:39:06.903298 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.903283    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ks7kz\""
Aug 05 16:39:06.904327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.904312    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 05 16:39:06.904504 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.904488    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:06.904593 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.904571    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:06.906299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.906278    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 05 16:39:06.906406 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.906320    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 05 16:39:06.906470 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.906457    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 05 16:39:06.906684 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.906670    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 05 16:39:06.906767 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.906751    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 05 16:39:06.906861 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.906845    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cflnw\""
Aug 05 16:39:06.907428 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.907412    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:39:06.907547 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.907533    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:06.907622 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.907537    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 05 16:39:06.910409 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.910393    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.910784 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.910768    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 05 16:39:06.911118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.911102    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j9p4z\""
Aug 05 16:39:06.911204 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.911141    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 05 16:39:06.912626 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.912608    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 05 16:39:06.912766 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.912749    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 05 16:39:06.913274 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.913254    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n42xv\""
Aug 05 16:39:06.913338 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.913297    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:06.913392 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.913374    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:06.915964 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.915949    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:06.916025 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:06.916009    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:06.919278 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.919261    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w5s4x"
Aug 05 16:39:06.921663 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.921647    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v7hq8\""
Aug 05 16:39:06.921762 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.921692    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 05 16:39:06.922209 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.922195    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 05 16:39:06.984132 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.984111    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 05 16:39:06.988594 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988571    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-var-lib-cni-multus\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.988696 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988599    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-multus-conf-dir\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.988696 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988617    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-run-systemd\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.988696 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-sysctl-d\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.988696 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988669    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-ovnkube-script-lib\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.988985 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988710    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-run-multus-certs\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.988985 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988732    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cb1412e-89c2-4df1-a15c-2cd8cd50dd87-tmp-dir\") pod \"node-resolver-vzjpl\" (UID: \"9cb1412e-89c2-4df1-a15c-2cd8cd50dd87\") " pod="openshift-dns/node-resolver-vzjpl"
Aug 05 16:39:06.988985 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-systemd-units\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.988985 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988770    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-sysctl-d\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.988985 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988780    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-var-lib-kubelet\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.988985 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988830    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-var-lib-kubelet\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.988985 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988852    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs\") pod \"network-metrics-daemon-8v7cz\" (UID: \"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2\") " pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:06.988985 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988880    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11f8ada3-7b4b-4584-9d69-6ec3dd068487-agent-certs\") pod \"konnectivity-agent-w5s4x\" (UID: \"11f8ada3-7b4b-4584-9d69-6ec3dd068487\") " pod="kube-system/konnectivity-agent-w5s4x"
Aug 05 16:39:06.988985 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988906    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-cni-netd\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.988985 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988932    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-cni-binary-copy\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.988985 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.988957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgqst\" (UniqueName: \"kubernetes.io/projected/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-kube-api-access-hgqst\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-sysconfig\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19978542-a8d5-4584-b68a-6f2cf12f2461-kubelet-config\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-multus-daemon-config\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989098    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-run\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989099    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-sysconfig\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-run-ovn\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-system-cni-dir\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989187    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989219    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-etc-selinux\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989243    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5f59a7f-c973-47dd-8604-3ff59ce75435-cnibin\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989263    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-cnibin\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd4a785f-fc18-40c6-a5bc-14f4064d26ba-serviceca\") pod \"node-ca-hj9wk\" (UID: \"fd4a785f-fc18-40c6-a5bc-14f4064d26ba\") " pod="openshift-image-registry/node-ca-hj9wk"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989311    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-device-dir\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989311    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-run\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989346    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5f59a7f-c973-47dd-8604-3ff59ce75435-system-cni-dir\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989376    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-log-socket\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.989449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-var-lib-cni-bin\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989412    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqrh2\" (UniqueName: \"kubernetes.io/projected/fd4a785f-fc18-40c6-a5bc-14f4064d26ba-kube-api-access-vqrh2\") pod \"node-ca-hj9wk\" (UID: \"fd4a785f-fc18-40c6-a5bc-14f4064d26ba\") " pod="openshift-image-registry/node-ca-hj9wk"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-hostroot\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989469    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5lgd\" (UniqueName: \"kubernetes.io/projected/3ce9c83a-cc80-4f79-99db-ed53da98f56b-kube-api-access-h5lgd\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989530    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-var-lib-openvswitch\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989576    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-cni-bin\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989599    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2tf5\" (UniqueName: \"kubernetes.io/projected/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-kube-api-access-c2tf5\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989623    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-os-release\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-kubelet\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989672    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-modprobe-d\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989695    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-sys\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989716    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dtgd\" (UniqueName: \"kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd\") pod \"network-check-target-hpls5\" (UID: \"d01e7b31-b024-4f0c-bddb-1f5f35d5ddce\") " pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989732    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c2df763-e9bb-47c8-a533-8b129eef9548-host-slash\") pod \"iptables-alerter-cr6n5\" (UID: \"2c2df763-e9bb-47c8-a533-8b129eef9548\") " pod="openshift-network-operator/iptables-alerter-cr6n5"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989750    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5f59a7f-c973-47dd-8604-3ff59ce75435-os-release\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5f59a7f-c973-47dd-8604-3ff59ce75435-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989789    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-modprobe-d\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.990118 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989789    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-sys\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzdn8\" (UniqueName: \"kubernetes.io/projected/a5f59a7f-c973-47dd-8604-3ff59ce75435-kube-api-access-nzdn8\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19978542-a8d5-4584-b68a-6f2cf12f2461-dbus\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-sysctl-conf\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-systemd\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.989998    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ce9c83a-cc80-4f79-99db-ed53da98f56b-tmp\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990020    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rtvh\" (UniqueName: \"kubernetes.io/projected/2c2df763-e9bb-47c8-a533-8b129eef9548-kube-api-access-8rtvh\") pod \"iptables-alerter-cr6n5\" (UID: \"2c2df763-e9bb-47c8-a533-8b129eef9548\") " pod="openshift-network-operator/iptables-alerter-cr6n5"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990050    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5f59a7f-c973-47dd-8604-3ff59ce75435-cni-binary-copy\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990054    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-sysctl-conf\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990070    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-systemd\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990078    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-ovn-node-metrics-cert\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990118    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-multus-socket-dir-parent\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-kubernetes\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990179    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-tuned\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-kubernetes\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-socket-dir\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:06.990920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990259    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9cb1412e-89c2-4df1-a15c-2cd8cd50dd87-hosts-file\") pod \"node-resolver-vzjpl\" (UID: \"9cb1412e-89c2-4df1-a15c-2cd8cd50dd87\") " pod="openshift-dns/node-resolver-vzjpl"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990296    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5f59a7f-c973-47dd-8604-3ff59ce75435-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990320    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-slash\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990383    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-etc-openvswitch\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990411    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c2df763-e9bb-47c8-a533-8b129eef9548-iptables-alerter-script\") pod \"iptables-alerter-cr6n5\" (UID: \"2c2df763-e9bb-47c8-a533-8b129eef9548\") " pod="openshift-network-operator/iptables-alerter-cr6n5"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11f8ada3-7b4b-4584-9d69-6ec3dd068487-konnectivity-ca\") pod \"konnectivity-agent-w5s4x\" (UID: \"11f8ada3-7b4b-4584-9d69-6ec3dd068487\") " pod="kube-system/konnectivity-agent-w5s4x"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-node-log\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990524    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990553    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-multus-cni-dir\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990578    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-run-netns\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990602    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-var-lib-kubelet\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-etc-kubernetes\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-lib-modules\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-sys-fs\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990725    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-run-openvswitch\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990749    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-run-k8s-cni-cncf-io\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:06.991534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990773    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-host\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.992073 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtds7\" (UniqueName: \"kubernetes.io/projected/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-kube-api-access-mtds7\") pod \"network-metrics-daemon-8v7cz\" (UID: \"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2\") " pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:06.992073 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990825    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-lib-modules\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.992073 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45vm4\" (UniqueName: \"kubernetes.io/projected/752c87e8-d12a-4bab-b6bd-1c91d438eb38-kube-api-access-45vm4\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:06.992073 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990856    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ce9c83a-cc80-4f79-99db-ed53da98f56b-host\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.992073 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcm45\" (UniqueName: \"kubernetes.io/projected/9cb1412e-89c2-4df1-a15c-2cd8cd50dd87-kube-api-access-bcm45\") pod \"node-resolver-vzjpl\" (UID: \"9cb1412e-89c2-4df1-a15c-2cd8cd50dd87\") " pod="openshift-dns/node-resolver-vzjpl"
Aug 05 16:39:06.992073 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990900    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-run-netns\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.992073 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-ovnkube-config\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.992073 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990962    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-env-overrides\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.992073 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.990997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd4a785f-fc18-40c6-a5bc-14f4064d26ba-host\") pod \"node-ca-hj9wk\" (UID: \"fd4a785f-fc18-40c6-a5bc-14f4064d26ba\") " pod="openshift-image-registry/node-ca-hj9wk"
Aug 05 16:39:06.992073 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.991018    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-registration-dir\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:06.992073 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.991039    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5f59a7f-c973-47dd-8604-3ff59ce75435-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:06.992073 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.991088    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:06.993344 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.993327    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ce9c83a-cc80-4f79-99db-ed53da98f56b-etc-tuned\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.993405 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.993344    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ce9c83a-cc80-4f79-99db-ed53da98f56b-tmp\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:06.998332 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:06.998314    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5lgd\" (UniqueName: \"kubernetes.io/projected/3ce9c83a-cc80-4f79-99db-ed53da98f56b-kube-api-access-h5lgd\") pod \"tuned-8s4cc\" (UID: \"3ce9c83a-cc80-4f79-99db-ed53da98f56b\") " pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:07.001732 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.001715    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-722g2"
Aug 05 16:39:07.012867 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.012851    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-722g2"
Aug 05 16:39:07.047264 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:07.047230    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08c34d8c3110c1c1697a169266e498d5.slice/crio-58d302962105fb10ca51087ed570643a768eba5581a9bae5c88c2198c506fc4f WatchSource:0}: Error finding container 58d302962105fb10ca51087ed570643a768eba5581a9bae5c88c2198c506fc4f: Status 404 returned error can't find the container with id 58d302962105fb10ca51087ed570643a768eba5581a9bae5c88c2198c506fc4f
Aug 05 16:39:07.051704 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.051689    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:39:07.091263 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11f8ada3-7b4b-4584-9d69-6ec3dd068487-agent-certs\") pod \"konnectivity-agent-w5s4x\" (UID: \"11f8ada3-7b4b-4584-9d69-6ec3dd068487\") " pod="kube-system/konnectivity-agent-w5s4x"
Aug 05 16:39:07.091353 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091275    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-cni-netd\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.091353 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091294    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-cni-binary-copy\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.091353 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgqst\" (UniqueName: \"kubernetes.io/projected/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-kube-api-access-hgqst\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.091510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091367    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-cni-netd\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.091510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091420    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19978542-a8d5-4584-b68a-6f2cf12f2461-kubelet-config\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:07.091510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091439    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/19978542-a8d5-4584-b68a-6f2cf12f2461-kubelet-config\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:07.091510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091462    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-multus-daemon-config\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.091510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-run-ovn\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.091761 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091529    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-system-cni-dir\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.091761 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091547    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-run-ovn\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.091761 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091556    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.091761 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-etc-selinux\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.091761 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091607    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-system-cni-dir\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.091761 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091625    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.091761 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091625    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5f59a7f-c973-47dd-8604-3ff59ce75435-cnibin\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.091761 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091654    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5f59a7f-c973-47dd-8604-3ff59ce75435-cnibin\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.091761 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-cnibin\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.091761 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd4a785f-fc18-40c6-a5bc-14f4064d26ba-serviceca\") pod \"node-ca-hj9wk\" (UID: \"fd4a785f-fc18-40c6-a5bc-14f4064d26ba\") " pod="openshift-image-registry/node-ca-hj9wk"
Aug 05 16:39:07.091761 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091719    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-etc-selinux\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.091761 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091756    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-cnibin\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091832    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-device-dir\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5f59a7f-c973-47dd-8604-3ff59ce75435-system-cni-dir\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-log-socket\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-var-lib-cni-bin\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqrh2\" (UniqueName: \"kubernetes.io/projected/fd4a785f-fc18-40c6-a5bc-14f4064d26ba-kube-api-access-vqrh2\") pod \"node-ca-hj9wk\" (UID: \"fd4a785f-fc18-40c6-a5bc-14f4064d26ba\") " pod="openshift-image-registry/node-ca-hj9wk"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091947    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5f59a7f-c973-47dd-8604-3ff59ce75435-system-cni-dir\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-hostroot\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091978    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-log-socket\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091992    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-device-dir\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091995    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-var-lib-cni-bin\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.091996    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-var-lib-openvswitch\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092032    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-hostroot\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-cni-bin\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092065    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-cni-bin\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092069    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2tf5\" (UniqueName: \"kubernetes.io/projected/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-kube-api-access-c2tf5\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092069    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd4a785f-fc18-40c6-a5bc-14f4064d26ba-serviceca\") pod \"node-ca-hj9wk\" (UID: \"fd4a785f-fc18-40c6-a5bc-14f4064d26ba\") " pod="openshift-image-registry/node-ca-hj9wk"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-os-release\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.092327 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092109    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-var-lib-openvswitch\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092245    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-os-release\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092216    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-kubelet\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092291    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtgd\" (UniqueName: \"kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd\") pod \"network-check-target-hpls5\" (UID: \"d01e7b31-b024-4f0c-bddb-1f5f35d5ddce\") " pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c2df763-e9bb-47c8-a533-8b129eef9548-host-slash\") pod \"iptables-alerter-cr6n5\" (UID: \"2c2df763-e9bb-47c8-a533-8b129eef9548\") " pod="openshift-network-operator/iptables-alerter-cr6n5"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092291    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-kubelet\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092352    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5f59a7f-c973-47dd-8604-3ff59ce75435-os-release\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5f59a7f-c973-47dd-8604-3ff59ce75435-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092412    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c2df763-e9bb-47c8-a533-8b129eef9548-host-slash\") pod \"iptables-alerter-cr6n5\" (UID: \"2c2df763-e9bb-47c8-a533-8b129eef9548\") " pod="openshift-network-operator/iptables-alerter-cr6n5"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092439    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzdn8\" (UniqueName: \"kubernetes.io/projected/a5f59a7f-c973-47dd-8604-3ff59ce75435-kube-api-access-nzdn8\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092466    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19978542-a8d5-4584-b68a-6f2cf12f2461-dbus\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092470    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5f59a7f-c973-47dd-8604-3ff59ce75435-os-release\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092656    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-cni-binary-copy\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092732    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/19978542-a8d5-4584-b68a-6f2cf12f2461-dbus\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.092760    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-multus-daemon-config\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093008    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rtvh\" (UniqueName: \"kubernetes.io/projected/2c2df763-e9bb-47c8-a533-8b129eef9548-kube-api-access-8rtvh\") pod \"iptables-alerter-cr6n5\" (UID: \"2c2df763-e9bb-47c8-a533-8b129eef9548\") " pod="openshift-network-operator/iptables-alerter-cr6n5"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5f59a7f-c973-47dd-8604-3ff59ce75435-cni-binary-copy\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.093219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093053    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-ovn-node-metrics-cert\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093074    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-multus-socket-dir-parent\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093106    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5f59a7f-c973-47dd-8604-3ff59ce75435-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093334    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-socket-dir\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093459    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-multus-socket-dir-parent\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093528    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9cb1412e-89c2-4df1-a15c-2cd8cd50dd87-hosts-file\") pod \"node-resolver-vzjpl\" (UID: \"9cb1412e-89c2-4df1-a15c-2cd8cd50dd87\") " pod="openshift-dns/node-resolver-vzjpl"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5f59a7f-c973-47dd-8604-3ff59ce75435-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093607    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-slash\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-etc-openvswitch\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c2df763-e9bb-47c8-a533-8b129eef9548-iptables-alerter-script\") pod \"iptables-alerter-cr6n5\" (UID: \"2c2df763-e9bb-47c8-a533-8b129eef9548\") " pod="openshift-network-operator/iptables-alerter-cr6n5"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093686    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-socket-dir\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093701    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11f8ada3-7b4b-4584-9d69-6ec3dd068487-konnectivity-ca\") pod \"konnectivity-agent-w5s4x\" (UID: \"11f8ada3-7b4b-4584-9d69-6ec3dd068487\") " pod="kube-system/konnectivity-agent-w5s4x"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093728    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-node-log\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093753    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-slash\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093874    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9cb1412e-89c2-4df1-a15c-2cd8cd50dd87-hosts-file\") pod \"node-resolver-vzjpl\" (UID: \"9cb1412e-89c2-4df1-a15c-2cd8cd50dd87\") " pod="openshift-dns/node-resolver-vzjpl"
Aug 05 16:39:07.094053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093920    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-multus-cni-dir\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093978    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5f59a7f-c973-47dd-8604-3ff59ce75435-cni-binary-copy\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.093985    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-etc-openvswitch\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094002    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-run-netns\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094055    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-multus-cni-dir\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094085    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-run-netns\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094130    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-var-lib-kubelet\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094183    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-etc-kubernetes\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094217    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-sys-fs\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094252    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-run-openvswitch\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094275    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-run-k8s-cni-cncf-io\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094329    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtds7\" (UniqueName: \"kubernetes.io/projected/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-kube-api-access-mtds7\") pod \"network-metrics-daemon-8v7cz\" (UID: \"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2\") " pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094493    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11f8ada3-7b4b-4584-9d69-6ec3dd068487-agent-certs\") pod \"konnectivity-agent-w5s4x\" (UID: \"11f8ada3-7b4b-4584-9d69-6ec3dd068487\") " pod="kube-system/konnectivity-agent-w5s4x"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094217    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-node-log\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094649    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-var-lib-kubelet\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094649    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11f8ada3-7b4b-4584-9d69-6ec3dd068487-konnectivity-ca\") pod \"konnectivity-agent-w5s4x\" (UID: \"11f8ada3-7b4b-4584-9d69-6ec3dd068487\") " pod="kube-system/konnectivity-agent-w5s4x"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094687    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-etc-kubernetes\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.094868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094748    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-run-openvswitch\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.095722 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.094750    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:07.095722 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094762    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-run-k8s-cni-cncf-io\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.095722 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094807    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5f59a7f-c973-47dd-8604-3ff59ce75435-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.095722 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.094829    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-sys-fs\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.095722 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.095320    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret podName:19978542-a8d5-4584-b68a-6f2cf12f2461 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:07.594967903 +0000 UTC m=+2.044514190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret") pod "global-pull-secret-syncer-cjd4p" (UID: "19978542-a8d5-4584-b68a-6f2cf12f2461") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:07.095722 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095367    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45vm4\" (UniqueName: \"kubernetes.io/projected/752c87e8-d12a-4bab-b6bd-1c91d438eb38-kube-api-access-45vm4\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.095722 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095423    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcm45\" (UniqueName: \"kubernetes.io/projected/9cb1412e-89c2-4df1-a15c-2cd8cd50dd87-kube-api-access-bcm45\") pod \"node-resolver-vzjpl\" (UID: \"9cb1412e-89c2-4df1-a15c-2cd8cd50dd87\") " pod="openshift-dns/node-resolver-vzjpl"
Aug 05 16:39:07.095722 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095442    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c2df763-e9bb-47c8-a533-8b129eef9548-iptables-alerter-script\") pod \"iptables-alerter-cr6n5\" (UID: \"2c2df763-e9bb-47c8-a533-8b129eef9548\") " pod="openshift-network-operator/iptables-alerter-cr6n5"
Aug 05 16:39:07.095722 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095489    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-run-netns\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.095722 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-ovnkube-config\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.095722 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-env-overrides\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.095722 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095627    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd4a785f-fc18-40c6-a5bc-14f4064d26ba-host\") pod \"node-ca-hj9wk\" (UID: \"fd4a785f-fc18-40c6-a5bc-14f4064d26ba\") " pod="openshift-image-registry/node-ca-hj9wk"
Aug 05 16:39:07.095722 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-registration-dir\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.095722 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095706    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5f59a7f-c973-47dd-8604-3ff59ce75435-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.096434 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095739    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.096434 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095775    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-var-lib-cni-multus\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.096434 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-multus-conf-dir\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.096434 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095870    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-run-systemd\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.096434 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095904    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-ovnkube-script-lib\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.096434 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-run-multus-certs\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.096434 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.095971    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cb1412e-89c2-4df1-a15c-2cd8cd50dd87-tmp-dir\") pod \"node-resolver-vzjpl\" (UID: \"9cb1412e-89c2-4df1-a15c-2cd8cd50dd87\") " pod="openshift-dns/node-resolver-vzjpl"
Aug 05 16:39:07.096434 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.096000    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-systemd-units\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.096434 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.096036    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs\") pod \"network-metrics-daemon-8v7cz\" (UID: \"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2\") " pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:07.096434 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.096166    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:07.096434 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.096231    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs podName:f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:07.596211833 +0000 UTC m=+2.045758124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs") pod "network-metrics-daemon-8v7cz" (UID: "f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:07.097011 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.096628    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-env-overrides\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.097011 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.096736    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd4a785f-fc18-40c6-a5bc-14f4064d26ba-host\") pod \"node-ca-hj9wk\" (UID: \"fd4a785f-fc18-40c6-a5bc-14f4064d26ba\") " pod="openshift-image-registry/node-ca-hj9wk"
Aug 05 16:39:07.097011 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.096787    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-ovnkube-config\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.097011 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.096827    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/752c87e8-d12a-4bab-b6bd-1c91d438eb38-registration-dir\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.097011 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.096884    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-run-netns\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.097262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.096992    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5f59a7f-c973-47dd-8604-3ff59ce75435-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.097262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.097085    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.097262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.097172    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-var-lib-cni-multus\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.097262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.097186    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-run-systemd\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.097262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.097222    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-host-run-multus-certs\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.097262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.097239    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-multus-conf-dir\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.097568 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.097285    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-systemd-units\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.097568 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.097421    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cb1412e-89c2-4df1-a15c-2cd8cd50dd87-tmp-dir\") pod \"node-resolver-vzjpl\" (UID: \"9cb1412e-89c2-4df1-a15c-2cd8cd50dd87\") " pod="openshift-dns/node-resolver-vzjpl"
Aug 05 16:39:07.097753 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.097728    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-ovnkube-script-lib\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.098358 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.096582    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-ovn-node-metrics-cert\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.102242 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.102221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqrh2\" (UniqueName: \"kubernetes.io/projected/fd4a785f-fc18-40c6-a5bc-14f4064d26ba-kube-api-access-vqrh2\") pod \"node-ca-hj9wk\" (UID: \"fd4a785f-fc18-40c6-a5bc-14f4064d26ba\") " pod="openshift-image-registry/node-ca-hj9wk"
Aug 05 16:39:07.103461 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.103437    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:39:07.103551 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.103469    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:39:07.103551 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.103511    2575 projected.go:196] Error preparing data for projected volume kube-api-access-9dtgd for pod openshift-network-diagnostics/network-check-target-hpls5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:07.103680 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.103585    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd podName:d01e7b31-b024-4f0c-bddb-1f5f35d5ddce nodeName:}" failed. No retries permitted until 2026-08-05 16:39:07.603567569 +0000 UTC m=+2.053113867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9dtgd" (UniqueName: "kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd") pod "network-check-target-hpls5" (UID: "d01e7b31-b024-4f0c-bddb-1f5f35d5ddce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:07.105053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.105028    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2tf5\" (UniqueName: \"kubernetes.io/projected/0c240570-c8ab-4d5a-ac59-4c45cd4a9417-kube-api-access-c2tf5\") pod \"ovnkube-node-v5rjf\" (UID: \"0c240570-c8ab-4d5a-ac59-4c45cd4a9417\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.105165 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.105147    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtds7\" (UniqueName: \"kubernetes.io/projected/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-kube-api-access-mtds7\") pod \"network-metrics-daemon-8v7cz\" (UID: \"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2\") " pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:07.105463 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.105435    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzdn8\" (UniqueName: \"kubernetes.io/projected/a5f59a7f-c973-47dd-8604-3ff59ce75435-kube-api-access-nzdn8\") pod \"multus-additional-cni-plugins-tlgqn\" (UID: \"a5f59a7f-c973-47dd-8604-3ff59ce75435\") " pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.105615 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.105595    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgqst\" (UniqueName: \"kubernetes.io/projected/48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff-kube-api-access-hgqst\") pod \"multus-5pvht\" (UID: \"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff\") " pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.105768 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.105745    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcm45\" (UniqueName: \"kubernetes.io/projected/9cb1412e-89c2-4df1-a15c-2cd8cd50dd87-kube-api-access-bcm45\") pod \"node-resolver-vzjpl\" (UID: \"9cb1412e-89c2-4df1-a15c-2cd8cd50dd87\") " pod="openshift-dns/node-resolver-vzjpl"
Aug 05 16:39:07.105973 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.105955    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rtvh\" (UniqueName: \"kubernetes.io/projected/2c2df763-e9bb-47c8-a533-8b129eef9548-kube-api-access-8rtvh\") pod \"iptables-alerter-cr6n5\" (UID: \"2c2df763-e9bb-47c8-a533-8b129eef9548\") " pod="openshift-network-operator/iptables-alerter-cr6n5"
Aug 05 16:39:07.107502 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.107486    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45vm4\" (UniqueName: \"kubernetes.io/projected/752c87e8-d12a-4bab-b6bd-1c91d438eb38-kube-api-access-45vm4\") pod \"aws-ebs-csi-driver-node-2mkzx\" (UID: \"752c87e8-d12a-4bab-b6bd-1c91d438eb38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.206052 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.205997    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8s4cc"
Aug 05 16:39:07.215562 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:07.215534    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce9c83a_cc80_4f79_99db_ed53da98f56b.slice/crio-06a38103490d53130528850c47b2e43e898f6c2f287bfc23515dbe7094ad02c1 WatchSource:0}: Error finding container 06a38103490d53130528850c47b2e43e898f6c2f287bfc23515dbe7094ad02c1: Status 404 returned error can't find the container with id 06a38103490d53130528850c47b2e43e898f6c2f287bfc23515dbe7094ad02c1
Aug 05 16:39:07.233491 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.233447    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vzjpl"
Aug 05 16:39:07.234051 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.234033    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:39:07.241946 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:07.241925    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb1412e_89c2_4df1_a15c_2cd8cd50dd87.slice/crio-cd24d12a845dfffb89960cf7fcd3f331052106689e09210e97cbeb1aa5d43819 WatchSource:0}: Error finding container cd24d12a845dfffb89960cf7fcd3f331052106689e09210e97cbeb1aa5d43819: Status 404 returned error can't find the container with id cd24d12a845dfffb89960cf7fcd3f331052106689e09210e97cbeb1aa5d43819
Aug 05 16:39:07.242680 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.242666    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hj9wk"
Aug 05 16:39:07.251405 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:07.251386    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd4a785f_fc18_40c6_a5bc_14f4064d26ba.slice/crio-785ed87dba78c32d220a1c9d1bc811de3cae7bc443d967a55c9e4a66ef034085 WatchSource:0}: Error finding container 785ed87dba78c32d220a1c9d1bc811de3cae7bc443d967a55c9e4a66ef034085: Status 404 returned error can't find the container with id 785ed87dba78c32d220a1c9d1bc811de3cae7bc443d967a55c9e4a66ef034085
Aug 05 16:39:07.263906 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.263872    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tlgqn"
Aug 05 16:39:07.271654 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.271639    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cr6n5"
Aug 05 16:39:07.278287 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:07.278266    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f59a7f_c973_47dd_8604_3ff59ce75435.slice/crio-f9f422bc58081773d62e9678c2470904a23a305d805089877a779e99efec672a WatchSource:0}: Error finding container f9f422bc58081773d62e9678c2470904a23a305d805089877a779e99efec672a: Status 404 returned error can't find the container with id f9f422bc58081773d62e9678c2470904a23a305d805089877a779e99efec672a
Aug 05 16:39:07.292075 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:07.292053    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c2df763_e9bb_47c8_a533_8b129eef9548.slice/crio-31492a8e9de246764377b4a88e38371b9eb44cfdde82a1fbf2fd830649b14a97 WatchSource:0}: Error finding container 31492a8e9de246764377b4a88e38371b9eb44cfdde82a1fbf2fd830649b14a97: Status 404 returned error can't find the container with id 31492a8e9de246764377b4a88e38371b9eb44cfdde82a1fbf2fd830649b14a97
Aug 05 16:39:07.293396 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:07.293342    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a83236ec0dc10215cc696b78d0e7a5.slice/crio-b9295c483a384ad722ab5a347751be1ae6d00c73c8c608d7864f835e98763629 WatchSource:0}: Error finding container b9295c483a384ad722ab5a347751be1ae6d00c73c8c608d7864f835e98763629: Status 404 returned error can't find the container with id b9295c483a384ad722ab5a347751be1ae6d00c73c8c608d7864f835e98763629
Aug 05 16:39:07.299643 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.299622    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:07.308756 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:07.308735    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c240570_c8ab_4d5a_ac59_4c45cd4a9417.slice/crio-ae941a854007600d296aaa7e4fdb6df032da6b04a6bebaf9eae4a3c7657aaf7f WatchSource:0}: Error finding container ae941a854007600d296aaa7e4fdb6df032da6b04a6bebaf9eae4a3c7657aaf7f: Status 404 returned error can't find the container with id ae941a854007600d296aaa7e4fdb6df032da6b04a6bebaf9eae4a3c7657aaf7f
Aug 05 16:39:07.325068 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.325049    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx"
Aug 05 16:39:07.331297 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.331277    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5pvht"
Aug 05 16:39:07.332937 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:07.332918    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod752c87e8_d12a_4bab_b6bd_1c91d438eb38.slice/crio-dee58377d9fbd8b15b697978f47b2f9a504461b8327bf674adac11595ddaf7a2 WatchSource:0}: Error finding container dee58377d9fbd8b15b697978f47b2f9a504461b8327bf674adac11595ddaf7a2: Status 404 returned error can't find the container with id dee58377d9fbd8b15b697978f47b2f9a504461b8327bf674adac11595ddaf7a2
Aug 05 16:39:07.339321 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:07.339304    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e71b92_5b2a_4cd0_a149_cbff0b6bd4ff.slice/crio-9aa8724a27c6d57807b66fca3b84f5c1b4d58e7c5cb584da7fe92c23192757cf WatchSource:0}: Error finding container 9aa8724a27c6d57807b66fca3b84f5c1b4d58e7c5cb584da7fe92c23192757cf: Status 404 returned error can't find the container with id 9aa8724a27c6d57807b66fca3b84f5c1b4d58e7c5cb584da7fe92c23192757cf
Aug 05 16:39:07.349284 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.349267    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w5s4x"
Aug 05 16:39:07.358294 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:07.358271    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f8ada3_7b4b_4584_9d69_6ec3dd068487.slice/crio-b0f1cd70188f079d56455f43e53b019bb388a30770d1832e54841f40bef914e8 WatchSource:0}: Error finding container b0f1cd70188f079d56455f43e53b019bb388a30770d1832e54841f40bef914e8: Status 404 returned error can't find the container with id b0f1cd70188f079d56455f43e53b019bb388a30770d1832e54841f40bef914e8
Aug 05 16:39:07.414757 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.414734    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:39:07.599087 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.598998    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:07.599087 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.599062    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs\") pod \"network-metrics-daemon-8v7cz\" (UID: \"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2\") " pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:07.599310 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.599126    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:07.599310 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.599192    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret podName:19978542-a8d5-4584-b68a-6f2cf12f2461 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:08.59917022 +0000 UTC m=+3.048716499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret") pod "global-pull-secret-syncer-cjd4p" (UID: "19978542-a8d5-4584-b68a-6f2cf12f2461") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:07.599310 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.599219    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:07.599310 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.599271    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs podName:f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:08.59925427 +0000 UTC m=+3.048800551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs") pod "network-metrics-daemon-8v7cz" (UID: "f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:07.700195 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:07.700143    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtgd\" (UniqueName: \"kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd\") pod \"network-check-target-hpls5\" (UID: \"d01e7b31-b024-4f0c-bddb-1f5f35d5ddce\") " pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:07.700354 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.700342    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:39:07.700412 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.700363    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:39:07.700412 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.700376    2575 projected.go:196] Error preparing data for projected volume kube-api-access-9dtgd for pod openshift-network-diagnostics/network-check-target-hpls5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:07.700498 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:07.700453    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd podName:d01e7b31-b024-4f0c-bddb-1f5f35d5ddce nodeName:}" failed. No retries permitted until 2026-08-05 16:39:08.700430469 +0000 UTC m=+3.149976750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dtgd" (UniqueName: "kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd") pod "network-check-target-hpls5" (UID: "d01e7b31-b024-4f0c-bddb-1f5f35d5ddce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:08.008092 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.008010    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:08.008921 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:08.008157    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:08.016222 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.016153    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 16:34:07 +0000 UTC" deadline="2028-01-11 12:57:50.004008803 +0000 UTC"
Aug 05 16:39:08.016222 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.016182    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12572h18m41.987831256s"
Aug 05 16:39:08.016579 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.016525    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vzjpl" event={"ID":"9cb1412e-89c2-4df1-a15c-2cd8cd50dd87","Type":"ContainerStarted","Data":"cd24d12a845dfffb89960cf7fcd3f331052106689e09210e97cbeb1aa5d43819"}
Aug 05 16:39:08.035252 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.035219    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5pvht" event={"ID":"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff","Type":"ContainerStarted","Data":"9aa8724a27c6d57807b66fca3b84f5c1b4d58e7c5cb584da7fe92c23192757cf"}
Aug 05 16:39:08.061643 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.061133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal" event={"ID":"c3a83236ec0dc10215cc696b78d0e7a5","Type":"ContainerStarted","Data":"b9295c483a384ad722ab5a347751be1ae6d00c73c8c608d7864f835e98763629"}
Aug 05 16:39:08.092924 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.092869    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8s4cc" event={"ID":"3ce9c83a-cc80-4f79-99db-ed53da98f56b","Type":"ContainerStarted","Data":"06a38103490d53130528850c47b2e43e898f6c2f287bfc23515dbe7094ad02c1"}
Aug 05 16:39:08.130650 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.130611    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal" event={"ID":"08c34d8c3110c1c1697a169266e498d5","Type":"ContainerStarted","Data":"58d302962105fb10ca51087ed570643a768eba5581a9bae5c88c2198c506fc4f"}
Aug 05 16:39:08.151394 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.151361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w5s4x" event={"ID":"11f8ada3-7b4b-4584-9d69-6ec3dd068487","Type":"ContainerStarted","Data":"b0f1cd70188f079d56455f43e53b019bb388a30770d1832e54841f40bef914e8"}
Aug 05 16:39:08.153181 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.153154    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:39:08.175982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.175835    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx" event={"ID":"752c87e8-d12a-4bab-b6bd-1c91d438eb38","Type":"ContainerStarted","Data":"dee58377d9fbd8b15b697978f47b2f9a504461b8327bf674adac11595ddaf7a2"}
Aug 05 16:39:08.192512 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.192481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf" event={"ID":"0c240570-c8ab-4d5a-ac59-4c45cd4a9417","Type":"ContainerStarted","Data":"ae941a854007600d296aaa7e4fdb6df032da6b04a6bebaf9eae4a3c7657aaf7f"}
Aug 05 16:39:08.200976 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.200898    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cr6n5" event={"ID":"2c2df763-e9bb-47c8-a533-8b129eef9548","Type":"ContainerStarted","Data":"31492a8e9de246764377b4a88e38371b9eb44cfdde82a1fbf2fd830649b14a97"}
Aug 05 16:39:08.222790 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.222732    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlgqn" event={"ID":"a5f59a7f-c973-47dd-8604-3ff59ce75435","Type":"ContainerStarted","Data":"f9f422bc58081773d62e9678c2470904a23a305d805089877a779e99efec672a"}
Aug 05 16:39:08.248221 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.248178    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hj9wk" event={"ID":"fd4a785f-fc18-40c6-a5bc-14f4064d26ba","Type":"ContainerStarted","Data":"785ed87dba78c32d220a1c9d1bc811de3cae7bc443d967a55c9e4a66ef034085"}
Aug 05 16:39:08.608493 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.608299    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:08.608493 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.608366    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs\") pod \"network-metrics-daemon-8v7cz\" (UID: \"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2\") " pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:08.608493 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:08.608501    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:08.608807 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:08.608562    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs podName:f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:10.60854451 +0000 UTC m=+5.058090792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs") pod "network-metrics-daemon-8v7cz" (UID: "f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:08.609058 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:08.609018    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:08.609142 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:08.609074    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret podName:19978542-a8d5-4584-b68a-6f2cf12f2461 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:10.609057069 +0000 UTC m=+5.058603369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret") pod "global-pull-secret-syncer-cjd4p" (UID: "19978542-a8d5-4584-b68a-6f2cf12f2461") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:08.709250 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:08.709216    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtgd\" (UniqueName: \"kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd\") pod \"network-check-target-hpls5\" (UID: \"d01e7b31-b024-4f0c-bddb-1f5f35d5ddce\") " pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:08.709479 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:08.709449    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:39:08.709479 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:08.709476    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:39:08.709594 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:08.709491    2575 projected.go:196] Error preparing data for projected volume kube-api-access-9dtgd for pod openshift-network-diagnostics/network-check-target-hpls5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:08.709594 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:08.709548    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd podName:d01e7b31-b024-4f0c-bddb-1f5f35d5ddce nodeName:}" failed. No retries permitted until 2026-08-05 16:39:10.709528272 +0000 UTC m=+5.159074553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dtgd" (UniqueName: "kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd") pod "network-check-target-hpls5" (UID: "d01e7b31-b024-4f0c-bddb-1f5f35d5ddce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:09.008242 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:09.008150    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:09.008728 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:09.008289    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:09.008728 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:09.008701    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:09.008854 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:09.008820    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:09.019539 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:09.019412    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 16:34:07 +0000 UTC" deadline="2028-03-07 20:34:43.439772967 +0000 UTC"
Aug 05 16:39:09.019539 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:09.019504    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13923h55m34.42027321s"
Aug 05 16:39:09.639655 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:09.639593    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:39:10.011995 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:10.011495    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:10.011995 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:10.011628    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:10.626977 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:10.626942    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:10.627149 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:10.627006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs\") pod \"network-metrics-daemon-8v7cz\" (UID: \"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2\") " pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:10.627149 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:10.627126    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:10.627271 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:10.627180    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs podName:f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:14.627161295 +0000 UTC m=+9.076707573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs") pod "network-metrics-daemon-8v7cz" (UID: "f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:10.627582 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:10.627560    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:10.627664 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:10.627619    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret podName:19978542-a8d5-4584-b68a-6f2cf12f2461 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:14.627604799 +0000 UTC m=+9.077151080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret") pod "global-pull-secret-syncer-cjd4p" (UID: "19978542-a8d5-4584-b68a-6f2cf12f2461") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:10.728017 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:10.727939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtgd\" (UniqueName: \"kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd\") pod \"network-check-target-hpls5\" (UID: \"d01e7b31-b024-4f0c-bddb-1f5f35d5ddce\") " pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:10.728219 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:10.728166    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:39:10.728219 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:10.728185    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:39:10.728219 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:10.728197    2575 projected.go:196] Error preparing data for projected volume kube-api-access-9dtgd for pod openshift-network-diagnostics/network-check-target-hpls5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:10.728388 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:10.728251    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd podName:d01e7b31-b024-4f0c-bddb-1f5f35d5ddce nodeName:}" failed. No retries permitted until 2026-08-05 16:39:14.728234066 +0000 UTC m=+9.177780366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dtgd" (UniqueName: "kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd") pod "network-check-target-hpls5" (UID: "d01e7b31-b024-4f0c-bddb-1f5f35d5ddce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:11.008721 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:11.008648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:11.008894 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:11.008788    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:11.009267 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:11.009100    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:11.009267 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:11.009206    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:12.008634 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:12.008143    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:12.008634 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:12.008282    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:13.008090 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:13.008053    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:13.008274 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:13.008104    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:13.008274 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:13.008192    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:13.008274 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:13.008263    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:14.008703 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:14.008674    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:14.009168 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:14.008833    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:14.660898 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:14.660859    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs\") pod \"network-metrics-daemon-8v7cz\" (UID: \"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2\") " pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:14.661100 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:14.660933    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:14.661100 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:14.661046    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:14.661100 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:14.661065    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:14.661258 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:14.661108    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret podName:19978542-a8d5-4584-b68a-6f2cf12f2461 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:22.661092253 +0000 UTC m=+17.110638530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret") pod "global-pull-secret-syncer-cjd4p" (UID: "19978542-a8d5-4584-b68a-6f2cf12f2461") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:14.661258 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:14.661123    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs podName:f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:22.661116316 +0000 UTC m=+17.110662593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs") pod "network-metrics-daemon-8v7cz" (UID: "f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:14.762047 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:14.762008    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtgd\" (UniqueName: \"kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd\") pod \"network-check-target-hpls5\" (UID: \"d01e7b31-b024-4f0c-bddb-1f5f35d5ddce\") " pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:14.762218 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:14.762169    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:39:14.762218 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:14.762191    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:39:14.762218 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:14.762204    2575 projected.go:196] Error preparing data for projected volume kube-api-access-9dtgd for pod openshift-network-diagnostics/network-check-target-hpls5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:14.762348 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:14.762255    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd podName:d01e7b31-b024-4f0c-bddb-1f5f35d5ddce nodeName:}" failed. No retries permitted until 2026-08-05 16:39:22.762242216 +0000 UTC m=+17.211788497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dtgd" (UniqueName: "kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd") pod "network-check-target-hpls5" (UID: "d01e7b31-b024-4f0c-bddb-1f5f35d5ddce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:15.008565 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:15.008491    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:15.008730 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:15.008615    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:15.008730 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:15.008699    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:15.009152 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:15.008786    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:16.010280 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:16.010245    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:16.010734 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:16.010353    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:17.008361 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:17.008321    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:17.008530 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:17.008487    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:17.008783 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:17.008330    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:17.008783 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:17.008748    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:18.008661 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:18.008622    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:18.009164 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:18.008756    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:19.008245 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:19.008212    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:19.008415 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:19.008331    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:19.008415 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:19.008389    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:19.008522 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:19.008501    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:20.008306 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:20.008270    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:20.008845 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:20.008398    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:21.007950 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:21.007922    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:21.008125 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:21.007924    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:21.008125 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:21.008029    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:21.008125 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:21.008103    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:22.008138 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:22.008104    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:22.008605 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:22.008238    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:22.719823 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:22.719767    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:22.720059 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:22.719868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs\") pod \"network-metrics-daemon-8v7cz\" (UID: \"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2\") " pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:22.720059 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:22.719963    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:22.720059 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:22.720024    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:22.720059 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:22.720044    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret podName:19978542-a8d5-4584-b68a-6f2cf12f2461 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:38.720023811 +0000 UTC m=+33.169570091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret") pod "global-pull-secret-syncer-cjd4p" (UID: "19978542-a8d5-4584-b68a-6f2cf12f2461") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:22.720242 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:22.720085    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs podName:f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:38.720066847 +0000 UTC m=+33.169613156 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs") pod "network-metrics-daemon-8v7cz" (UID: "f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:22.820713 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:22.820678    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtgd\" (UniqueName: \"kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd\") pod \"network-check-target-hpls5\" (UID: \"d01e7b31-b024-4f0c-bddb-1f5f35d5ddce\") " pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:22.820961 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:22.820836    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:39:22.820961 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:22.820855    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:39:22.820961 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:22.820869    2575 projected.go:196] Error preparing data for projected volume kube-api-access-9dtgd for pod openshift-network-diagnostics/network-check-target-hpls5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:22.820961 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:22.820931    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd podName:d01e7b31-b024-4f0c-bddb-1f5f35d5ddce nodeName:}" failed. No retries permitted until 2026-08-05 16:39:38.820912219 +0000 UTC m=+33.270458497 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dtgd" (UniqueName: "kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd") pod "network-check-target-hpls5" (UID: "d01e7b31-b024-4f0c-bddb-1f5f35d5ddce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:23.008616 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:23.008542    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:23.009085 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:23.008666    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:23.009085 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:23.008728    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:23.009085 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:23.008853    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:24.008558 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:24.008526    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:24.008745 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:24.008658    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:25.008381 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:25.008342    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:25.008567 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:25.008466    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:25.008624 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:25.008594    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:25.008740 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:25.008721    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:26.008818 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:26.008773    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:26.009253 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:26.008890    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:27.007814 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:27.007778    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:27.007928 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:27.007786    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:27.007978 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:27.007875    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:27.007978 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:27.007966    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:27.305138 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:27.304909    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5pvht" event={"ID":"48e71b92-5b2a-4cd0-a149-cbff0b6bd4ff","Type":"ContainerStarted","Data":"8f321505d82fbd7ad3afbc044bba39468ec6ed46e06507f79076144a9995e2e6"}
Aug 05 16:39:27.306505 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:27.306484    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal" event={"ID":"c3a83236ec0dc10215cc696b78d0e7a5","Type":"ContainerStarted","Data":"17ad464e59aa937e06ee6924fdccec7c3e3de8e9da2f85041eda698757ff9b10"}
Aug 05 16:39:27.306620 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:27.306604    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:27.307957 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:27.307936    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8s4cc" event={"ID":"3ce9c83a-cc80-4f79-99db-ed53da98f56b","Type":"ContainerStarted","Data":"774a13b7b54e33842b3ba5d06e313aaf739e75d82528024a9550a07ad52eb3fb"}
Aug 05 16:39:27.320357 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:27.320341    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 16:39:27.320900 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:27.320884    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"]
Aug 05 16:39:27.323080 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:27.323048    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5pvht" podStartSLOduration=1.518018168 podStartE2EDuration="21.323036212s" totalImagesPullingTime="19.805018044s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:27.32278381 +0000 UTC m=+21.772330109" watchObservedRunningTime="2026-08-05 16:39:27.323036212 +0000 UTC m=+21.772582512"
Aug 05 16:39:27.337688 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:27.337652    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal" podStartSLOduration=0.337641724 podStartE2EDuration="337.641724ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:27.337335916 +0000 UTC m=+21.786882215" watchObservedRunningTime="2026-08-05 16:39:27.337641724 +0000 UTC m=+21.787188022"
Aug 05 16:39:27.354266 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:27.354233    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8s4cc" podStartSLOduration=1.483059624 podStartE2EDuration="21.354221566s" totalImagesPullingTime="19.871161942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:27.354199086 +0000 UTC m=+21.803745385" watchObservedRunningTime="2026-08-05 16:39:27.354221566 +0000 UTC m=+21.803767860"
Aug 05 16:39:28.008276 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.007988    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:28.008435 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:28.008411    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:28.312861 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.312788    2575 generic.go:356] "Generic (PLEG): container finished" podID="a5f59a7f-c973-47dd-8604-3ff59ce75435" containerID="58d8241742ec3faaee110a1ec71dcaccfc8cfbca4bf5af5b8a994099d944e7de" exitCode=0
Aug 05 16:39:28.313549 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.312873    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlgqn" event={"ID":"a5f59a7f-c973-47dd-8604-3ff59ce75435","Type":"ContainerDied","Data":"58d8241742ec3faaee110a1ec71dcaccfc8cfbca4bf5af5b8a994099d944e7de"}
Aug 05 16:39:28.314382 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.314346    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hj9wk" event={"ID":"fd4a785f-fc18-40c6-a5bc-14f4064d26ba","Type":"ContainerStarted","Data":"dc7865c7bfef76780ad181a02246856fb7d2c5aff85c2e5dd9fb4f0d3ab6292c"}
Aug 05 16:39:28.315837 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.315795    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vzjpl" event={"ID":"9cb1412e-89c2-4df1-a15c-2cd8cd50dd87","Type":"ContainerStarted","Data":"5736507c39401e4a5780ab42fb00858deb8299281434fcf5193bac2c43601e59"}
Aug 05 16:39:28.317289 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.317267    2575 generic.go:356] "Generic (PLEG): container finished" podID="08c34d8c3110c1c1697a169266e498d5" containerID="1e9ad45db7831f9934e5dd43a2fd6950a76dd3ec1179d3353f9e6e64311ea762" exitCode=0
Aug 05 16:39:28.317370 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.317346    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal" event={"ID":"08c34d8c3110c1c1697a169266e498d5","Type":"ContainerDied","Data":"1e9ad45db7831f9934e5dd43a2fd6950a76dd3ec1179d3353f9e6e64311ea762"}
Aug 05 16:39:28.318856 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.318832    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w5s4x" event={"ID":"11f8ada3-7b4b-4584-9d69-6ec3dd068487","Type":"ContainerStarted","Data":"61bd668c3b8a1d138a83ab9331c7833b99aa2409b40a89a62bcf4b09c327fec2"}
Aug 05 16:39:28.320362 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.320340    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx" event={"ID":"752c87e8-d12a-4bab-b6bd-1c91d438eb38","Type":"ContainerStarted","Data":"7b52a0edd3abd6e6e6f61c73ceb8d63c33db8549f6bca1334bb71c55a61492f7"}
Aug 05 16:39:28.322773 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.322759    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 16:39:28.323076 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.323057    2575 generic.go:356] "Generic (PLEG): container finished" podID="0c240570-c8ab-4d5a-ac59-4c45cd4a9417" containerID="4d6f4cd2f2cb3932337e35bc1c97ab6382795ed101f62f3bf726d98f85ee8b12" exitCode=1
Aug 05 16:39:28.323141 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.323129    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf" event={"ID":"0c240570-c8ab-4d5a-ac59-4c45cd4a9417","Type":"ContainerStarted","Data":"25fb61610d7ab4eb4c4a09fb1c53463e4e6808595211876262ee58a6e17a3c45"}
Aug 05 16:39:28.323194 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.323183    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf" event={"ID":"0c240570-c8ab-4d5a-ac59-4c45cd4a9417","Type":"ContainerStarted","Data":"726255641a97a2349dfe3b4c9068eaeab4ab12dcce0cbc8ced1762720cc67702"}
Aug 05 16:39:28.323229 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.323217    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf" event={"ID":"0c240570-c8ab-4d5a-ac59-4c45cd4a9417","Type":"ContainerStarted","Data":"766dd81fc89f39ab88b6e5926093eea6f6e238788abe0a07d9b9d72161dd5fdd"}
Aug 05 16:39:28.323262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.323247    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf" event={"ID":"0c240570-c8ab-4d5a-ac59-4c45cd4a9417","Type":"ContainerStarted","Data":"b18a05778e7c3d959db7d7a3bedaaade1f88f61727abc7019ad58b68a2d21200"}
Aug 05 16:39:28.323290 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.323276    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf" event={"ID":"0c240570-c8ab-4d5a-ac59-4c45cd4a9417","Type":"ContainerStarted","Data":"0ec5f8f9d2cc335ab28bc74ed2d298a3b0e957759da02f7a0cbc3c5e835ee414"}
Aug 05 16:39:28.323319 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.323303    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf" event={"ID":"0c240570-c8ab-4d5a-ac59-4c45cd4a9417","Type":"ContainerDied","Data":"4d6f4cd2f2cb3932337e35bc1c97ab6382795ed101f62f3bf726d98f85ee8b12"}
Aug 05 16:39:28.323553 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.323539    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:28.334826 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.334791    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 16:39:28.334921 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:28.334875    2575 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-130-35.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Aug 05 16:39:28.351894 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.351844    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vzjpl" podStartSLOduration=2.507297392 podStartE2EDuration="22.351828673s" totalImagesPullingTime="19.844531281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:28.351695218 +0000 UTC m=+22.801241522" watchObservedRunningTime="2026-08-05 16:39:28.351828673 +0000 UTC m=+22.801374979"
Aug 05 16:39:28.367322 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.367155    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hj9wk" podStartSLOduration=2.53622268 podStartE2EDuration="22.367142555s" totalImagesPullingTime="19.830919875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:28.366329688 +0000 UTC m=+22.815875989" watchObservedRunningTime="2026-08-05 16:39:28.367142555 +0000 UTC m=+22.816688854"
Aug 05 16:39:28.382180 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.382137    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w5s4x" podStartSLOduration=2.657430592 podStartE2EDuration="22.382124893s" totalImagesPullingTime="19.724694301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:28.381949792 +0000 UTC m=+22.831496091" watchObservedRunningTime="2026-08-05 16:39:28.382124893 +0000 UTC m=+22.831671189"
Aug 05 16:39:28.462315 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.462272    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:28.538263 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:28.538221    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:29.008339 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:29.008230    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:29.008339 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:29.008265    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:29.008581 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:29.008361    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:29.008581 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:29.008499    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:29.327631 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:29.327320    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cr6n5" event={"ID":"2c2df763-e9bb-47c8-a533-8b129eef9548","Type":"ContainerStarted","Data":"58707b98abc3422ae803c19e7ede21194e49ebd1831f2486c14918a7f75fa368"}
Aug 05 16:39:29.329358 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:29.329332    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal" event={"ID":"08c34d8c3110c1c1697a169266e498d5","Type":"ContainerStarted","Data":"1061ffc3e75a739a3075c5c16b685a07b4d0f4cf281852ca0c84262f59c77648"}
Aug 05 16:39:29.344510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:29.344460    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cr6n5" podStartSLOduration=3.553503337 podStartE2EDuration="23.34444732s" totalImagesPullingTime="19.790943983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:29.344422742 +0000 UTC m=+23.793969042" watchObservedRunningTime="2026-08-05 16:39:29.34444732 +0000 UTC m=+23.793993618"
Aug 05 16:39:29.360002 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:29.359953    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal" podStartSLOduration=23.359935741 podStartE2EDuration="23.359935741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:29.359188887 +0000 UTC m=+23.808735199" watchObservedRunningTime="2026-08-05 16:39:29.359935741 +0000 UTC m=+23.809482041"
Aug 05 16:39:29.468367 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:29.468323    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:29.531346 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:29.531304    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:29.848037 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:29.848014    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 05 16:39:29.963918 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:29.963775    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T16:39:29.848031492Z","UUID":"6adf4a82-6e4e-4e09-9ad6-b0673f32d82c","Handler":null,"Name":"","Endpoint":""}
Aug 05 16:39:29.965341 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:29.965305    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 05 16:39:29.965341 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:29.965343    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 05 16:39:29.996243 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:29.996218    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w5s4x"
Aug 05 16:39:29.996931 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:29.996912    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w5s4x"
Aug 05 16:39:30.008783 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:30.008760    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:30.008920 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:30.008858    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:30.167408 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:30.167378    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w5s4x"
Aug 05 16:39:30.167915 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:30.167895    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w5s4x"
Aug 05 16:39:30.232439 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:30.232370    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:30.333470 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:30.333438    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx" event={"ID":"752c87e8-d12a-4bab-b6bd-1c91d438eb38","Type":"ContainerStarted","Data":"66f315b60d5a1e867fab18391f6ec5cccbce68a7f02d4d2967f185b2298da489"}
Aug 05 16:39:30.337143 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:30.337119    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 16:39:30.337631 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:30.337605    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf" event={"ID":"0c240570-c8ab-4d5a-ac59-4c45cd4a9417","Type":"ContainerStarted","Data":"585e2eb9d567f8f7ce53cf535eb987869ec3f207d0b411dacd670f01e2648720"}
Aug 05 16:39:30.536176 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:30.536100    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:30.606100 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:30.606067    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:31.008629 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:31.008599    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:31.008883 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:31.008725    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:31.008883 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:31.008766    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:31.009000 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:31.008881    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:31.342931 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:31.342841    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx" event={"ID":"752c87e8-d12a-4bab-b6bd-1c91d438eb38","Type":"ContainerStarted","Data":"c8f5f1c3b5c48e281d30df0ce8d765769b6d9dddd27cd2aeb78eabd812f73f9a"}
Aug 05 16:39:31.369525 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:31.369482    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mkzx" podStartSLOduration=2.821647451 podStartE2EDuration="25.369469118s" totalImagesPullingTime="22.547821667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:39:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:31.368984473 +0000 UTC m=+25.818530771" watchObservedRunningTime="2026-08-05 16:39:31.369469118 +0000 UTC m=+25.819015417"
Aug 05 16:39:32.008176 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:32.008141    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:32.008465 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:32.008271    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:33.008584 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:33.008555    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:33.009052 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:33.008556    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:33.009052 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:33.008670    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:33.009052 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:33.008768    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:34.008148 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:34.007996    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:34.008289 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:34.008219    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:34.352958 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:34.352892    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 16:39:34.353751 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:34.353234    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf" event={"ID":"0c240570-c8ab-4d5a-ac59-4c45cd4a9417","Type":"ContainerStarted","Data":"acd74e36c92c48157c44c212352f8dde5d5cc601cf484c61133f59a8354fad35"}
Aug 05 16:39:34.353751 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:34.353634    2575 scope.go:117] "RemoveContainer" containerID="4d6f4cd2f2cb3932337e35bc1c97ab6382795ed101f62f3bf726d98f85ee8b12"
Aug 05 16:39:34.353751 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:34.353641    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:34.353751 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:34.353716    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:34.353958 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:34.353765    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:34.355237 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:34.355212    2575 generic.go:356] "Generic (PLEG): container finished" podID="a5f59a7f-c973-47dd-8604-3ff59ce75435" containerID="c3c8929d95c01e1fa2b441b6804ee807962a95dbb1b64a8652bc840c6eef183e" exitCode=0
Aug 05 16:39:34.355367 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:34.355249    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlgqn" event={"ID":"a5f59a7f-c973-47dd-8604-3ff59ce75435","Type":"ContainerDied","Data":"c3c8929d95c01e1fa2b441b6804ee807962a95dbb1b64a8652bc840c6eef183e"}
Aug 05 16:39:34.368625 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:34.368601    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:34.370004 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:34.369984    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:34.370653 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:34.370637    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:39:34.503129 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:34.503090    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:35.008002 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.007969    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:35.008002 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.007995    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:35.008322 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:35.008076    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:35.008322 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:35.008222    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:35.177639 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.177610    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:35.307264 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.307044    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:35.361350 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.361329    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 16:39:35.361752 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.361685    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf" event={"ID":"0c240570-c8ab-4d5a-ac59-4c45cd4a9417","Type":"ContainerStarted","Data":"28f4b47a77fbddf32c902806878d16f4617bb159e2452c41dafe2b9350bec815"}
Aug 05 16:39:35.395999 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.395949    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf" podStartSLOduration=9.560308329 podStartE2EDuration="29.395931883s" totalImagesPullingTime="19.835623554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:35.394695244 +0000 UTC m=+29.844241542" watchObservedRunningTime="2026-08-05 16:39:35.395931883 +0000 UTC m=+29.845478179"
Aug 05 16:39:35.615311 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.615203    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:35.672207 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.672178    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cjd4p"]
Aug 05 16:39:35.672403 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.672320    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:35.672610 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:35.672438    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:35.675209 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.675031    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8v7cz"]
Aug 05 16:39:35.675209 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.675135    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:35.675353 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:35.675238    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:35.675751 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.675721    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hpls5"]
Aug 05 16:39:35.675751 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.675821    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:35.675751 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:35.675911    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:35.716849 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.716801    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:35.820018 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.819990    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:35.899436 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:35.899380    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:36.365840 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:36.365788    2575 generic.go:356] "Generic (PLEG): container finished" podID="a5f59a7f-c973-47dd-8604-3ff59ce75435" containerID="7f058bbb48b6b9a147cd60b3dc9159f605e69b3615d89467cfdd7d39adecdb19" exitCode=0
Aug 05 16:39:36.366239 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:36.365875    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlgqn" event={"ID":"a5f59a7f-c973-47dd-8604-3ff59ce75435","Type":"ContainerDied","Data":"7f058bbb48b6b9a147cd60b3dc9159f605e69b3615d89467cfdd7d39adecdb19"}
Aug 05 16:39:37.008254 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:37.008180    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:37.008392 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:37.008270    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:37.008392 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:37.008284    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:37.008392 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:37.008283    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:37.008392 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:37.008366    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:37.008540 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:37.008420    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:38.371851 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:38.371817    2575 generic.go:356] "Generic (PLEG): container finished" podID="a5f59a7f-c973-47dd-8604-3ff59ce75435" containerID="386bc49eadaf9f79a97996afc44685178908f10d4d6fcc30172efa8a43c5365c" exitCode=0
Aug 05 16:39:38.372219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:38.371863    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlgqn" event={"ID":"a5f59a7f-c973-47dd-8604-3ff59ce75435","Type":"ContainerDied","Data":"386bc49eadaf9f79a97996afc44685178908f10d4d6fcc30172efa8a43c5365c"}
Aug 05 16:39:38.739015 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:38.738972    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:38.739199 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:38.739033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs\") pod \"network-metrics-daemon-8v7cz\" (UID: \"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2\") " pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:38.739199 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:38.739132    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:38.739199 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:38.739169    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:38.739199 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:38.739201    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret podName:19978542-a8d5-4584-b68a-6f2cf12f2461 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:10.739183641 +0000 UTC m=+65.188729919 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret") pod "global-pull-secret-syncer-cjd4p" (UID: "19978542-a8d5-4584-b68a-6f2cf12f2461") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:38.739358 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:38.739224    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs podName:f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:10.73920802 +0000 UTC m=+65.188754301 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs") pod "network-metrics-daemon-8v7cz" (UID: "f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:38.839326 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:38.839272    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtgd\" (UniqueName: \"kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd\") pod \"network-check-target-hpls5\" (UID: \"d01e7b31-b024-4f0c-bddb-1f5f35d5ddce\") " pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:38.839479 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:38.839425    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:39:38.839479 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:38.839443    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:39:38.839479 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:38.839453    2575 projected.go:196] Error preparing data for projected volume kube-api-access-9dtgd for pod openshift-network-diagnostics/network-check-target-hpls5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:38.839576 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:38.839499    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd podName:d01e7b31-b024-4f0c-bddb-1f5f35d5ddce nodeName:}" failed. No retries permitted until 2026-08-05 16:40:10.839486889 +0000 UTC m=+65.289033166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dtgd" (UniqueName: "kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd") pod "network-check-target-hpls5" (UID: "d01e7b31-b024-4f0c-bddb-1f5f35d5ddce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:39.008517 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.008489    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:39.008683 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.008493    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:39.008683 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:39.008581    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjd4p" podUID="19978542-a8d5-4584-b68a-6f2cf12f2461"
Aug 05 16:39:39.008683 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:39.008672    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpls5" podUID="d01e7b31-b024-4f0c-bddb-1f5f35d5ddce"
Aug 05 16:39:39.008791 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.008495    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:39.008791 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:39.008749    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v7cz" podUID="f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2"
Aug 05 16:39:39.888446 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.888413    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeReady"
Aug 05 16:39:39.888898 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.888542    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 05 16:39:39.947495 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.947463    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-45ltw"]
Aug 05 16:39:39.951477 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.951451    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:39.956720 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.956675    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 05 16:39:39.956959 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.956942    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p9jdc\""
Aug 05 16:39:39.957922 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.957716    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jbgzp"]
Aug 05 16:39:39.961866 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.961848    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jbgzp"
Aug 05 16:39:39.963132 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.962950    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 05 16:39:39.964482 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.964461    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jb59q\""
Aug 05 16:39:39.964596 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.964528    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 05 16:39:39.964663 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.964595    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 05 16:39:39.964770 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.964754    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 05 16:39:39.972464 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.972448    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-45ltw"]
Aug 05 16:39:39.976476 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:39.976455    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jbgzp"]
Aug 05 16:39:40.048903 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.048850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d629bd8-964f-4458-93bc-d7719b91491c-config-volume\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:40.048903 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.048893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d629bd8-964f-4458-93bc-d7719b91491c-tmp-dir\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:40.049065 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.048940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:40.049065 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.049021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmkwp\" (UniqueName: \"kubernetes.io/projected/6d629bd8-964f-4458-93bc-d7719b91491c-kube-api-access-dmkwp\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:40.049065 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.049055    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87px8\" (UniqueName: \"kubernetes.io/projected/ef4eeedd-04e8-4f1f-892c-67192a3c0ffc-kube-api-access-87px8\") pod \"ingress-canary-jbgzp\" (UID: \"ef4eeedd-04e8-4f1f-892c-67192a3c0ffc\") " pod="openshift-ingress-canary/ingress-canary-jbgzp"
Aug 05 16:39:40.049256 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.049074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef4eeedd-04e8-4f1f-892c-67192a3c0ffc-cert\") pod \"ingress-canary-jbgzp\" (UID: \"ef4eeedd-04e8-4f1f-892c-67192a3c0ffc\") " pod="openshift-ingress-canary/ingress-canary-jbgzp"
Aug 05 16:39:40.150191 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.150166    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d629bd8-964f-4458-93bc-d7719b91491c-tmp-dir\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:40.150324 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.150208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:40.150324 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.150247    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmkwp\" (UniqueName: \"kubernetes.io/projected/6d629bd8-964f-4458-93bc-d7719b91491c-kube-api-access-dmkwp\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:40.150324 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.150263    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87px8\" (UniqueName: \"kubernetes.io/projected/ef4eeedd-04e8-4f1f-892c-67192a3c0ffc-kube-api-access-87px8\") pod \"ingress-canary-jbgzp\" (UID: \"ef4eeedd-04e8-4f1f-892c-67192a3c0ffc\") " pod="openshift-ingress-canary/ingress-canary-jbgzp"
Aug 05 16:39:40.150324 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.150285    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef4eeedd-04e8-4f1f-892c-67192a3c0ffc-cert\") pod \"ingress-canary-jbgzp\" (UID: \"ef4eeedd-04e8-4f1f-892c-67192a3c0ffc\") " pod="openshift-ingress-canary/ingress-canary-jbgzp"
Aug 05 16:39:40.150480 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.150326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d629bd8-964f-4458-93bc-d7719b91491c-config-volume\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:40.150480 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:40.150406    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:39:40.150480 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:40.150470    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls podName:6d629bd8-964f-4458-93bc-d7719b91491c nodeName:}" failed. No retries permitted until 2026-08-05 16:39:40.650449847 +0000 UTC m=+35.099996124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls") pod "dns-default-45ltw" (UID: "6d629bd8-964f-4458-93bc-d7719b91491c") : secret "dns-default-metrics-tls" not found
Aug 05 16:39:40.150607 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.150511    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d629bd8-964f-4458-93bc-d7719b91491c-tmp-dir\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:40.150890 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.150869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d629bd8-964f-4458-93bc-d7719b91491c-config-volume\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:40.155216 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.155091    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef4eeedd-04e8-4f1f-892c-67192a3c0ffc-cert\") pod \"ingress-canary-jbgzp\" (UID: \"ef4eeedd-04e8-4f1f-892c-67192a3c0ffc\") " pod="openshift-ingress-canary/ingress-canary-jbgzp"
Aug 05 16:39:40.166780 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.166759    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmkwp\" (UniqueName: \"kubernetes.io/projected/6d629bd8-964f-4458-93bc-d7719b91491c-kube-api-access-dmkwp\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:40.168370 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.168353    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87px8\" (UniqueName: \"kubernetes.io/projected/ef4eeedd-04e8-4f1f-892c-67192a3c0ffc-kube-api-access-87px8\") pod \"ingress-canary-jbgzp\" (UID: \"ef4eeedd-04e8-4f1f-892c-67192a3c0ffc\") " pod="openshift-ingress-canary/ingress-canary-jbgzp"
Aug 05 16:39:40.173139 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.173115    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:40.272791 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.272749    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jbgzp"
Aug 05 16:39:40.436231 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.436201    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jbgzp"]
Aug 05 16:39:40.439865 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:39:40.439835    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef4eeedd_04e8_4f1f_892c_67192a3c0ffc.slice/crio-05ae2b9c8d964fee855fccce596f5cf6ba5f897ece3b5e4ae663e5660c2f3e6f WatchSource:0}: Error finding container 05ae2b9c8d964fee855fccce596f5cf6ba5f897ece3b5e4ae663e5660c2f3e6f: Status 404 returned error can't find the container with id 05ae2b9c8d964fee855fccce596f5cf6ba5f897ece3b5e4ae663e5660c2f3e6f
Aug 05 16:39:40.655891 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:40.655860    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:40.656050 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:40.656035    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:39:40.656137 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:40.656123    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls podName:6d629bd8-964f-4458-93bc-d7719b91491c nodeName:}" failed. No retries permitted until 2026-08-05 16:39:41.656095563 +0000 UTC m=+36.105641856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls") pod "dns-default-45ltw" (UID: "6d629bd8-964f-4458-93bc-d7719b91491c") : secret "dns-default-metrics-tls" not found
Aug 05 16:39:41.008299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:41.008213    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:39:41.008299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:41.008256    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:39:41.008299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:41.008257    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:39:41.019762 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:41.019741    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 16:39:41.019914 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:41.019745    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 16:39:41.020549 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:41.020528    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 16:39:41.020660 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:41.020593    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 16:39:41.020660 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:41.020624    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7qbz9\""
Aug 05 16:39:41.020783 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:41.020766    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cn6w5\""
Aug 05 16:39:41.382931 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:41.382847    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jbgzp" event={"ID":"ef4eeedd-04e8-4f1f-892c-67192a3c0ffc","Type":"ContainerStarted","Data":"05ae2b9c8d964fee855fccce596f5cf6ba5f897ece3b5e4ae663e5660c2f3e6f"}
Aug 05 16:39:41.665692 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:41.665637    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:41.665893 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:41.665863    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:39:41.666012 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:41.665973    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls podName:6d629bd8-964f-4458-93bc-d7719b91491c nodeName:}" failed. No retries permitted until 2026-08-05 16:39:43.665926368 +0000 UTC m=+38.115472646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls") pod "dns-default-45ltw" (UID: "6d629bd8-964f-4458-93bc-d7719b91491c") : secret "dns-default-metrics-tls" not found
Aug 05 16:39:43.678621 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:43.678587    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:43.679194 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:43.678760    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:39:43.679194 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:43.678855    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls podName:6d629bd8-964f-4458-93bc-d7719b91491c nodeName:}" failed. No retries permitted until 2026-08-05 16:39:47.678836628 +0000 UTC m=+42.128382926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls") pod "dns-default-45ltw" (UID: "6d629bd8-964f-4458-93bc-d7719b91491c") : secret "dns-default-metrics-tls" not found
Aug 05 16:39:44.327572 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:44.327541    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:44.394370 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:44.394344    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlgqn" event={"ID":"a5f59a7f-c973-47dd-8604-3ff59ce75435","Type":"ContainerStarted","Data":"a88572aa044a5382f89ab99d38f5bf99bf9977df236189c74a3dac37aef50ff8"}
Aug 05 16:39:44.396337 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:44.396314    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jbgzp" event={"ID":"ef4eeedd-04e8-4f1f-892c-67192a3c0ffc","Type":"ContainerStarted","Data":"bcd06cd455ef4fde2a65a1a3dee01a98a612032a15b8e34e90ef1d6ab46d5974"}
Aug 05 16:39:44.423310 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:44.423280    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:45.401402 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:45.401323    2575 generic.go:356] "Generic (PLEG): container finished" podID="a5f59a7f-c973-47dd-8604-3ff59ce75435" containerID="a88572aa044a5382f89ab99d38f5bf99bf9977df236189c74a3dac37aef50ff8" exitCode=0
Aug 05 16:39:45.401877 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:45.401409    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlgqn" event={"ID":"a5f59a7f-c973-47dd-8604-3ff59ce75435","Type":"ContainerDied","Data":"a88572aa044a5382f89ab99d38f5bf99bf9977df236189c74a3dac37aef50ff8"}
Aug 05 16:39:45.443006 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:45.442970    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jbgzp" podStartSLOduration=2.602355782 podStartE2EDuration="6.442955655s" totalImagesPullingTime="3.840599873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:45.441959799 +0000 UTC m=+39.891506099" watchObservedRunningTime="2026-08-05 16:39:45.442955655 +0000 UTC m=+39.892501954"
Aug 05 16:39:46.406355 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:46.406321    2575 generic.go:356] "Generic (PLEG): container finished" podID="a5f59a7f-c973-47dd-8604-3ff59ce75435" containerID="45e804ca361a0e6683c7106de6b69499f91f9926298822b91def53b39d1e56ed" exitCode=0
Aug 05 16:39:46.406723 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:46.406376    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlgqn" event={"ID":"a5f59a7f-c973-47dd-8604-3ff59ce75435","Type":"ContainerDied","Data":"45e804ca361a0e6683c7106de6b69499f91f9926298822b91def53b39d1e56ed"}
Aug 05 16:39:47.411653 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:47.411622    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlgqn" event={"ID":"a5f59a7f-c973-47dd-8604-3ff59ce75435","Type":"ContainerStarted","Data":"cbcb86b2a1a2f458288d20d5c5962c634647ec0517313f56f8fcbe5246d97865"}
Aug 05 16:39:47.436601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:47.436552    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tlgqn" podStartSLOduration=7.77080622 podStartE2EDuration="41.436536835s" totalImagesPullingTime="33.665730615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:39:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:47.435800816 +0000 UTC m=+41.885347115" watchObservedRunningTime="2026-08-05 16:39:47.436536835 +0000 UTC m=+41.886083133"
Aug 05 16:39:47.559372 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:47.559333    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:47.658971 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:47.658946    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:47.706241 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:47.706167    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:47.706370 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:47.706307    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:39:47.706370 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:47.706356    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls podName:6d629bd8-964f-4458-93bc-d7719b91491c nodeName:}" failed. No retries permitted until 2026-08-05 16:39:55.706342884 +0000 UTC m=+50.155889160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls") pod "dns-default-45ltw" (UID: "6d629bd8-964f-4458-93bc-d7719b91491c") : secret "dns-default-metrics-tls" not found
Aug 05 16:39:48.292256 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:48.292225    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:48.420953 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:48.420926    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:55.757226 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:55.757194    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:39:55.757684 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:55.757339    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:39:55.757684 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:39:55.757404    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls podName:6d629bd8-964f-4458-93bc-d7719b91491c nodeName:}" failed. No retries permitted until 2026-08-05 16:40:11.757389811 +0000 UTC m=+66.206936088 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls") pod "dns-default-45ltw" (UID: "6d629bd8-964f-4458-93bc-d7719b91491c") : secret "dns-default-metrics-tls" not found
Aug 05 16:39:56.367423 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:56.367355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:56.467495 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:39:56.467464    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:06.378693 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:06.378669    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5rjf"
Aug 05 16:40:06.598490 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:06.598459    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:06.672682 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:06.672655    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:06.732197 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:06.732167    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:09.907687 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:09.907655    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-pqb7z"]
Aug 05 16:40:09.910325 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:09.910304    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:09.913143 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:09.913114    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7flkg\""
Aug 05 16:40:09.913143 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:09.913136    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Aug 05 16:40:09.913331 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:09.913153    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Aug 05 16:40:09.913331 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:09.913154    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 05 16:40:09.913768 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:09.913746    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 05 16:40:09.919697 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:09.919681    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Aug 05 16:40:09.922840 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:09.922800    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-pqb7z"]
Aug 05 16:40:10.028124 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.028091    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-g9g9z"]
Aug 05 16:40:10.030003 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.029980    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4"]
Aug 05 16:40:10.030149 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.030109    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-g9g9z"
Aug 05 16:40:10.031864 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.031846    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4"]
Aug 05 16:40:10.032000 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.031981    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4"
Aug 05 16:40:10.032601 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.032581    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wkrw9\""
Aug 05 16:40:10.033744 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.033727    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79969d86b4-ds5sb"]
Aug 05 16:40:10.033851 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.033821    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Aug 05 16:40:10.033919 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.033858    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4"
Aug 05 16:40:10.034528 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.034511    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Aug 05 16:40:10.034921 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.034907    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jf4vh\""
Aug 05 16:40:10.034978 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.034908    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:40:10.035366 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.035351    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Aug 05 16:40:10.035436 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.035423    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.035910 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.035870    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-kzp7j\""
Aug 05 16:40:10.036019 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.035894    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Aug 05 16:40:10.036778 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.036744    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Aug 05 16:40:10.037138 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.037119    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:40:10.037579 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.037565    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Aug 05 16:40:10.038788 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.038770    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 05 16:40:10.038788 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.038783    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Aug 05 16:40:10.038935 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.038828    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Aug 05 16:40:10.039734 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.039722    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Aug 05 16:40:10.039849 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.039832    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Aug 05 16:40:10.039912 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.039859    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mgkvh\""
Aug 05 16:40:10.040004 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.039988    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 05 16:40:10.046366 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.046350    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4"]
Aug 05 16:40:10.047182 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.047163    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-g9g9z"]
Aug 05 16:40:10.047948 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.047928    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4"]
Aug 05 16:40:10.051593 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.051569    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78c7b72-7cdf-4eda-8751-975306bd3265-service-ca-bundle\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.051698 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.051631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f78c7b72-7cdf-4eda-8751-975306bd3265-serving-cert\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.051698 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.051674    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrxqr\" (UniqueName: \"kubernetes.io/projected/f78c7b72-7cdf-4eda-8751-975306bd3265-kube-api-access-vrxqr\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.051822 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.051718    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f78c7b72-7cdf-4eda-8751-975306bd3265-snapshots\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.051822 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.051772    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f78c7b72-7cdf-4eda-8751-975306bd3265-tmp\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.051908 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.051802    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78c7b72-7cdf-4eda-8751-975306bd3265-trusted-ca-bundle\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.066597 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.066571    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79969d86b4-ds5sb"]
Aug 05 16:40:10.125066 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.125036    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-869c9b8f7b-5x9bd"]
Aug 05 16:40:10.127029 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.127013    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.129486 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.129460    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 05 16:40:10.131046 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.131014    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 05 16:40:10.131150 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.131077    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xts8t\""
Aug 05 16:40:10.131351 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.131327    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 05 16:40:10.136568 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.136544    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 05 16:40:10.152268 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.152247    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-869c9b8f7b-5x9bd"]
Aug 05 16:40:10.152480 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.152465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f78c7b72-7cdf-4eda-8751-975306bd3265-serving-cert\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.152545 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.152492    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znmkm\" (UniqueName: \"kubernetes.io/projected/b1680b14-97ef-4d2a-876a-3c52b77f06cc-kube-api-access-znmkm\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.152545 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.152529    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrxqr\" (UniqueName: \"kubernetes.io/projected/f78c7b72-7cdf-4eda-8751-975306bd3265-kube-api-access-vrxqr\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.152645 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.152555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-stats-auth\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.152681 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.152633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f78c7b72-7cdf-4eda-8751-975306bd3265-snapshots\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.152734 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.152675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a1923c6-f271-4d98-8c01-c9abefa0543e-serving-cert\") pod \"service-ca-operator-784f97bcf6-fdjc4\" (UID: \"6a1923c6-f271-4d98-8c01-c9abefa0543e\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4"
Aug 05 16:40:10.152734 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.152702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-default-certificate\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.152829 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.152775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-strtc\" (UniqueName: \"kubernetes.io/projected/c6bbcd5c-cd34-4128-84b4-8a448b82efed-kube-api-access-strtc\") pod \"network-check-source-65bdbbff45-g9g9z\" (UID: \"c6bbcd5c-cd34-4128-84b4-8a448b82efed\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-g9g9z"
Aug 05 16:40:10.152882 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.152837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfs72\" (UniqueName: \"kubernetes.io/projected/b3db7d60-99ef-4ad5-8bf3-5b186729fcdd-kube-api-access-nfs72\") pod \"kube-storage-version-migrator-operator-7878f4b88c-45kd4\" (UID: \"b3db7d60-99ef-4ad5-8bf3-5b186729fcdd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4"
Aug 05 16:40:10.152882 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.152877    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f78c7b72-7cdf-4eda-8751-975306bd3265-tmp\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.152971 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.152901    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a1923c6-f271-4d98-8c01-c9abefa0543e-config\") pod \"service-ca-operator-784f97bcf6-fdjc4\" (UID: \"6a1923c6-f271-4d98-8c01-c9abefa0543e\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4"
Aug 05 16:40:10.153010 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.152982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpmrb\" (UniqueName: \"kubernetes.io/projected/6a1923c6-f271-4d98-8c01-c9abefa0543e-kube-api-access-mpmrb\") pod \"service-ca-operator-784f97bcf6-fdjc4\" (UID: \"6a1923c6-f271-4d98-8c01-c9abefa0543e\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4"
Aug 05 16:40:10.153053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.153015    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.153053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.153037    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3db7d60-99ef-4ad5-8bf3-5b186729fcdd-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-45kd4\" (UID: \"b3db7d60-99ef-4ad5-8bf3-5b186729fcdd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4"
Aug 05 16:40:10.153153 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.153060    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3db7d60-99ef-4ad5-8bf3-5b186729fcdd-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-45kd4\" (UID: \"b3db7d60-99ef-4ad5-8bf3-5b186729fcdd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4"
Aug 05 16:40:10.153153 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.153118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78c7b72-7cdf-4eda-8751-975306bd3265-trusted-ca-bundle\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.153252 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.153191    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78c7b72-7cdf-4eda-8751-975306bd3265-service-ca-bundle\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.153252 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.153218    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.153334 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.153310    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f78c7b72-7cdf-4eda-8751-975306bd3265-tmp\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.153371 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.153360    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f78c7b72-7cdf-4eda-8751-975306bd3265-snapshots\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.153788 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.153753    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78c7b72-7cdf-4eda-8751-975306bd3265-service-ca-bundle\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.154156 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.154129    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78c7b72-7cdf-4eda-8751-975306bd3265-trusted-ca-bundle\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.155486 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.155463    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f78c7b72-7cdf-4eda-8751-975306bd3265-serving-cert\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.167656 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.167599    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrxqr\" (UniqueName: \"kubernetes.io/projected/f78c7b72-7cdf-4eda-8751-975306bd3265-kube-api-access-vrxqr\") pod \"insights-operator-77696685b-pqb7z\" (UID: \"f78c7b72-7cdf-4eda-8751-975306bd3265\") " pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.221591 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.221568    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-pqb7z"
Aug 05 16:40:10.253720 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.253684    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-stats-auth\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.253720 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.253718    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce5f6742-9896-40b4-9c99-043e4add0a9a-installation-pull-secrets\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.253916 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.253766    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a1923c6-f271-4d98-8c01-c9abefa0543e-serving-cert\") pod \"service-ca-operator-784f97bcf6-fdjc4\" (UID: \"6a1923c6-f271-4d98-8c01-c9abefa0543e\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4"
Aug 05 16:40:10.253916 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.253845    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpmrb\" (UniqueName: \"kubernetes.io/projected/6a1923c6-f271-4d98-8c01-c9abefa0543e-kube-api-access-mpmrb\") pod \"service-ca-operator-784f97bcf6-fdjc4\" (UID: \"6a1923c6-f271-4d98-8c01-c9abefa0543e\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4"
Aug 05 16:40:10.253916 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.253876    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3db7d60-99ef-4ad5-8bf3-5b186729fcdd-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-45kd4\" (UID: \"b3db7d60-99ef-4ad5-8bf3-5b186729fcdd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4"
Aug 05 16:40:10.253916 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.253895    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.254127 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.253919    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3db7d60-99ef-4ad5-8bf3-5b186729fcdd-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-45kd4\" (UID: \"b3db7d60-99ef-4ad5-8bf3-5b186729fcdd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4"
Aug 05 16:40:10.254127 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:10.254118    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle podName:b1680b14-97ef-4d2a-876a-3c52b77f06cc nodeName:}" failed. No retries permitted until 2026-08-05 16:40:10.754095051 +0000 UTC m=+65.203641352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle") pod "router-default-79969d86b4-ds5sb" (UID: "b1680b14-97ef-4d2a-876a-3c52b77f06cc") : configmap references non-existent config key: service-ca.crt
Aug 05 16:40:10.254432 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.254406    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-certificates\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.254543 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.254490    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znmkm\" (UniqueName: \"kubernetes.io/projected/b1680b14-97ef-4d2a-876a-3c52b77f06cc-kube-api-access-znmkm\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.254543 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.254491    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3db7d60-99ef-4ad5-8bf3-5b186729fcdd-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-45kd4\" (UID: \"b3db7d60-99ef-4ad5-8bf3-5b186729fcdd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4"
Aug 05 16:40:10.254543 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.254536    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-strtc\" (UniqueName: \"kubernetes.io/projected/c6bbcd5c-cd34-4128-84b4-8a448b82efed-kube-api-access-strtc\") pod \"network-check-source-65bdbbff45-g9g9z\" (UID: \"c6bbcd5c-cd34-4128-84b4-8a448b82efed\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-g9g9z"
Aug 05 16:40:10.254715 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.254572    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54qtl\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-kube-api-access-54qtl\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.256702 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.256673    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-default-certificate\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.256860 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.256726    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfs72\" (UniqueName: \"kubernetes.io/projected/b3db7d60-99ef-4ad5-8bf3-5b186729fcdd-kube-api-access-nfs72\") pod \"kube-storage-version-migrator-operator-7878f4b88c-45kd4\" (UID: \"b3db7d60-99ef-4ad5-8bf3-5b186729fcdd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4"
Aug 05 16:40:10.256860 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.256755    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-bound-sa-token\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.256860 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.256787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a1923c6-f271-4d98-8c01-c9abefa0543e-config\") pod \"service-ca-operator-784f97bcf6-fdjc4\" (UID: \"6a1923c6-f271-4d98-8c01-c9abefa0543e\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4"
Aug 05 16:40:10.256860 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.256838    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.257126 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.256870    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce5f6742-9896-40b4-9c99-043e4add0a9a-ca-trust-extracted\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.257126 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.256895    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce5f6742-9896-40b4-9c99-043e4add0a9a-trusted-ca\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.257126 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.256895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a1923c6-f271-4d98-8c01-c9abefa0543e-serving-cert\") pod \"service-ca-operator-784f97bcf6-fdjc4\" (UID: \"6a1923c6-f271-4d98-8c01-c9abefa0543e\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4"
Aug 05 16:40:10.257126 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.256960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce5f6742-9896-40b4-9c99-043e4add0a9a-image-registry-private-configuration\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.257126 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.256988    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.257126 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.257071    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-stats-auth\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.257126 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.257115    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3db7d60-99ef-4ad5-8bf3-5b186729fcdd-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-45kd4\" (UID: \"b3db7d60-99ef-4ad5-8bf3-5b186729fcdd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4"
Aug 05 16:40:10.257572 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:10.257167    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 16:40:10.257572 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:10.257224    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs podName:b1680b14-97ef-4d2a-876a-3c52b77f06cc nodeName:}" failed. No retries permitted until 2026-08-05 16:40:10.757207187 +0000 UTC m=+65.206753472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs") pod "router-default-79969d86b4-ds5sb" (UID: "b1680b14-97ef-4d2a-876a-3c52b77f06cc") : secret "router-metrics-certs-default" not found
Aug 05 16:40:10.257572 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.257510    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a1923c6-f271-4d98-8c01-c9abefa0543e-config\") pod \"service-ca-operator-784f97bcf6-fdjc4\" (UID: \"6a1923c6-f271-4d98-8c01-c9abefa0543e\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4"
Aug 05 16:40:10.258276 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.258246    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:10.259461 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.259446    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-default-certificate\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.263292 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.263257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpmrb\" (UniqueName: \"kubernetes.io/projected/6a1923c6-f271-4d98-8c01-c9abefa0543e-kube-api-access-mpmrb\") pod \"service-ca-operator-784f97bcf6-fdjc4\" (UID: \"6a1923c6-f271-4d98-8c01-c9abefa0543e\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4"
Aug 05 16:40:10.263929 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.263914    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znmkm\" (UniqueName: \"kubernetes.io/projected/b1680b14-97ef-4d2a-876a-3c52b77f06cc-kube-api-access-znmkm\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.265428 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.265411    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 16:40:10.266242 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.266222    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfs72\" (UniqueName: \"kubernetes.io/projected/b3db7d60-99ef-4ad5-8bf3-5b186729fcdd-kube-api-access-nfs72\") pod \"kube-storage-version-migrator-operator-7878f4b88c-45kd4\" (UID: \"b3db7d60-99ef-4ad5-8bf3-5b186729fcdd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4"
Aug 05 16:40:10.276344 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.276327    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 16:40:10.286869 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.286846    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-strtc\" (UniqueName: \"kubernetes.io/projected/c6bbcd5c-cd34-4128-84b4-8a448b82efed-kube-api-access-strtc\") pod \"network-check-source-65bdbbff45-g9g9z\" (UID: \"c6bbcd5c-cd34-4128-84b4-8a448b82efed\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-g9g9z"
Aug 05 16:40:10.341129 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.341100    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-g9g9z"
Aug 05 16:40:10.341264 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.341177    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-pqb7z"]
Aug 05 16:40:10.343907 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:40:10.343873    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78c7b72_7cdf_4eda_8751_975306bd3265.slice/crio-15ccc4273c0da984308aab1fb6e788682bb429b950d2df5605212033642e8883 WatchSource:0}: Error finding container 15ccc4273c0da984308aab1fb6e788682bb429b950d2df5605212033642e8883: Status 404 returned error can't find the container with id 15ccc4273c0da984308aab1fb6e788682bb429b950d2df5605212033642e8883
Aug 05 16:40:10.344531 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.344508    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:10.346981 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.346964    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4"
Aug 05 16:40:10.354224 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.354202    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4"
Aug 05 16:40:10.357365 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.357342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54qtl\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-kube-api-access-54qtl\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.357469 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.357390    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-bound-sa-token\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.357469 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.357446    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce5f6742-9896-40b4-9c99-043e4add0a9a-ca-trust-extracted\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.357593 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.357476    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce5f6742-9896-40b4-9c99-043e4add0a9a-trusted-ca\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.357593 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.357524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce5f6742-9896-40b4-9c99-043e4add0a9a-image-registry-private-configuration\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.357593 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.357552    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.357593 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.357584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce5f6742-9896-40b4-9c99-043e4add0a9a-installation-pull-secrets\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.357787 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.357662    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-certificates\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.357910 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.357883    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce5f6742-9896-40b4-9c99-043e4add0a9a-ca-trust-extracted\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.358042 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:10.358026    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:40:10.358126 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:10.358044    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869c9b8f7b-5x9bd: secret "image-registry-tls" not found
Aug 05 16:40:10.358126 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:10.358099    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls podName:ce5f6742-9896-40b4-9c99-043e4add0a9a nodeName:}" failed. No retries permitted until 2026-08-05 16:40:10.858080184 +0000 UTC m=+65.307626460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls") pod "image-registry-869c9b8f7b-5x9bd" (UID: "ce5f6742-9896-40b4-9c99-043e4add0a9a") : secret "image-registry-tls" not found
Aug 05 16:40:10.358556 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.358477    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-certificates\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.359167 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.359139    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce5f6742-9896-40b4-9c99-043e4add0a9a-trusted-ca\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.360672 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.360638    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce5f6742-9896-40b4-9c99-043e4add0a9a-image-registry-private-configuration\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.361487 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.361467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce5f6742-9896-40b4-9c99-043e4add0a9a-installation-pull-secrets\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.367993 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.367970    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54qtl\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-kube-api-access-54qtl\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.370072 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.370025    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-bound-sa-token\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.467321 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.467295    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-pqb7z" event={"ID":"f78c7b72-7cdf-4eda-8751-975306bd3265","Type":"ContainerStarted","Data":"15ccc4273c0da984308aab1fb6e788682bb429b950d2df5605212033642e8883"}
Aug 05 16:40:10.496695 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.496670    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4"]
Aug 05 16:40:10.499895 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:40:10.499868    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1923c6_f271_4d98_8c01_c9abefa0543e.slice/crio-829d25d7967276002c81647c8867369258110c8db54c367d8a82078360a5d854 WatchSource:0}: Error finding container 829d25d7967276002c81647c8867369258110c8db54c367d8a82078360a5d854: Status 404 returned error can't find the container with id 829d25d7967276002c81647c8867369258110c8db54c367d8a82078360a5d854
Aug 05 16:40:10.507781 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.507760    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-g9g9z"]
Aug 05 16:40:10.510171 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:40:10.510146    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6bbcd5c_cd34_4128_84b4_8a448b82efed.slice/crio-1da1853aac724d9817e13b9117c3788ff221aad8a4ba7287618995886f36e103 WatchSource:0}: Error finding container 1da1853aac724d9817e13b9117c3788ff221aad8a4ba7287618995886f36e103: Status 404 returned error can't find the container with id 1da1853aac724d9817e13b9117c3788ff221aad8a4ba7287618995886f36e103
Aug 05 16:40:10.522421 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.522400    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4"]
Aug 05 16:40:10.524958 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:40:10.524939    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3db7d60_99ef_4ad5_8bf3_5b186729fcdd.slice/crio-a018535e68821a65f357aaab3601e485207c9b7f92994879285db0aaba13ea7a WatchSource:0}: Error finding container a018535e68821a65f357aaab3601e485207c9b7f92994879285db0aaba13ea7a: Status 404 returned error can't find the container with id a018535e68821a65f357aaab3601e485207c9b7f92994879285db0aaba13ea7a
Aug 05 16:40:10.760314 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.760236    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs\") pod \"network-metrics-daemon-8v7cz\" (UID: \"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2\") " pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:40:10.760314 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.760280    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.760464 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.760362    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:10.760464 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.760393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:40:10.760464 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:10.760456    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle podName:b1680b14-97ef-4d2a-876a-3c52b77f06cc nodeName:}" failed. No retries permitted until 2026-08-05 16:40:11.760438871 +0000 UTC m=+66.209985149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle") pod "router-default-79969d86b4-ds5sb" (UID: "b1680b14-97ef-4d2a-876a-3c52b77f06cc") : configmap references non-existent config key: service-ca.crt
Aug 05 16:40:10.760616 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:10.760501    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 16:40:10.760616 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:10.760555    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs podName:b1680b14-97ef-4d2a-876a-3c52b77f06cc nodeName:}" failed. No retries permitted until 2026-08-05 16:40:11.760543227 +0000 UTC m=+66.210089504 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs") pod "router-default-79969d86b4-ds5sb" (UID: "b1680b14-97ef-4d2a-876a-3c52b77f06cc") : secret "router-metrics-certs-default" not found
Aug 05 16:40:10.762381 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.762364    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 16:40:10.762448 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.762422    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 16:40:10.770856 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:10.770838    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 05 16:40:10.770908 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:10.770893    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs podName:f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2 nodeName:}" failed. No retries permitted until 2026-08-05 16:41:14.770875641 +0000 UTC m=+129.220421930 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs") pod "network-metrics-daemon-8v7cz" (UID: "f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2") : secret "metrics-daemon-secret" not found
Aug 05 16:40:10.772941 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.772915    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/19978542-a8d5-4584-b68a-6f2cf12f2461-original-pull-secret\") pod \"global-pull-secret-syncer-cjd4p\" (UID: \"19978542-a8d5-4584-b68a-6f2cf12f2461\") " pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:40:10.861453 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.861426    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtgd\" (UniqueName: \"kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd\") pod \"network-check-target-hpls5\" (UID: \"d01e7b31-b024-4f0c-bddb-1f5f35d5ddce\") " pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:40:10.861579 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.861497    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:10.861622 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:10.861596    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:40:10.861622 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:10.861606    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869c9b8f7b-5x9bd: secret "image-registry-tls" not found
Aug 05 16:40:10.861691 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:10.861645    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls podName:ce5f6742-9896-40b4-9c99-043e4add0a9a nodeName:}" failed. No retries permitted until 2026-08-05 16:40:11.861634454 +0000 UTC m=+66.311180731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls") pod "image-registry-869c9b8f7b-5x9bd" (UID: "ce5f6742-9896-40b4-9c99-043e4add0a9a") : secret "image-registry-tls" not found
Aug 05 16:40:10.863741 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:10.863725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dtgd\" (UniqueName: \"kubernetes.io/projected/d01e7b31-b024-4f0c-bddb-1f5f35d5ddce-kube-api-access-9dtgd\") pod \"network-check-target-hpls5\" (UID: \"d01e7b31-b024-4f0c-bddb-1f5f35d5ddce\") " pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:40:11.019802 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:11.019742    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjd4p"
Aug 05 16:40:11.028971 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:11.028953    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cn6w5\""
Aug 05 16:40:11.037357 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:11.037340    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:40:11.176927 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:11.176417    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cjd4p"]
Aug 05 16:40:11.200256 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:11.200228    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hpls5"]
Aug 05 16:40:11.204507 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:40:11.204481    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01e7b31_b024_4f0c_bddb_1f5f35d5ddce.slice/crio-e8ce7113d6b096e2906637e0bc7a9cccbc7cfc90e49158bc2fba6f12be45bfcc WatchSource:0}: Error finding container e8ce7113d6b096e2906637e0bc7a9cccbc7cfc90e49158bc2fba6f12be45bfcc: Status 404 returned error can't find the container with id e8ce7113d6b096e2906637e0bc7a9cccbc7cfc90e49158bc2fba6f12be45bfcc
Aug 05 16:40:11.473607 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:11.473511    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4" event={"ID":"b3db7d60-99ef-4ad5-8bf3-5b186729fcdd","Type":"ContainerStarted","Data":"a018535e68821a65f357aaab3601e485207c9b7f92994879285db0aaba13ea7a"}
Aug 05 16:40:11.475415 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:11.475335    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4" event={"ID":"6a1923c6-f271-4d98-8c01-c9abefa0543e","Type":"ContainerStarted","Data":"829d25d7967276002c81647c8867369258110c8db54c367d8a82078360a5d854"}
Aug 05 16:40:11.477213 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:11.477145    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-g9g9z" event={"ID":"c6bbcd5c-cd34-4128-84b4-8a448b82efed","Type":"ContainerStarted","Data":"1da1853aac724d9817e13b9117c3788ff221aad8a4ba7287618995886f36e103"}
Aug 05 16:40:11.478827 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:11.478784    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hpls5" event={"ID":"d01e7b31-b024-4f0c-bddb-1f5f35d5ddce","Type":"ContainerStarted","Data":"e8ce7113d6b096e2906637e0bc7a9cccbc7cfc90e49158bc2fba6f12be45bfcc"}
Aug 05 16:40:11.480469 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:11.480391    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cjd4p" event={"ID":"19978542-a8d5-4584-b68a-6f2cf12f2461","Type":"ContainerStarted","Data":"32412514b17040ee9b46c88f3564571caf35f37f806105884dca67a8d9189122"}
Aug 05 16:40:11.769388 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:11.768411    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:11.769388 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:11.768467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:40:11.769388 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:11.768517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:11.769388 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:11.768638    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 16:40:11.769388 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:11.768696    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs podName:b1680b14-97ef-4d2a-876a-3c52b77f06cc nodeName:}" failed. No retries permitted until 2026-08-05 16:40:13.768678378 +0000 UTC m=+68.218224657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs") pod "router-default-79969d86b4-ds5sb" (UID: "b1680b14-97ef-4d2a-876a-3c52b77f06cc") : secret "router-metrics-certs-default" not found
Aug 05 16:40:11.769388 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:11.769153    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle podName:b1680b14-97ef-4d2a-876a-3c52b77f06cc nodeName:}" failed. No retries permitted until 2026-08-05 16:40:13.769136457 +0000 UTC m=+68.218682749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle") pod "router-default-79969d86b4-ds5sb" (UID: "b1680b14-97ef-4d2a-876a-3c52b77f06cc") : configmap references non-existent config key: service-ca.crt
Aug 05 16:40:11.769388 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:11.769232    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:40:11.769388 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:11.769268    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls podName:6d629bd8-964f-4458-93bc-d7719b91491c nodeName:}" failed. No retries permitted until 2026-08-05 16:40:43.769255877 +0000 UTC m=+98.218802160 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls") pod "dns-default-45ltw" (UID: "6d629bd8-964f-4458-93bc-d7719b91491c") : secret "dns-default-metrics-tls" not found
Aug 05 16:40:11.869820 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:11.869154    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:11.869820 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:11.869392    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:40:11.869820 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:11.869411    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869c9b8f7b-5x9bd: secret "image-registry-tls" not found
Aug 05 16:40:11.869820 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:11.869472    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls podName:ce5f6742-9896-40b4-9c99-043e4add0a9a nodeName:}" failed. No retries permitted until 2026-08-05 16:40:13.869452296 +0000 UTC m=+68.318998575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls") pod "image-registry-869c9b8f7b-5x9bd" (UID: "ce5f6742-9896-40b4-9c99-043e4add0a9a") : secret "image-registry-tls" not found
Aug 05 16:40:12.424192 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:12.424143    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:12.524710 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:12.524637    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:13.787178 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:13.787142    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:13.787631 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:13.787240    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:13.787631 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:13.787398    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle podName:b1680b14-97ef-4d2a-876a-3c52b77f06cc nodeName:}" failed. No retries permitted until 2026-08-05 16:40:17.787363443 +0000 UTC m=+72.236909735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle") pod "router-default-79969d86b4-ds5sb" (UID: "b1680b14-97ef-4d2a-876a-3c52b77f06cc") : configmap references non-existent config key: service-ca.crt
Aug 05 16:40:13.787631 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:13.787415    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 16:40:13.787631 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:13.787481    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs podName:b1680b14-97ef-4d2a-876a-3c52b77f06cc nodeName:}" failed. No retries permitted until 2026-08-05 16:40:17.787462295 +0000 UTC m=+72.237008591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs") pod "router-default-79969d86b4-ds5sb" (UID: "b1680b14-97ef-4d2a-876a-3c52b77f06cc") : secret "router-metrics-certs-default" not found
Aug 05 16:40:13.887694 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:13.887658    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:13.887895 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:13.887875    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:40:13.887970 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:13.887896    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869c9b8f7b-5x9bd: secret "image-registry-tls" not found
Aug 05 16:40:13.887970 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:13.887962    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls podName:ce5f6742-9896-40b4-9c99-043e4add0a9a nodeName:}" failed. No retries permitted until 2026-08-05 16:40:17.88794221 +0000 UTC m=+72.337488487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls") pod "image-registry-869c9b8f7b-5x9bd" (UID: "ce5f6742-9896-40b4-9c99-043e4add0a9a") : secret "image-registry-tls" not found
Aug 05 16:40:17.502640 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.502597    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-pqb7z" event={"ID":"f78c7b72-7cdf-4eda-8751-975306bd3265","Type":"ContainerStarted","Data":"1b0e43db6d552fd193ba17d06925e0a1a4585725df670ebe8af9e7c45f8da1ea"}
Aug 05 16:40:17.505104 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.505074    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hpls5" event={"ID":"d01e7b31-b024-4f0c-bddb-1f5f35d5ddce","Type":"ContainerStarted","Data":"5e547a21a8d4cd549a707b844948692c61f13d40a3eb682e1356460691adf68e"}
Aug 05 16:40:17.505515 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.505497    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:40:17.508013 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.507989    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cjd4p" event={"ID":"19978542-a8d5-4584-b68a-6f2cf12f2461","Type":"ContainerStarted","Data":"69d8b4307de9a09a50a132d769f5feceb2c4dcb86ffebced924162a8bc559b2e"}
Aug 05 16:40:17.510130 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.510107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4" event={"ID":"b3db7d60-99ef-4ad5-8bf3-5b186729fcdd","Type":"ContainerStarted","Data":"8086a8669be4347b3d98af80b61d007e72de354f52e608d16ab42f647239487c"}
Aug 05 16:40:17.512321 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.512297    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4" event={"ID":"6a1923c6-f271-4d98-8c01-c9abefa0543e","Type":"ContainerStarted","Data":"8c0e1c1f7034f36a3af146edeb7c7ec4e06f6dffc0b773582845bac3153548eb"}
Aug 05 16:40:17.514219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.514195    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-g9g9z" event={"ID":"c6bbcd5c-cd34-4128-84b4-8a448b82efed","Type":"ContainerStarted","Data":"1fd81b0f111193f1553e6bc2859834b77129cc3c9250c27777bb198d734bb480"}
Aug 05 16:40:17.527497 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.527425    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-pqb7z" podStartSLOduration=1.60108234 podStartE2EDuration="8.527408937s" totalImagesPullingTime="6.926326597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:17.525765536 +0000 UTC m=+71.975311835" watchObservedRunningTime="2026-08-05 16:40:17.527408937 +0000 UTC m=+71.976955235"
Aug 05 16:40:17.544728 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.543793    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4" podStartSLOduration=1.768367614 podStartE2EDuration="8.543776951s" totalImagesPullingTime="6.775409337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:17.542371594 +0000 UTC m=+71.991917897" watchObservedRunningTime="2026-08-05 16:40:17.543776951 +0000 UTC m=+71.993323250"
Aug 05 16:40:17.579654 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.579520    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cjd4p" podStartSLOduration=65.440778402 podStartE2EDuration="1m11.579503009s" totalImagesPullingTime="6.138724607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:17.578488358 +0000 UTC m=+72.028034656" watchObservedRunningTime="2026-08-05 16:40:17.579503009 +0000 UTC m=+72.029049310"
Aug 05 16:40:17.580247 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.580210    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4" podStartSLOduration=1.8292745419999998 podStartE2EDuration="8.580200979s" totalImagesPullingTime="6.750926437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:17.563335493 +0000 UTC m=+72.012881799" watchObservedRunningTime="2026-08-05 16:40:17.580200979 +0000 UTC m=+72.029747279"
Aug 05 16:40:17.617058 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.617014    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hpls5" podStartSLOduration=65.51937941 podStartE2EDuration="1m11.617000055s" totalImagesPullingTime="6.097620645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:17.595211207 +0000 UTC m=+72.044757507" watchObservedRunningTime="2026-08-05 16:40:17.617000055 +0000 UTC m=+72.066546331"
Aug 05 16:40:17.820715 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.820628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:17.820882 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.820720    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:17.820882 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:17.820787    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle podName:b1680b14-97ef-4d2a-876a-3c52b77f06cc nodeName:}" failed. No retries permitted until 2026-08-05 16:40:25.82076887 +0000 UTC m=+80.270315153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle") pod "router-default-79969d86b4-ds5sb" (UID: "b1680b14-97ef-4d2a-876a-3c52b77f06cc") : configmap references non-existent config key: service-ca.crt
Aug 05 16:40:17.820882 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:17.820868    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 16:40:17.821057 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:17.820928    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs podName:b1680b14-97ef-4d2a-876a-3c52b77f06cc nodeName:}" failed. No retries permitted until 2026-08-05 16:40:25.820911586 +0000 UTC m=+80.270457870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs") pod "router-default-79969d86b4-ds5sb" (UID: "b1680b14-97ef-4d2a-876a-3c52b77f06cc") : secret "router-metrics-certs-default" not found
Aug 05 16:40:17.921374 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:17.921344    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:17.921494 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:17.921469    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:40:17.921494 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:17.921482    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869c9b8f7b-5x9bd: secret "image-registry-tls" not found
Aug 05 16:40:17.921587 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:17.921529    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls podName:ce5f6742-9896-40b4-9c99-043e4add0a9a nodeName:}" failed. No retries permitted until 2026-08-05 16:40:25.921515263 +0000 UTC m=+80.371061543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls") pod "image-registry-869c9b8f7b-5x9bd" (UID: "ce5f6742-9896-40b4-9c99-043e4add0a9a") : secret "image-registry-tls" not found
Aug 05 16:40:18.913950 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:18.913898    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:19.041328 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.041277    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-g9g9z" podStartSLOduration=3.248663007 podStartE2EDuration="10.041260156s" totalImagesPullingTime="6.792597149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:17.616799578 +0000 UTC m=+72.066345878" watchObservedRunningTime="2026-08-05 16:40:19.041260156 +0000 UTC m=+73.490806454"
Aug 05 16:40:19.041491 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.041465    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-trdrs"]
Aug 05 16:40:19.045841 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.045795    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.050191 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.050171    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 05 16:40:19.051434 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.051419    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 05 16:40:19.054849 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.054831    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lp7bm\""
Aug 05 16:40:19.072464 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.072441    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-trdrs"]
Aug 05 16:40:19.092171 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.092136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:19.131716 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.131694    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.131842 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.131742    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.131903 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.131875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79snx\" (UniqueName: \"kubernetes.io/projected/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-api-access-79snx\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.131958 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.131940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d72561a-dcc4-4073-972a-156cdd9c2b1b-data-volume\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.132016 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.131974    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1d72561a-dcc4-4073-972a-156cdd9c2b1b-crio-socket\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.158537 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.158518    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:19.232749 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.232696    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79snx\" (UniqueName: \"kubernetes.io/projected/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-api-access-79snx\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.232749 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.232742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d72561a-dcc4-4073-972a-156cdd9c2b1b-data-volume\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.232904 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.232762    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1d72561a-dcc4-4073-972a-156cdd9c2b1b-crio-socket\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.232904 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.232799    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.232904 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.232852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.232904 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.232887    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1d72561a-dcc4-4073-972a-156cdd9c2b1b-crio-socket\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.233058 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:19.232928    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:40:19.233058 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:19.232938    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:19.233058 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:19.232988    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm podName:1d72561a-dcc4-4073-972a-156cdd9c2b1b nodeName:}" failed. No retries permitted until 2026-08-05 16:40:19.73296708 +0000 UTC m=+74.182513361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trdrs" (UID: "1d72561a-dcc4-4073-972a-156cdd9c2b1b") : configmap "kube-rbac-proxy" not found
Aug 05 16:40:19.233058 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:19.233005    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls podName:1d72561a-dcc4-4073-972a-156cdd9c2b1b nodeName:}" failed. No retries permitted until 2026-08-05 16:40:19.732996065 +0000 UTC m=+74.182542345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trdrs" (UID: "1d72561a-dcc4-4073-972a-156cdd9c2b1b") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:19.233237 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.233110    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d72561a-dcc4-4073-972a-156cdd9c2b1b-data-volume\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.246754 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.246728    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79snx\" (UniqueName: \"kubernetes.io/projected/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-api-access-79snx\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.295290 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.295265    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:19.365465 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.365446    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:19.569551 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.569494    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:19.670112 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.670090    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:19.737102 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.737076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.737241 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:19.737109    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:19.737241 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:19.737174    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:40:19.737241 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:19.737222    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:19.737241 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:19.737234    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm podName:1d72561a-dcc4-4073-972a-156cdd9c2b1b nodeName:}" failed. No retries permitted until 2026-08-05 16:40:20.737218266 +0000 UTC m=+75.186764547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trdrs" (UID: "1d72561a-dcc4-4073-972a-156cdd9c2b1b") : configmap "kube-rbac-proxy" not found
Aug 05 16:40:19.737419 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:19.737290    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls podName:1d72561a-dcc4-4073-972a-156cdd9c2b1b nodeName:}" failed. No retries permitted until 2026-08-05 16:40:20.737272009 +0000 UTC m=+75.186818289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trdrs" (UID: "1d72561a-dcc4-4073-972a-156cdd9c2b1b") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:20.744864 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:20.744793    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:20.745264 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:20.744941    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:20.745264 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:20.745000    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls podName:1d72561a-dcc4-4073-972a-156cdd9c2b1b nodeName:}" failed. No retries permitted until 2026-08-05 16:40:22.744986156 +0000 UTC m=+77.194532432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trdrs" (UID: "1d72561a-dcc4-4073-972a-156cdd9c2b1b") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:20.745264 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:20.745004    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:40:20.745264 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:20.744947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:20.745264 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:20.745046    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm podName:1d72561a-dcc4-4073-972a-156cdd9c2b1b nodeName:}" failed. No retries permitted until 2026-08-05 16:40:22.745035741 +0000 UTC m=+77.194582018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trdrs" (UID: "1d72561a-dcc4-4073-972a-156cdd9c2b1b") : configmap "kube-rbac-proxy" not found
Aug 05 16:40:21.127010 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:21.126948    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vzjpl_9cb1412e-89c2-4df1-a15c-2cd8cd50dd87/dns-node-resolver/0.log"
Aug 05 16:40:21.220163 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:21.220136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:21.289464 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:21.289438    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:21.461239 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:21.461206    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:21.526746 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:21.526718    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:21.927109 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:21.927087    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hj9wk_fd4a785f-fc18-40c6-a5bc-14f4064d26ba/node-ca/0.log"
Aug 05 16:40:22.727295 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:22.727268    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jbgzp_ef4eeedd-04e8-4f1f-892c-67192a3c0ffc/serve-healthcheck-canary/0.log"
Aug 05 16:40:22.759833 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:22.759791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:22.759927 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:22.759848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:22.759963 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:22.759927    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:22.760003 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:22.759971    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:40:22.760003 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:22.759993    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls podName:1d72561a-dcc4-4073-972a-156cdd9c2b1b nodeName:}" failed. No retries permitted until 2026-08-05 16:40:26.759979269 +0000 UTC m=+81.209525546 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trdrs" (UID: "1d72561a-dcc4-4073-972a-156cdd9c2b1b") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:22.760083 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:22.760029    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm podName:1d72561a-dcc4-4073-972a-156cdd9c2b1b nodeName:}" failed. No retries permitted until 2026-08-05 16:40:26.760016373 +0000 UTC m=+81.209562651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trdrs" (UID: "1d72561a-dcc4-4073-972a-156cdd9c2b1b") : configmap "kube-rbac-proxy" not found
Aug 05 16:40:22.852606 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:22.852570    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:24.662204 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:24.662151    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:24.766519 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:24.766465    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:24.859469 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:24.859442    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:24.968642 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:24.968573    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:25.564461 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:25.564429    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:25.883478 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:25.883404    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:25.883478 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:25.883462    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:25.883864 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:25.883548    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle podName:b1680b14-97ef-4d2a-876a-3c52b77f06cc nodeName:}" failed. No retries permitted until 2026-08-05 16:40:41.883532298 +0000 UTC m=+96.333078575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle") pod "router-default-79969d86b4-ds5sb" (UID: "b1680b14-97ef-4d2a-876a-3c52b77f06cc") : configmap references non-existent config key: service-ca.crt
Aug 05 16:40:25.883864 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:25.883558    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 16:40:25.883864 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:25.883600    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs podName:b1680b14-97ef-4d2a-876a-3c52b77f06cc nodeName:}" failed. No retries permitted until 2026-08-05 16:40:41.883586761 +0000 UTC m=+96.333133038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs") pod "router-default-79969d86b4-ds5sb" (UID: "b1680b14-97ef-4d2a-876a-3c52b77f06cc") : secret "router-metrics-certs-default" not found
Aug 05 16:40:25.984784 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:25.984755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls\") pod \"image-registry-869c9b8f7b-5x9bd\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") " pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:25.984933 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:25.984890    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:40:25.984933 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:25.984901    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869c9b8f7b-5x9bd: secret "image-registry-tls" not found
Aug 05 16:40:25.985023 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:25.984946    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls podName:ce5f6742-9896-40b4-9c99-043e4add0a9a nodeName:}" failed. No retries permitted until 2026-08-05 16:40:41.984933111 +0000 UTC m=+96.434479389 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls") pod "image-registry-869c9b8f7b-5x9bd" (UID: "ce5f6742-9896-40b4-9c99-043e4add0a9a") : secret "image-registry-tls" not found
Aug 05 16:40:26.159890 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:26.159859    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:26.551153 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:26.551065    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:26.790201 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:26.790166    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:26.790201 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:26.790206    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:26.790434 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:26.790285    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:40:26.790434 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:26.790322    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:26.790434 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:26.790350    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm podName:1d72561a-dcc4-4073-972a-156cdd9c2b1b nodeName:}" failed. No retries permitted until 2026-08-05 16:40:34.790335414 +0000 UTC m=+89.239881691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trdrs" (UID: "1d72561a-dcc4-4073-972a-156cdd9c2b1b") : configmap "kube-rbac-proxy" not found
Aug 05 16:40:26.790434 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:26.790392    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls podName:1d72561a-dcc4-4073-972a-156cdd9c2b1b nodeName:}" failed. No retries permitted until 2026-08-05 16:40:34.790374875 +0000 UTC m=+89.239921156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trdrs" (UID: "1d72561a-dcc4-4073-972a-156cdd9c2b1b") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:26.970908 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:26.970883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:27.152624 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:27.152590    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:27.569283 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:27.569251    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:28.124232 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:28.124127    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:28.225558 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:28.225527    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:28.554059 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:28.554027    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:28.654932 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:28.654907    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:29.003521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:29.003489    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:29.071071 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:29.071042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:29.210958 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:29.210930    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:29.557749 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:29.557721    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:29.952529 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:29.952499    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:30.558640 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:30.558607    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:30.954062 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:30.954036    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:31.163729 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:31.163704    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:31.361299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:31.361226    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:31.579010 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:31.578983    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:31.958775 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:31.958747    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:32.079661 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:32.079629    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:32.583019 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:32.582989    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:32.761284 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:32.761257    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:33.156158 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:33.156129    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:33.947357 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:33.947326    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:34.373484 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:34.373416    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:34.577377 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:34.577345    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:34.731031 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:34.731006    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:34.854659 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:34.854638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:34.854775 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:34.854676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:34.854856 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:34.854772    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:34.854856 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:34.854848    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls podName:1d72561a-dcc4-4073-972a-156cdd9c2b1b nodeName:}" failed. No retries permitted until 2026-08-05 16:40:50.85483096 +0000 UTC m=+105.304377237 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trdrs" (UID: "1d72561a-dcc4-4073-972a-156cdd9c2b1b") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:34.855276 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:34.855259    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d72561a-dcc4-4073-972a-156cdd9c2b1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:34.875949 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:34.875911    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:35.181181 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:35.181157    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:35.380643 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:35.380596    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:40.055586 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.055547    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-869c9b8f7b-5x9bd"]
Aug 05 16:40:40.056091 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:40.055748    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd" podUID="ce5f6742-9896-40b4-9c99-043e4add0a9a"
Aug 05 16:40:40.121980 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.121953    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b59665466-p5rql"]
Aug 05 16:40:40.126220 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.126200    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.154428 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.154406    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b59665466-p5rql"]
Aug 05 16:40:40.191728 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.191706    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9a099fa-dbd7-420c-9f10-42479359f875-ca-trust-extracted\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.191837 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.191761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9a099fa-dbd7-420c-9f10-42479359f875-image-registry-private-configuration\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.191837 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.191781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjcv4\" (UniqueName: \"kubernetes.io/projected/b9a099fa-dbd7-420c-9f10-42479359f875-kube-api-access-tjcv4\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.191915 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.191844    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9a099fa-dbd7-420c-9f10-42479359f875-bound-sa-token\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.191915 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.191864    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9a099fa-dbd7-420c-9f10-42479359f875-registry-certificates\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.191915 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.191878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9a099fa-dbd7-420c-9f10-42479359f875-trusted-ca\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.192036 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.191911    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9a099fa-dbd7-420c-9f10-42479359f875-installation-pull-secrets\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.192036 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.191962    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9a099fa-dbd7-420c-9f10-42479359f875-registry-tls\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.266849 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.266800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:40.293362 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.293336    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9a099fa-dbd7-420c-9f10-42479359f875-ca-trust-extracted\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.293461 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.293396    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9a099fa-dbd7-420c-9f10-42479359f875-image-registry-private-configuration\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.293461 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.293420    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjcv4\" (UniqueName: \"kubernetes.io/projected/b9a099fa-dbd7-420c-9f10-42479359f875-kube-api-access-tjcv4\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.293461 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.293448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9a099fa-dbd7-420c-9f10-42479359f875-bound-sa-token\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.293617 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.293473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9a099fa-dbd7-420c-9f10-42479359f875-registry-certificates\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.293617 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.293492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9a099fa-dbd7-420c-9f10-42479359f875-trusted-ca\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.293617 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.293537    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9a099fa-dbd7-420c-9f10-42479359f875-installation-pull-secrets\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.293617 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.293573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9a099fa-dbd7-420c-9f10-42479359f875-registry-tls\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.293837 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.293734    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9a099fa-dbd7-420c-9f10-42479359f875-ca-trust-extracted\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.294469 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.294445    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9a099fa-dbd7-420c-9f10-42479359f875-registry-certificates\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.294585 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.294552    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9a099fa-dbd7-420c-9f10-42479359f875-trusted-ca\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.296130 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.296104    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9a099fa-dbd7-420c-9f10-42479359f875-installation-pull-secrets\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.296222 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.296110    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9a099fa-dbd7-420c-9f10-42479359f875-registry-tls\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.296285 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.296263    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9a099fa-dbd7-420c-9f10-42479359f875-image-registry-private-configuration\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.330398 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.330341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9a099fa-dbd7-420c-9f10-42479359f875-bound-sa-token\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.330479 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.330413    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjcv4\" (UniqueName: \"kubernetes.io/projected/b9a099fa-dbd7-420c-9f10-42479359f875-kube-api-access-tjcv4\") pod \"image-registry-7b59665466-p5rql\" (UID: \"b9a099fa-dbd7-420c-9f10-42479359f875\") " pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.434759 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.434739    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:40.482280 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.482237    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:40.570296 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.570149    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b59665466-p5rql"]
Aug 05 16:40:40.572536 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:40:40.572513    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a099fa_dbd7_420c_9f10_42479359f875.slice/crio-1eea6ecbed539cc2b2c3219c1765ca9e851ded8ab54bcaed2736ce4bbde31876 WatchSource:0}: Error finding container 1eea6ecbed539cc2b2c3219c1765ca9e851ded8ab54bcaed2736ce4bbde31876: Status 404 returned error can't find the container with id 1eea6ecbed539cc2b2c3219c1765ca9e851ded8ab54bcaed2736ce4bbde31876
Aug 05 16:40:40.586703 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.586684    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:40.586823 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.586712    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b59665466-p5rql" event={"ID":"b9a099fa-dbd7-420c-9f10-42479359f875","Type":"ContainerStarted","Data":"1eea6ecbed539cc2b2c3219c1765ca9e851ded8ab54bcaed2736ce4bbde31876"}
Aug 05 16:40:40.595145 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.595130    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:40.695497 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.695470    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce5f6742-9896-40b4-9c99-043e4add0a9a-installation-pull-secrets\") pod \"ce5f6742-9896-40b4-9c99-043e4add0a9a\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") "
Aug 05 16:40:40.695628 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.695508    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-certificates\") pod \"ce5f6742-9896-40b4-9c99-043e4add0a9a\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") "
Aug 05 16:40:40.695628 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.695527    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce5f6742-9896-40b4-9c99-043e4add0a9a-image-registry-private-configuration\") pod \"ce5f6742-9896-40b4-9c99-043e4add0a9a\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") "
Aug 05 16:40:40.695628 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.695548    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54qtl\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-kube-api-access-54qtl\") pod \"ce5f6742-9896-40b4-9c99-043e4add0a9a\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") "
Aug 05 16:40:40.695628 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.695614    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-bound-sa-token\") pod \"ce5f6742-9896-40b4-9c99-043e4add0a9a\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") "
Aug 05 16:40:40.695861 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.695632    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce5f6742-9896-40b4-9c99-043e4add0a9a-trusted-ca\") pod \"ce5f6742-9896-40b4-9c99-043e4add0a9a\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") "
Aug 05 16:40:40.695861 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.695682    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce5f6742-9896-40b4-9c99-043e4add0a9a-ca-trust-extracted\") pod \"ce5f6742-9896-40b4-9c99-043e4add0a9a\" (UID: \"ce5f6742-9896-40b4-9c99-043e4add0a9a\") "
Aug 05 16:40:40.695966 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.695920    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ce5f6742-9896-40b4-9c99-043e4add0a9a" (UID: "ce5f6742-9896-40b4-9c99-043e4add0a9a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:40:40.696185 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.696124    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce5f6742-9896-40b4-9c99-043e4add0a9a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ce5f6742-9896-40b4-9c99-043e4add0a9a" (UID: "ce5f6742-9896-40b4-9c99-043e4add0a9a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:40:40.696294 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.696239    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce5f6742-9896-40b4-9c99-043e4add0a9a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ce5f6742-9896-40b4-9c99-043e4add0a9a" (UID: "ce5f6742-9896-40b4-9c99-043e4add0a9a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:40:40.697780 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.697753    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-kube-api-access-54qtl" (OuterVolumeSpecName: "kube-api-access-54qtl") pod "ce5f6742-9896-40b4-9c99-043e4add0a9a" (UID: "ce5f6742-9896-40b4-9c99-043e4add0a9a"). InnerVolumeSpecName "kube-api-access-54qtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:40:40.698148 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.698120    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ce5f6742-9896-40b4-9c99-043e4add0a9a" (UID: "ce5f6742-9896-40b4-9c99-043e4add0a9a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:40:40.698148 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.698136    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce5f6742-9896-40b4-9c99-043e4add0a9a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ce5f6742-9896-40b4-9c99-043e4add0a9a" (UID: "ce5f6742-9896-40b4-9c99-043e4add0a9a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:40:40.698278 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.698192    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce5f6742-9896-40b4-9c99-043e4add0a9a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ce5f6742-9896-40b4-9c99-043e4add0a9a" (UID: "ce5f6742-9896-40b4-9c99-043e4add0a9a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:40:40.796474 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.796452    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce5f6742-9896-40b4-9c99-043e4add0a9a-ca-trust-extracted\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:40:40.796474 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.796472    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce5f6742-9896-40b4-9c99-043e4add0a9a-installation-pull-secrets\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:40:40.796633 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.796483    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-certificates\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:40:40.796633 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.796491    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce5f6742-9896-40b4-9c99-043e4add0a9a-image-registry-private-configuration\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:40:40.796633 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.796500    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54qtl\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-kube-api-access-54qtl\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:40:40.796633 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.796509    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-bound-sa-token\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:40:40.796633 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:40.796516    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce5f6742-9896-40b4-9c99-043e4add0a9a-trusted-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:40:41.593534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:41.593457    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b59665466-p5rql" event={"ID":"b9a099fa-dbd7-420c-9f10-42479359f875","Type":"ContainerStarted","Data":"8c4c5491818e93753c91e86c22970912be9f62868e3d7d05431215d167c16665"}
Aug 05 16:40:41.593918 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:41.593473    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869c9b8f7b-5x9bd"
Aug 05 16:40:41.593918 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:41.593704    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:40:41.629257 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:41.629217    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b59665466-p5rql" podStartSLOduration=1.629204098 podStartE2EDuration="1.629204098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:41.628254054 +0000 UTC m=+96.077800350" watchObservedRunningTime="2026-08-05 16:40:41.629204098 +0000 UTC m=+96.078750397"
Aug 05 16:40:41.666221 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:41.666197    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-869c9b8f7b-5x9bd"]
Aug 05 16:40:41.670514 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:41.670496    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-869c9b8f7b-5x9bd"]
Aug 05 16:40:41.804277 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:41.804249    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce5f6742-9896-40b4-9c99-043e4add0a9a-registry-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:40:41.905483 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:41.905462    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:41.905617 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:41.905519    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:41.906138 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:41.906114    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1680b14-97ef-4d2a-876a-3c52b77f06cc-service-ca-bundle\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:41.907755 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:41.907738    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1680b14-97ef-4d2a-876a-3c52b77f06cc-metrics-certs\") pod \"router-default-79969d86b4-ds5sb\" (UID: \"b1680b14-97ef-4d2a-876a-3c52b77f06cc\") " pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:42.012066 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:42.012041    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce5f6742-9896-40b4-9c99-043e4add0a9a" path="/var/lib/kubelet/pods/ce5f6742-9896-40b4-9c99-043e4add0a9a/volumes"
Aug 05 16:40:42.159449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:42.159385    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:42.285432 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:42.285359    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79969d86b4-ds5sb"]
Aug 05 16:40:42.287485 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:40:42.287458    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1680b14_97ef_4d2a_876a_3c52b77f06cc.slice/crio-1e8a88c00cd397e04a3cafbf9bdaee5f5fed16ebd54743becb7bd3d81c166e0c WatchSource:0}: Error finding container 1e8a88c00cd397e04a3cafbf9bdaee5f5fed16ebd54743becb7bd3d81c166e0c: Status 404 returned error can't find the container with id 1e8a88c00cd397e04a3cafbf9bdaee5f5fed16ebd54743becb7bd3d81c166e0c
Aug 05 16:40:42.598175 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:42.598101    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79969d86b4-ds5sb" event={"ID":"b1680b14-97ef-4d2a-876a-3c52b77f06cc","Type":"ContainerStarted","Data":"9434a2c45b782bc1f3f287e12f4e35eae161f00fb38007d84e15c062ebaea6f9"}
Aug 05 16:40:42.598175 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:42.598148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79969d86b4-ds5sb" event={"ID":"b1680b14-97ef-4d2a-876a-3c52b77f06cc","Type":"ContainerStarted","Data":"1e8a88c00cd397e04a3cafbf9bdaee5f5fed16ebd54743becb7bd3d81c166e0c"}
Aug 05 16:40:43.160442 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:43.160407    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:43.162884 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:43.162860    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:43.187489 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:43.187444    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-79969d86b4-ds5sb" podStartSLOduration=34.187429866 podStartE2EDuration="34.187429866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:42.621010115 +0000 UTC m=+97.070556428" watchObservedRunningTime="2026-08-05 16:40:43.187429866 +0000 UTC m=+97.636976164"
Aug 05 16:40:43.601219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:43.601145    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:43.602268 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:43.602253    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79969d86b4-ds5sb"
Aug 05 16:40:43.820285 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:43.820239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:40:43.822483 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:43.822460    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d629bd8-964f-4458-93bc-d7719b91491c-metrics-tls\") pod \"dns-default-45ltw\" (UID: \"6d629bd8-964f-4458-93bc-d7719b91491c\") " pod="openshift-dns/dns-default-45ltw"
Aug 05 16:40:43.848899 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:43.848871    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:43.866066 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:43.866018    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p9jdc\""
Aug 05 16:40:43.874055 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:43.874036    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-45ltw"
Aug 05 16:40:43.970206 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:43.970163    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:44.007274 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:44.007250    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-45ltw"]
Aug 05 16:40:44.012413 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:40:44.012380    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d629bd8_964f_4458_93bc_d7719b91491c.slice/crio-d2484ef2d5b2e595401ad084d41ac7476c330481c3ee9b32292881368bcc82ad WatchSource:0}: Error finding container d2484ef2d5b2e595401ad084d41ac7476c330481c3ee9b32292881368bcc82ad: Status 404 returned error can't find the container with id d2484ef2d5b2e595401ad084d41ac7476c330481c3ee9b32292881368bcc82ad
Aug 05 16:40:44.062862 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:44.062836    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:44.063463 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:44.063445    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-f4hmf"]
Aug 05 16:40:44.067510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:44.067495    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-f4hmf"
Aug 05 16:40:44.071520 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:44.071504    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6lkfr\""
Aug 05 16:40:44.072206 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:44.072193    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Aug 05 16:40:44.081198 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:44.081180    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-f4hmf"]
Aug 05 16:40:44.122780 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:44.122714    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-f4hmf\" (UID: \"6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-f4hmf"
Aug 05 16:40:44.224094 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:44.224064    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-f4hmf\" (UID: \"6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-f4hmf"
Aug 05 16:40:44.224239 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:44.224169    2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Aug 05 16:40:44.224239 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:44.224218    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30-tls-certificates podName:6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:44.724205549 +0000 UTC m=+99.173751826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30-tls-certificates") pod "prometheus-operator-admission-webhook-66685ff6d4-f4hmf" (UID: "6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30") : secret "prometheus-operator-admission-webhook-tls" not found
Aug 05 16:40:44.495466 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:44.495436    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:44.608374 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:44.608346    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-45ltw" event={"ID":"6d629bd8-964f-4458-93bc-d7719b91491c","Type":"ContainerStarted","Data":"d2484ef2d5b2e595401ad084d41ac7476c330481c3ee9b32292881368bcc82ad"}
Aug 05 16:40:44.727461 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:44.727429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-f4hmf\" (UID: \"6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-f4hmf"
Aug 05 16:40:44.729784 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:44.729761    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-f4hmf\" (UID: \"6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-f4hmf"
Aug 05 16:40:44.975961 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:44.975923    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-f4hmf"
Aug 05 16:40:45.125152 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:45.125124    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-f4hmf"]
Aug 05 16:40:45.128947 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:40:45.128921    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f21e9c6_bb31_4c27_b29d_d6ad6d1d4d30.slice/crio-c0a3873a0b1025f23f911ff3936123c1d6d19e43df3ee31df6c43c76361aa93c WatchSource:0}: Error finding container c0a3873a0b1025f23f911ff3936123c1d6d19e43df3ee31df6c43c76361aa93c: Status 404 returned error can't find the container with id c0a3873a0b1025f23f911ff3936123c1d6d19e43df3ee31df6c43c76361aa93c
Aug 05 16:40:45.533842 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:45.533790    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:45.613379 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:45.613344    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-f4hmf" event={"ID":"6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30","Type":"ContainerStarted","Data":"c0a3873a0b1025f23f911ff3936123c1d6d19e43df3ee31df6c43c76361aa93c"}
Aug 05 16:40:45.634943 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:45.634899    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:46.618110 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:46.618080    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-45ltw" event={"ID":"6d629bd8-964f-4458-93bc-d7719b91491c","Type":"ContainerStarted","Data":"c003f844ffd13a50a51d73d884ad1ed9a4f7e302725803ef3ea7ea3dec988300"}
Aug 05 16:40:46.618449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:46.618128    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-45ltw" event={"ID":"6d629bd8-964f-4458-93bc-d7719b91491c","Type":"ContainerStarted","Data":"c8cdd4444c82f102aab1c1ae7f53f20a53153d151df3511a062dcdd5c86764a5"}
Aug 05 16:40:46.618449 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:46.618228    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-45ltw"
Aug 05 16:40:46.638391 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:46.638347    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-45ltw" podStartSLOduration=65.753346861 podStartE2EDuration="1m7.638330667s" totalImagesPullingTime="1.884983806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:46.637528538 +0000 UTC m=+101.087074859" watchObservedRunningTime="2026-08-05 16:40:46.638330667 +0000 UTC m=+101.087877011"
Aug 05 16:40:47.623342 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:47.623306    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-f4hmf" event={"ID":"6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30","Type":"ContainerStarted","Data":"f52f74707de55228335290503d58cde0791c0b68823eaba84066425e2f451539"}
Aug 05 16:40:47.644666 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:47.644622    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-f4hmf" podStartSLOduration=2.131859504 podStartE2EDuration="3.64460763s" totalImagesPullingTime="1.512748126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:47.64384971 +0000 UTC m=+102.093396012" watchObservedRunningTime="2026-08-05 16:40:47.64460763 +0000 UTC m=+102.094153962"
Aug 05 16:40:48.630204 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:48.629874    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-f4hmf"
Aug 05 16:40:48.634885 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:48.634863    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-f4hmf"
Aug 05 16:40:48.687075 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:48.687042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:48.783975 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:48.783944    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:48.884489 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:48.884417    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:49.162980 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:49.162946    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:49.268291 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:49.268259    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:49.361223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:49.361193    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:49.523518 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:49.523454    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hpls5"
Aug 05 16:40:50.524686 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:50.524650    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:50.593120 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:50.593091    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:50.873599 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:50.873519    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:50.875772 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:50.875749    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d72561a-dcc4-4073-972a-156cdd9c2b1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trdrs\" (UID: \"1d72561a-dcc4-4073-972a-156cdd9c2b1b\") " pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:51.155208 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:51.155181    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-trdrs"
Aug 05 16:40:51.197755 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:51.197728    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:51.314219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:51.314132    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-trdrs"]
Aug 05 16:40:51.318103 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:40:51.318078    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d72561a_dcc4_4073_972a_156cdd9c2b1b.slice/crio-bd3baa822a0cf0d12edaf2c11401dbb808c8d0acd5cdd91efc1148cc0a362b38 WatchSource:0}: Error finding container bd3baa822a0cf0d12edaf2c11401dbb808c8d0acd5cdd91efc1148cc0a362b38: Status 404 returned error can't find the container with id bd3baa822a0cf0d12edaf2c11401dbb808c8d0acd5cdd91efc1148cc0a362b38
Aug 05 16:40:51.639091 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:51.639063    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trdrs" event={"ID":"1d72561a-dcc4-4073-972a-156cdd9c2b1b","Type":"ContainerStarted","Data":"0e7e8b34b0392978ae5a6d8350dc261687a67434f10843dcbd0990bbcb8a6a11"}
Aug 05 16:40:51.639456 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:51.639115    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trdrs" event={"ID":"1d72561a-dcc4-4073-972a-156cdd9c2b1b","Type":"ContainerStarted","Data":"bd3baa822a0cf0d12edaf2c11401dbb808c8d0acd5cdd91efc1148cc0a362b38"}
Aug 05 16:40:52.644879 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:52.644854    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trdrs" event={"ID":"1d72561a-dcc4-4073-972a-156cdd9c2b1b","Type":"ContainerStarted","Data":"d46c0e21bcea58f9b5da6272fe05ddde484eb608f0d500ccbc728627bfe128bd"}
Aug 05 16:40:53.274984 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.274953    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:53.489944 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.489914    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:53.548239 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.548162    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"]
Aug 05 16:40:53.550430 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.550408    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.555431 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.555404    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Aug 05 16:40:53.555764 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.555745    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 05 16:40:53.555882 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.555754    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pwwvt\""
Aug 05 16:40:53.555882 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.555831    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Aug 05 16:40:53.556055 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.555889    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 05 16:40:53.556055 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.555746    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Aug 05 16:40:53.556055 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.556002    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 05 16:40:53.563267 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.563249    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kz4hj"]
Aug 05 16:40:53.565445 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.565430    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.568369 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.568350    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 05 16:40:53.568501 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.568479    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 05 16:40:53.568611 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.568580    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6jkd7\""
Aug 05 16:40:53.569156 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.569135    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 05 16:40:53.570644 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.570623    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"]
Aug 05 16:40:53.595775 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.595747    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:53.693394 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f73f6931-9502-414c-a31d-229a93e63e5c-sys\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.693394 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f73f6931-9502-414c-a31d-229a93e63e5c-root\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.693945 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-tls\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.693945 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693470    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.693945 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693498    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-accelerators-collector-config\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.693945 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693536    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.693945 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693568    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-wtmp\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.693945 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f73f6931-9502-414c-a31d-229a93e63e5c-metrics-client-ca\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.693945 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693614    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfdtt\" (UniqueName: \"kubernetes.io/projected/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-api-access-jfdtt\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.693945 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.693945 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klctj\" (UniqueName: \"kubernetes.io/projected/f73f6931-9502-414c-a31d-229a93e63e5c-kube-api-access-klctj\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.693945 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693701    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.693945 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693732    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-textfile\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.693945 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693756    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.693945 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.693789    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.694585 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.694456    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:53.794993 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.794962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klctj\" (UniqueName: \"kubernetes.io/projected/f73f6931-9502-414c-a31d-229a93e63e5c-kube-api-access-klctj\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.794993 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.794998    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.795247 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795028    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-textfile\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.795247 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795169    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.795247 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795225    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.795402 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f73f6931-9502-414c-a31d-229a93e63e5c-sys\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.795402 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f73f6931-9502-414c-a31d-229a93e63e5c-root\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.795402 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795343    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-textfile\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.795402 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795359    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-tls\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.795402 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795396    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.795659 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795426    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-accelerators-collector-config\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.795659 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795468    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.795659 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795503    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-wtmp\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.795659 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f73f6931-9502-414c-a31d-229a93e63e5c-metrics-client-ca\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.795659 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795548    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfdtt\" (UniqueName: \"kubernetes.io/projected/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-api-access-jfdtt\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.795659 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.795990 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795722    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.795990 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795874    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-wtmp\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.795990 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.795951    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.796138 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.796015    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.796138 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.796086    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f73f6931-9502-414c-a31d-229a93e63e5c-root\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.796138 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.796134    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f73f6931-9502-414c-a31d-229a93e63e5c-sys\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.796288 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.796160    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-accelerators-collector-config\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.796288 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.796205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f73f6931-9502-414c-a31d-229a93e63e5c-metrics-client-ca\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.796288 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:53.796215    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 05 16:40:53.796288 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:53.796253    2575 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Aug 05 16:40:53.796288 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:53.796275    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-tls podName:f73f6931-9502-414c-a31d-229a93e63e5c nodeName:}" failed. No retries permitted until 2026-08-05 16:40:54.296258668 +0000 UTC m=+108.745804944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-tls") pod "node-exporter-kz4hj" (UID: "f73f6931-9502-414c-a31d-229a93e63e5c") : secret "node-exporter-tls" not found
Aug 05 16:40:53.796549 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:40:53.796312    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-state-metrics-tls podName:44ee2551-7b6a-4ca7-8ce5-bb7132d7626a nodeName:}" failed. No retries permitted until 2026-08-05 16:40:54.296295628 +0000 UTC m=+108.745841907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-state-metrics-tls") pod "kube-state-metrics-6bd9664c4-9ddwn" (UID: "44ee2551-7b6a-4ca7-8ce5-bb7132d7626a") : secret "kube-state-metrics-tls" not found
Aug 05 16:40:53.798137 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.798110    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.798262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.798181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.820679 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.820648    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klctj\" (UniqueName: \"kubernetes.io/projected/f73f6931-9502-414c-a31d-229a93e63e5c-kube-api-access-klctj\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:53.822546 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.822523    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfdtt\" (UniqueName: \"kubernetes.io/projected/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-api-access-jfdtt\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:53.884950 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.884915    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:53.989294 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:53.989263    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:54.227139 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:54.227110    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:54.300771 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:54.300741    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-tls\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:54.301108 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:54.300786    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:54.303080 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:54.303054    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f73f6931-9502-414c-a31d-229a93e63e5c-node-exporter-tls\") pod \"node-exporter-kz4hj\" (UID: \"f73f6931-9502-414c-a31d-229a93e63e5c\") " pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:54.303178 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:54.303118    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ee2551-7b6a-4ca7-8ce5-bb7132d7626a-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-9ddwn\" (UID: \"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:54.393868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:54.393779    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:54.461701 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:54.461669    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"
Aug 05 16:40:54.480663 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:54.480632    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kz4hj"
Aug 05 16:40:54.491656 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:40:54.491606    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73f6931_9502_414c_a31d_229a93e63e5c.slice/crio-19d82d764c70037c5d6209141a2390c9229377b68f38646603fa1f1b53a7f87e WatchSource:0}: Error finding container 19d82d764c70037c5d6209141a2390c9229377b68f38646603fa1f1b53a7f87e: Status 404 returned error can't find the container with id 19d82d764c70037c5d6209141a2390c9229377b68f38646603fa1f1b53a7f87e
Aug 05 16:40:54.640413 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:54.640373    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn"]
Aug 05 16:40:54.643961 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:40:54.643898    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ee2551_7b6a_4ca7_8ce5_bb7132d7626a.slice/crio-4caea0626827b5994cdc0293691525bf689ef18573dde4be3c056c59d499b0ed WatchSource:0}: Error finding container 4caea0626827b5994cdc0293691525bf689ef18573dde4be3c056c59d499b0ed: Status 404 returned error can't find the container with id 4caea0626827b5994cdc0293691525bf689ef18573dde4be3c056c59d499b0ed
Aug 05 16:40:54.653154 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:54.653124    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kz4hj" event={"ID":"f73f6931-9502-414c-a31d-229a93e63e5c","Type":"ContainerStarted","Data":"19d82d764c70037c5d6209141a2390c9229377b68f38646603fa1f1b53a7f87e"}
Aug 05 16:40:54.654299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:54.654277    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn" event={"ID":"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a","Type":"ContainerStarted","Data":"4caea0626827b5994cdc0293691525bf689ef18573dde4be3c056c59d499b0ed"}
Aug 05 16:40:54.656088 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:54.656066    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trdrs" event={"ID":"1d72561a-dcc4-4073-972a-156cdd9c2b1b","Type":"ContainerStarted","Data":"f5e5554a699e89f064805439e6c426708f091194e263eaee15f5a77d18193627"}
Aug 05 16:40:54.957419 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:54.957380    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:55.111215 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.111170    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:55.150627 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.150578    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-trdrs" podStartSLOduration=34.594548629 podStartE2EDuration="37.150562933s" totalImagesPullingTime="2.556014304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:40:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:54.940564807 +0000 UTC m=+109.390111105" watchObservedRunningTime="2026-08-05 16:40:55.150562933 +0000 UTC m=+109.600109232"
Aug 05 16:40:55.151524 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.151499    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:40:55.154948 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.154934    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.158996 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.158972    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 05 16:40:55.159111 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.158973    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 05 16:40:55.159397 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.159379    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 05 16:40:55.160067 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.160044    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 05 16:40:55.160174 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.160066    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dgvbn\""
Aug 05 16:40:55.160174 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.160052    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 05 16:40:55.160480 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.160454    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 05 16:40:55.160635 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.160613    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 05 16:40:55.161539 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.161518    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 05 16:40:55.166260 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.166239    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 05 16:40:55.188482 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.188463    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:40:55.309775 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.309698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.309775 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.309739    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.309996 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.309847    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.309996 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.309885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.309996 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.309908    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvpsv\" (UniqueName: \"kubernetes.io/projected/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-kube-api-access-kvpsv\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.309996 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.309952    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.310203 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.310012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.310203 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.310035    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.310203 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.310065    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-web-config\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.310203 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.310153    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.310203 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.310188    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.310453 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.310227    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.310453 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.310277    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-config-out\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.333175 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.333143    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:55.411458 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.411424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-web-config\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.411650 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.411478    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.411650 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.411520    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.411650 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.411565    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.411650 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.411616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-config-out\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.411855 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.411659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.411855 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.411685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.411855 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.411716    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.411855 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.411744    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.411855 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.411769    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvpsv\" (UniqueName: \"kubernetes.io/projected/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-kube-api-access-kvpsv\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.411855 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.411795    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.412144 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.411858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.412144 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.411890    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.412144 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.412106    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.412987 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.412449    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.412987 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.412946    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.414415 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.414387    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-config-out\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.415532 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.415327    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.415640 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.415534    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.415640 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.415612    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.415885 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.415867    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-web-config\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.416070 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.416046    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.417142 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.417121    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.417742 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.417724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.417844 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.417776    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.428514 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.428491    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvpsv\" (UniqueName: \"kubernetes.io/projected/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-kube-api-access-kvpsv\") pod \"alertmanager-main-0\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.467573 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.467552    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:40:55.621352 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.621256    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:40:55.625021 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:40:55.624984    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5fe900_8a78_4d30_bd37_d1a25fb2fd4d.slice/crio-6209419c97c119b64e0cbe776f6c832a70036497a4f7a57b1dcc6bc88cc0a008 WatchSource:0}: Error finding container 6209419c97c119b64e0cbe776f6c832a70036497a4f7a57b1dcc6bc88cc0a008: Status 404 returned error can't find the container with id 6209419c97c119b64e0cbe776f6c832a70036497a4f7a57b1dcc6bc88cc0a008
Aug 05 16:40:55.664428 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.662439    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerStarted","Data":"6209419c97c119b64e0cbe776f6c832a70036497a4f7a57b1dcc6bc88cc0a008"}
Aug 05 16:40:55.665379 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:55.665342    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kz4hj" event={"ID":"f73f6931-9502-414c-a31d-229a93e63e5c","Type":"ContainerStarted","Data":"97a4aeeb21d06c057a315029df9ca7ffcb6a90058f9162950716343355f497fc"}
Aug 05 16:40:56.625660 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:56.625630    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-45ltw"
Aug 05 16:40:56.670789 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:56.670760    2575 generic.go:356] "Generic (PLEG): container finished" podID="f73f6931-9502-414c-a31d-229a93e63e5c" containerID="97a4aeeb21d06c057a315029df9ca7ffcb6a90058f9162950716343355f497fc" exitCode=0
Aug 05 16:40:56.670915 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:56.670843    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kz4hj" event={"ID":"f73f6931-9502-414c-a31d-229a93e63e5c","Type":"ContainerDied","Data":"97a4aeeb21d06c057a315029df9ca7ffcb6a90058f9162950716343355f497fc"}
Aug 05 16:40:56.742963 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:56.742930    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:56.939701 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:56.939652    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:57.612093 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:57.612061    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:57.678419 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:57.678383    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn" event={"ID":"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a","Type":"ContainerStarted","Data":"daddf33373195b4b9070222bb9032f8b32448601ce1b914574688f74cf0a105e"}
Aug 05 16:40:57.678868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:57.678451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn" event={"ID":"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a","Type":"ContainerStarted","Data":"a82e8e5404ee7fa671e7561a6bd2fccb78e174268abb01b9307239bd3b391871"}
Aug 05 16:40:57.678868 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:57.678480    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn" event={"ID":"44ee2551-7b6a-4ca7-8ce5-bb7132d7626a","Type":"ContainerStarted","Data":"3f8857b6cedf3d8a9a7ff68a459b8729796a5cdfe73e38d136ef953809ee7f27"}
Aug 05 16:40:57.680071 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:57.680046    2575 generic.go:356] "Generic (PLEG): container finished" podID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerID="911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5" exitCode=0
Aug 05 16:40:57.680186 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:57.680125    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerDied","Data":"911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5"}
Aug 05 16:40:57.682352 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:57.682331    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kz4hj" event={"ID":"f73f6931-9502-414c-a31d-229a93e63e5c","Type":"ContainerStarted","Data":"5445464578b12ed749304d0338fb94baf67c28a07cfaec36baf43dc79238e31b"}
Aug 05 16:40:57.682431 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:57.682372    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kz4hj" event={"ID":"f73f6931-9502-414c-a31d-229a93e63e5c","Type":"ContainerStarted","Data":"fa14c6a6ba019789f4a6d4ccac203d24ef59523abb60f7672762d2c9589081b3"}
Aug 05 16:40:57.699831 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:57.699775    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-9ddwn" podStartSLOduration=2.755988975 podStartE2EDuration="4.699763246s" totalImagesPullingTime="1.943774271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:57.698334843 +0000 UTC m=+112.147881155" watchObservedRunningTime="2026-08-05 16:40:57.699763246 +0000 UTC m=+112.149309544"
Aug 05 16:40:57.721031 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:57.720990    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kz4hj" podStartSLOduration=3.622192312 podStartE2EDuration="4.720977115s" totalImagesPullingTime="1.025074828s" totalInitContainerRuntime="73.709975ms" isStatefulPod=true podCreationTimestamp="2026-08-05 16:40:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:57.719766806 +0000 UTC m=+112.169313107" watchObservedRunningTime="2026-08-05 16:40:57.720977115 +0000 UTC m=+112.170523446"
Aug 05 16:40:57.994760 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:57.994725    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f48dbb44f-54b49"]
Aug 05 16:40:57.997935 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:57.997919    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.002654 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.002635    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-16vbieh9ml0av\""
Aug 05 16:40:58.003387 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.003369    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Aug 05 16:40:58.003387 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.003378    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Aug 05 16:40:58.003576 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.003431    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mz2gm\""
Aug 05 16:40:58.003576 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.003470    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 05 16:40:58.003699 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.003686    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Aug 05 16:40:58.014935 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.014913    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f48dbb44f-54b49"]
Aug 05 16:40:58.139531 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.139500    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-audit-log\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.139674 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.139542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-secret-metrics-server-client-certs\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.139674 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.139568    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.139674 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.139626    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-metrics-server-audit-profiles\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.139787 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.139690    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-secret-metrics-server-tls\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.139787 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.139724    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7lfb\" (UniqueName: \"kubernetes.io/projected/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-kube-api-access-p7lfb\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.139787 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.139763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-client-ca-bundle\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.241228 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.241193    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-audit-log\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.241400 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.241244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-secret-metrics-server-client-certs\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.241400 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.241273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.241400 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.241300    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-metrics-server-audit-profiles\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.241400 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.241349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-secret-metrics-server-tls\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.241400 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.241386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7lfb\" (UniqueName: \"kubernetes.io/projected/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-kube-api-access-p7lfb\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.242784 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.241424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-client-ca-bundle\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.242784 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.241613    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-audit-log\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.242784 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.242425    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.244626 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.244580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-metrics-server-audit-profiles\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.245665 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.245588    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-secret-metrics-server-tls\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.246252 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.246233    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-client-ca-bundle\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.246392 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.246368    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-secret-metrics-server-client-certs\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.256899 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.256871    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7lfb\" (UniqueName: \"kubernetes.io/projected/529b3595-b8ab-4c0c-b10a-ee9a83309cdb-kube-api-access-p7lfb\") pod \"metrics-server-5f48dbb44f-54b49\" (UID: \"529b3595-b8ab-4c0c-b10a-ee9a83309cdb\") " pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.298635 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.298587    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:58.307537 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.307512    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:40:58.452310 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.452280    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f48dbb44f-54b49"]
Aug 05 16:40:58.456223 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:40:58.456199    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529b3595_b8ab_4c0c_b10a_ee9a83309cdb.slice/crio-182407a8dfd0fa39f21546717d0092dddbfa64c5727c19899c06a951a6408451 WatchSource:0}: Error finding container 182407a8dfd0fa39f21546717d0092dddbfa64c5727c19899c06a951a6408451: Status 404 returned error can't find the container with id 182407a8dfd0fa39f21546717d0092dddbfa64c5727c19899c06a951a6408451
Aug 05 16:40:58.687752 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.687717    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49" event={"ID":"529b3595-b8ab-4c0c-b10a-ee9a83309cdb","Type":"ContainerStarted","Data":"182407a8dfd0fa39f21546717d0092dddbfa64c5727c19899c06a951a6408451"}
Aug 05 16:40:58.860367 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:58.860326    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:40:59.696179 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:59.696150    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerStarted","Data":"1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c"}
Aug 05 16:40:59.696569 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:59.696217    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerStarted","Data":"0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f"}
Aug 05 16:40:59.696569 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:59.696243    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerStarted","Data":"c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6"}
Aug 05 16:40:59.696569 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:59.696276    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerStarted","Data":"619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2"}
Aug 05 16:40:59.696569 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:59.696315    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerStarted","Data":"bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e"}
Aug 05 16:40:59.999125 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:40:59.999036    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:00.004260 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.004236    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:41:00.008363 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.008341    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.010960 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.010939    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 05 16:41:00.011191 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.011169    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 05 16:41:00.011505 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.011484    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 05 16:41:00.011728 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.011713    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lrxwj\""
Aug 05 16:41:00.013592 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.013574    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 05 16:41:00.013697 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.013681    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 05 16:41:00.013752 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.013692    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 05 16:41:00.014591 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.014571    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 05 16:41:00.014690 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.014622    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7kqq67ou11ev5\""
Aug 05 16:41:00.014792 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.014774    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 05 16:41:00.014910 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.014865    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 05 16:41:00.015541 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.015520    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 05 16:41:00.015798 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.015751    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 05 16:41:00.015798 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.015758    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 05 16:41:00.020914 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.020888    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 05 16:41:00.026097 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.025978    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 05 16:41:00.033227 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.033203    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:41:00.166423 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.166391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.166423 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.166439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.166670 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.166457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.166670 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.166505    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.166670 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.166550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.166670 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.166643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.166670 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.166660    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smbdc\" (UniqueName: \"kubernetes.io/projected/51663f19-a642-4f2d-925e-afa6e293fadb-kube-api-access-smbdc\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.166947 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.166677    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.166947 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.166703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.166947 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.166759    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.166947 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.166864    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51663f19-a642-4f2d-925e-afa6e293fadb-config-out\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.166947 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.166919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.166947 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.166946    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-config\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.167262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.166993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.167262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.167039    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.167262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.167061    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-web-config\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.167262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.167086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.167262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.167119    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.167262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.167144    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.167262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.167171    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51663f19-a642-4f2d-925e-afa6e293fadb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.267762 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.267734    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.267884 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.267785    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51663f19-a642-4f2d-925e-afa6e293fadb-config-out\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.267884 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.267838    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.267884 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.267865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-config\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268054 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.267908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268054 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.267944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268054 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.267958    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-web-config\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268054 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.267974    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268054 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.268004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268054 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.268029    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268054 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.268054    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51663f19-a642-4f2d-925e-afa6e293fadb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.268077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.268118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.268141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.268171    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.268231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.268282    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.268308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smbdc\" (UniqueName: \"kubernetes.io/projected/51663f19-a642-4f2d-925e-afa6e293fadb-kube-api-access-smbdc\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.268337    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.268385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.268370    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.269112 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.268999    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.270521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.270270    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.271982 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.271958    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51663f19-a642-4f2d-925e-afa6e293fadb-config-out\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.273202 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.272541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.273202 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.272784    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.273202 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.272795    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.273202 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.272934    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-web-config\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.273202 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.272493    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.273202 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.272936    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-config\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.273202 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.273019    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.273202 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.273169    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.273716 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.273669    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.273853 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.273829    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.274130 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.274109    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.274317 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.274294    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.274438 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.274409    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.275039 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.275020    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51663f19-a642-4f2d-925e-afa6e293fadb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.275144 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.275089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.275273 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.275257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.279204 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.279172    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smbdc\" (UniqueName: \"kubernetes.io/projected/51663f19-a642-4f2d-925e-afa6e293fadb-kube-api-access-smbdc\") pod \"prometheus-k8s-0\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.322153 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.322055    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:00.472469 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.472365    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:41:00.541609 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:41:00.541549    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51663f19_a642_4f2d_925e_afa6e293fadb.slice/crio-060b11277441016e07200c13517abc0e39b827c20e969a8b98bf7899b3e14bbd WatchSource:0}: Error finding container 060b11277441016e07200c13517abc0e39b827c20e969a8b98bf7899b3e14bbd: Status 404 returned error can't find the container with id 060b11277441016e07200c13517abc0e39b827c20e969a8b98bf7899b3e14bbd
Aug 05 16:41:00.693472 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.693437    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:00.703086 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.703057    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerStarted","Data":"a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956"}
Aug 05 16:41:00.704613 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.704595    2575 generic.go:356] "Generic (PLEG): container finished" podID="51663f19-a642-4f2d-925e-afa6e293fadb" containerID="02deb62acfcd6c510acaf2a43f0378f3fdd114f629001e87c47ff7f965cd62b4" exitCode=0
Aug 05 16:41:00.704725 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.704678    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerDied","Data":"02deb62acfcd6c510acaf2a43f0378f3fdd114f629001e87c47ff7f965cd62b4"}
Aug 05 16:41:00.704791 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.704752    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerStarted","Data":"060b11277441016e07200c13517abc0e39b827c20e969a8b98bf7899b3e14bbd"}
Aug 05 16:41:00.706303 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.706283    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49" event={"ID":"529b3595-b8ab-4c0c-b10a-ee9a83309cdb","Type":"ContainerStarted","Data":"0e351318c24255dba3ae7767e19220b9b997806b8bac5eb24e51f4944d1716dd"}
Aug 05 16:41:00.742063 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.742013    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.137099984 podStartE2EDuration="5.741987698s" totalImagesPullingTime="3.581133761s" totalInitContainerRuntime="23.753953ms" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:41:00.741120479 +0000 UTC m=+115.190666779" watchObservedRunningTime="2026-08-05 16:41:00.741987698 +0000 UTC m=+115.191533988"
Aug 05 16:41:00.762242 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.762185    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49" podStartSLOduration=1.971168827 podStartE2EDuration="3.762166119s" totalImagesPullingTime="1.790997292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:41:00.760202582 +0000 UTC m=+115.209748882" watchObservedRunningTime="2026-08-05 16:41:00.762166119 +0000 UTC m=+115.211712420"
Aug 05 16:41:00.831388 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:00.831299    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:02.603105 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:02.603078    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b59665466-p5rql"
Aug 05 16:41:02.873780 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:02.873662    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:02.974634 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:02.974596    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:04.726689 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:04.726651    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerStarted","Data":"cc4261544937df466982ee3af4fec3939664a3a945b769bde8f39bc24ddfe535"}
Aug 05 16:41:04.727045 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:04.726716    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerStarted","Data":"d87578ddf1fbc4d0d01cd863bcbaa84dd6c532e852c8f23fe2ba56da6ba7f174"}
Aug 05 16:41:06.621890 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:06.621853    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:06.693392 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:06.693363    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:06.736627 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:06.736594    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerStarted","Data":"c4f489f4e268dd31520d1ccf0df60350566873a980784de8d623cfa936f0e28c"}
Aug 05 16:41:06.736775 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:06.736682    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerStarted","Data":"66c58d023a5ac4b6dd8f527db37fd2a2ec6084e8b04b28cbdf22433d4d430cf6"}
Aug 05 16:41:06.736775 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:06.736712    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerStarted","Data":"98521bb92c097c603d96705cfa3c17de7adf60d417bb0f387c3df42b3266b7c9"}
Aug 05 16:41:06.736775 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:06.736737    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerStarted","Data":"481231d505b34fad61efa875bdfdcd9a9fe35156835e9526bb9bb0001bd0993c"}
Aug 05 16:41:07.276561 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:07.276524    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:07.362942 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:07.362903    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:07.541419 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:07.541332    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:07.715597 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:07.715566    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:07.831835 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:07.831737    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:07.932735 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:07.932707    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:08.031028 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:08.030995    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:08.548272 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:08.548238    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:09.151231 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:09.151195    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:09.333311 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:09.333274    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:10.046010 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:10.045960    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:10.323342 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:10.323242    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:41:10.996146 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:10.996109    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:11.098121 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:11.098088    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:11.521537 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:11.521504    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:11.590212 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:11.590182    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:13.168216 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:13.168175    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:13.267877 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:13.267842    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:14.803371 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:14.803338    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs\") pod \"network-metrics-daemon-8v7cz\" (UID: \"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2\") " pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:41:14.805575 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:14.805550    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2-metrics-certs\") pod \"network-metrics-daemon-8v7cz\" (UID: \"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2\") " pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:41:14.935866 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:14.935843    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7qbz9\""
Aug 05 16:41:14.943853 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:14.943833    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v7cz"
Aug 05 16:41:15.074931 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:15.074839    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=10.954639952 podStartE2EDuration="16.074819397s" totalImagesPullingTime="5.102146635s" totalInitContainerRuntime="18.03281ms" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:41:06.775373704 +0000 UTC m=+121.224920003" watchObservedRunningTime="2026-08-05 16:41:15.074819397 +0000 UTC m=+129.524365694"
Aug 05 16:41:15.075070 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:15.075052    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8v7cz"]
Aug 05 16:41:15.077767 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:41:15.077739    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d9f9ff_1f0f_4bb0_8640_4211bc4f72a2.slice/crio-26ef8437f2365d57eedd7752acf1564c2c16f0242b095d20bdfc7c6b1972bf3b WatchSource:0}: Error finding container 26ef8437f2365d57eedd7752acf1564c2c16f0242b095d20bdfc7c6b1972bf3b: Status 404 returned error can't find the container with id 26ef8437f2365d57eedd7752acf1564c2c16f0242b095d20bdfc7c6b1972bf3b
Aug 05 16:41:15.593060 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:15.593017    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:15.689271 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:15.689235    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:15.774223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:15.774191    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8v7cz" event={"ID":"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2","Type":"ContainerStarted","Data":"26ef8437f2365d57eedd7752acf1564c2c16f0242b095d20bdfc7c6b1972bf3b"}
Aug 05 16:41:16.779195 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:16.779160    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8v7cz" event={"ID":"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2","Type":"ContainerStarted","Data":"196c7d6dbc41b97b7b2b56c787eb3d9bc87429a94b642eceef2330b729532056"}
Aug 05 16:41:16.779668 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:16.779217    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8v7cz" event={"ID":"f6d9f9ff-1f0f-4bb0-8640-4211bc4f72a2","Type":"ContainerStarted","Data":"a50beffb0d7e7b105c6e7b4a246db7a531fea448cb7067eeeeec53572ad7b57f"}
Aug 05 16:41:16.804969 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:16.804920    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8v7cz" podStartSLOduration=129.65763305 podStartE2EDuration="2m10.8049037s" totalImagesPullingTime="1.14727065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:41:16.804017291 +0000 UTC m=+131.253563589" watchObservedRunningTime="2026-08-05 16:41:16.8049037 +0000 UTC m=+131.254449998"
Aug 05 16:41:16.922256 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:16.922222    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:17.034661 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:17.034534    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:18.307867 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:18.307831    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:41:18.308242 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:18.307896    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:41:20.633319 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:20.633282    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:20.720275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:20.720235    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:22.510360 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:22.510326    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:22.610827 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:22.610776    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:22.688031 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:22.688005    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:25.153692 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:25.153652    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:25.262563 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:25.262528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:29.164370 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:29.164338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:29.264786 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:29.264746    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:30.570799 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:30.570751    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:30.672395 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:30.672366    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:37.856920 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:37.856892    2575 generic.go:356] "Generic (PLEG): container finished" podID="6a1923c6-f271-4d98-8c01-c9abefa0543e" containerID="8c0e1c1f7034f36a3af146edeb7c7ec4e06f6dffc0b773582845bac3153548eb" exitCode=0
Aug 05 16:41:37.857223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:37.856962    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4" event={"ID":"6a1923c6-f271-4d98-8c01-c9abefa0543e","Type":"ContainerDied","Data":"8c0e1c1f7034f36a3af146edeb7c7ec4e06f6dffc0b773582845bac3153548eb"}
Aug 05 16:41:37.857285 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:37.857271    2575 scope.go:117] "RemoveContainer" containerID="8c0e1c1f7034f36a3af146edeb7c7ec4e06f6dffc0b773582845bac3153548eb"
Aug 05 16:41:38.313348 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:38.313320    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:41:38.321062 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:38.321036    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f48dbb44f-54b49"
Aug 05 16:41:38.373516 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:38.373468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:38.473598 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:38.473570    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:38.862958 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:38.862920    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fdjc4" event={"ID":"6a1923c6-f271-4d98-8c01-c9abefa0543e","Type":"ContainerStarted","Data":"2fb8dbb7537f614fc3d9746a300d6431fffb18f01beef9b50bc1a2680acf6dfe"}
Aug 05 16:41:41.167088 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:41.167057    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:41.268854 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:41.268800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:41.645215 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:41.645144    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:41.746662 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:41.746634    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:41.879766 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:41.879730    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:41.949910 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:41.949871    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:43.885859 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:43.885827    2575 generic.go:356] "Generic (PLEG): container finished" podID="f78c7b72-7cdf-4eda-8751-975306bd3265" containerID="1b0e43db6d552fd193ba17d06925e0a1a4585725df670ebe8af9e7c45f8da1ea" exitCode=0
Aug 05 16:41:43.886232 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:43.885897    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-pqb7z" event={"ID":"f78c7b72-7cdf-4eda-8751-975306bd3265","Type":"ContainerDied","Data":"1b0e43db6d552fd193ba17d06925e0a1a4585725df670ebe8af9e7c45f8da1ea"}
Aug 05 16:41:43.886275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:43.886238    2575 scope.go:117] "RemoveContainer" containerID="1b0e43db6d552fd193ba17d06925e0a1a4585725df670ebe8af9e7c45f8da1ea"
Aug 05 16:41:44.892142 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:44.892106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-pqb7z" event={"ID":"f78c7b72-7cdf-4eda-8751-975306bd3265","Type":"ContainerStarted","Data":"da0e8a51bfb4794233c291158449604c41a24a175a143eede7aaaf745e74f429"}
Aug 05 16:41:45.537755 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:45.537722    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:45.638230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:45.638201    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:48.907891 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:48.907851    2575 generic.go:356] "Generic (PLEG): container finished" podID="b3db7d60-99ef-4ad5-8bf3-5b186729fcdd" containerID="8086a8669be4347b3d98af80b61d007e72de354f52e608d16ab42f647239487c" exitCode=0
Aug 05 16:41:48.908358 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:48.907918    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4" event={"ID":"b3db7d60-99ef-4ad5-8bf3-5b186729fcdd","Type":"ContainerDied","Data":"8086a8669be4347b3d98af80b61d007e72de354f52e608d16ab42f647239487c"}
Aug 05 16:41:48.908358 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:48.908342    2575 scope.go:117] "RemoveContainer" containerID="8086a8669be4347b3d98af80b61d007e72de354f52e608d16ab42f647239487c"
Aug 05 16:41:49.914223 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:49.914191    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-45kd4" event={"ID":"b3db7d60-99ef-4ad5-8bf3-5b186729fcdd","Type":"ContainerStarted","Data":"3f036d3cd6ef2dbb622f630fc179615b9ed48046e7db66ce353f581acc819639"}
Aug 05 16:41:58.611221 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:58.611141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:58.688628 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:58.688597    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:59.743460 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:59.743430    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:41:59.817905 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:41:59.817874    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:42:00.322722 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:00.322691    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:00.338232 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:00.338211    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:00.976531 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:00.976506    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:10.049095 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:10.049063    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:42:10.120867 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:10.120838    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:42:14.152284 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:14.152251    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:42:14.152714 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:14.152573    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="alertmanager" containerID="cri-o://bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e" gracePeriod=120
Aug 05 16:42:14.152714 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:14.152621    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="kube-rbac-proxy-metric" containerID="cri-o://1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c" gracePeriod=120
Aug 05 16:42:14.152714 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:14.152654    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="config-reloader" containerID="cri-o://619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2" gracePeriod=120
Aug 05 16:42:14.152714 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:14.152678    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="kube-rbac-proxy" containerID="cri-o://0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f" gracePeriod=120
Aug 05 16:42:14.152952 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:14.152698    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="prom-label-proxy" containerID="cri-o://a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956" gracePeriod=120
Aug 05 16:42:14.152952 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:14.152648    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="kube-rbac-proxy-web" containerID="cri-o://c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6" gracePeriod=120
Aug 05 16:42:15.018561 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.018528    2575 generic.go:356] "Generic (PLEG): container finished" podID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerID="a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956" exitCode=0
Aug 05 16:42:15.018561 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.018555    2575 generic.go:356] "Generic (PLEG): container finished" podID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerID="0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f" exitCode=0
Aug 05 16:42:15.018561 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.018560    2575 generic.go:356] "Generic (PLEG): container finished" podID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerID="619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2" exitCode=0
Aug 05 16:42:15.018561 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.018567    2575 generic.go:356] "Generic (PLEG): container finished" podID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerID="bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e" exitCode=0
Aug 05 16:42:15.018854 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.018598    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerDied","Data":"a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956"}
Aug 05 16:42:15.018854 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.018656    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerDied","Data":"0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f"}
Aug 05 16:42:15.018854 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.018682    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerDied","Data":"619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2"}
Aug 05 16:42:15.018854 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.018707    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerDied","Data":"bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e"}
Aug 05 16:42:15.398008 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.397986    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:15.520229 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520157    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvpsv\" (UniqueName: \"kubernetes.io/projected/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-kube-api-access-kvpsv\") pod \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") "
Aug 05 16:42:15.520229 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520187    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-alertmanager-trusted-ca-bundle\") pod \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") "
Aug 05 16:42:15.520229 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520209    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-config-out\") pod \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") "
Aug 05 16:42:15.520510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520252    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-main-tls\") pod \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") "
Aug 05 16:42:15.520510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520277    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-cluster-tls-config\") pod \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") "
Aug 05 16:42:15.520510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520311    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-config-volume\") pod \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") "
Aug 05 16:42:15.520510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520343    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") "
Aug 05 16:42:15.520510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520375    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-web-config\") pod \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") "
Aug 05 16:42:15.520510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520421    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-metrics-client-ca\") pod \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") "
Aug 05 16:42:15.520510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520445    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy\") pod \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") "
Aug 05 16:42:15.520510 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520480    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy-web\") pod \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") "
Aug 05 16:42:15.520922 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520551    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-tls-assets\") pod \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") "
Aug 05 16:42:15.520922 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520580    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-alertmanager-main-db\") pod \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\" (UID: \"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d\") "
Aug 05 16:42:15.520922 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520653    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" (UID: "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:42:15.521058 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.520955    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" (UID: "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:42:15.521058 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.521042    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-alertmanager-main-db\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:15.521160 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.521068    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:15.521392 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.521360    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" (UID: "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:42:15.523364 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.523331    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-kube-api-access-kvpsv" (OuterVolumeSpecName: "kube-api-access-kvpsv") pod "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" (UID: "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d"). InnerVolumeSpecName "kube-api-access-kvpsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:42:15.523776 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.523739    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-config-out" (OuterVolumeSpecName: "config-out") pod "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" (UID: "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:42:15.524205 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.524134    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" (UID: "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:42:15.524298 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.524206    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" (UID: "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:15.524644 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.524619    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" (UID: "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:15.524875 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.524849    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-config-volume" (OuterVolumeSpecName: "config-volume") pod "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" (UID: "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:15.524875 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.524860    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" (UID: "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:15.524989 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.524878    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" (UID: "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:15.528446 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.528403    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" (UID: "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:15.534748 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.534730    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-web-config" (OuterVolumeSpecName: "web-config") pod "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" (UID: "ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:15.621847 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.621825    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-tls-assets\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:15.621847 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.621845    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvpsv\" (UniqueName: \"kubernetes.io/projected/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-kube-api-access-kvpsv\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:15.621961 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.621855    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-config-out\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:15.621961 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.621864    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-main-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:15.621961 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.621872    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-cluster-tls-config\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:15.621961 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.621880    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-config-volume\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:15.621961 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.621889    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:15.621961 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.621897    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-web-config\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:15.621961 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.621905    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-metrics-client-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:15.621961 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.621913    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:15.621961 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:15.621922    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:16.025248 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.025223    2575 generic.go:356] "Generic (PLEG): container finished" podID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerID="1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c" exitCode=0
Aug 05 16:42:16.025346 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.025249    2575 generic.go:356] "Generic (PLEG): container finished" podID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerID="c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6" exitCode=0
Aug 05 16:42:16.025346 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.025285    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerDied","Data":"1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c"}
Aug 05 16:42:16.025346 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.025328    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.025503 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.025347    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerDied","Data":"c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6"}
Aug 05 16:42:16.025503 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.025390    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d","Type":"ContainerDied","Data":"6209419c97c119b64e0cbe776f6c832a70036497a4f7a57b1dcc6bc88cc0a008"}
Aug 05 16:42:16.025503 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.025438    2575 scope.go:117] "RemoveContainer" containerID="a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956"
Aug 05 16:42:16.033079 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.033063    2575 scope.go:117] "RemoveContainer" containerID="1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c"
Aug 05 16:42:16.039770 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.039756    2575 scope.go:117] "RemoveContainer" containerID="0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f"
Aug 05 16:42:16.046094 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.046077    2575 scope.go:117] "RemoveContainer" containerID="c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6"
Aug 05 16:42:16.052964 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.052944    2575 scope.go:117] "RemoveContainer" containerID="619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2"
Aug 05 16:42:16.053928 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.053903    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:42:16.059604 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.059506    2575 scope.go:117] "RemoveContainer" containerID="bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e"
Aug 05 16:42:16.061826 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.061789    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:42:16.067025 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.067011    2575 scope.go:117] "RemoveContainer" containerID="911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5"
Aug 05 16:42:16.075125 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.075105    2575 scope.go:117] "RemoveContainer" containerID="a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956"
Aug 05 16:42:16.075415 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:42:16.075394    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956\": container with ID starting with a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956 not found: ID does not exist" containerID="a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956"
Aug 05 16:42:16.075461 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.075425    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956"} err="failed to get container status \"a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956\": rpc error: code = NotFound desc = could not find container \"a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956\": container with ID starting with a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956 not found: ID does not exist"
Aug 05 16:42:16.075461 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.075458    2575 scope.go:117] "RemoveContainer" containerID="1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c"
Aug 05 16:42:16.075709 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:42:16.075692    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c\": container with ID starting with 1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c not found: ID does not exist" containerID="1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c"
Aug 05 16:42:16.075761 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.075715    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c"} err="failed to get container status \"1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c\": rpc error: code = NotFound desc = could not find container \"1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c\": container with ID starting with 1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c not found: ID does not exist"
Aug 05 16:42:16.075761 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.075730    2575 scope.go:117] "RemoveContainer" containerID="0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f"
Aug 05 16:42:16.075988 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:42:16.075973    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f\": container with ID starting with 0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f not found: ID does not exist" containerID="0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f"
Aug 05 16:42:16.076035 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.075991    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f"} err="failed to get container status \"0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f\": rpc error: code = NotFound desc = could not find container \"0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f\": container with ID starting with 0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f not found: ID does not exist"
Aug 05 16:42:16.076035 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.076003    2575 scope.go:117] "RemoveContainer" containerID="c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6"
Aug 05 16:42:16.076247 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:42:16.076231    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6\": container with ID starting with c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6 not found: ID does not exist" containerID="c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6"
Aug 05 16:42:16.076308 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.076255    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6"} err="failed to get container status \"c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6\": rpc error: code = NotFound desc = could not find container \"c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6\": container with ID starting with c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6 not found: ID does not exist"
Aug 05 16:42:16.076308 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.076274    2575 scope.go:117] "RemoveContainer" containerID="619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2"
Aug 05 16:42:16.076527 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:42:16.076512    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2\": container with ID starting with 619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2 not found: ID does not exist" containerID="619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2"
Aug 05 16:42:16.076587 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.076532    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2"} err="failed to get container status \"619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2\": rpc error: code = NotFound desc = could not find container \"619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2\": container with ID starting with 619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2 not found: ID does not exist"
Aug 05 16:42:16.076587 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.076550    2575 scope.go:117] "RemoveContainer" containerID="bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e"
Aug 05 16:42:16.076780 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:42:16.076762    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e\": container with ID starting with bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e not found: ID does not exist" containerID="bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e"
Aug 05 16:42:16.076846 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.076782    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e"} err="failed to get container status \"bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e\": rpc error: code = NotFound desc = could not find container \"bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e\": container with ID starting with bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e not found: ID does not exist"
Aug 05 16:42:16.076846 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.076797    2575 scope.go:117] "RemoveContainer" containerID="911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5"
Aug 05 16:42:16.077039 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:42:16.077020    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5\": container with ID starting with 911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5 not found: ID does not exist" containerID="911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5"
Aug 05 16:42:16.077088 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.077046    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5"} err="failed to get container status \"911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5\": rpc error: code = NotFound desc = could not find container \"911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5\": container with ID starting with 911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5 not found: ID does not exist"
Aug 05 16:42:16.077088 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.077061    2575 scope.go:117] "RemoveContainer" containerID="a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956"
Aug 05 16:42:16.077278 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.077260    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956"} err="failed to get container status \"a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956\": rpc error: code = NotFound desc = could not find container \"a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956\": container with ID starting with a7da7ddbe62ed53f152bb4cc397acd5d8b1e850299bfc12caf5469dda8f11956 not found: ID does not exist"
Aug 05 16:42:16.077321 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.077278    2575 scope.go:117] "RemoveContainer" containerID="1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c"
Aug 05 16:42:16.077492 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.077474    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c"} err="failed to get container status \"1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c\": rpc error: code = NotFound desc = could not find container \"1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c\": container with ID starting with 1728a306965f980f6527f3ed969d91407e5bc4fc4604f7642105f03fe0bf370c not found: ID does not exist"
Aug 05 16:42:16.077545 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.077493    2575 scope.go:117] "RemoveContainer" containerID="0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f"
Aug 05 16:42:16.077702 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.077681    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f"} err="failed to get container status \"0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f\": rpc error: code = NotFound desc = could not find container \"0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f\": container with ID starting with 0b997f07e6a3d37c29141139f3369bcbd619100997470c38f820f2d269abac7f not found: ID does not exist"
Aug 05 16:42:16.077770 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.077704    2575 scope.go:117] "RemoveContainer" containerID="c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6"
Aug 05 16:42:16.077959 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.077941    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6"} err="failed to get container status \"c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6\": rpc error: code = NotFound desc = could not find container \"c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6\": container with ID starting with c3d130de7183b677d7df415938675a06e81c5a975c4e1dda2bd528f19aa336f6 not found: ID does not exist"
Aug 05 16:42:16.078031 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.077961    2575 scope.go:117] "RemoveContainer" containerID="619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2"
Aug 05 16:42:16.078212 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.078191    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2"} err="failed to get container status \"619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2\": rpc error: code = NotFound desc = could not find container \"619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2\": container with ID starting with 619e58075136d54690e0abd83f4b5bdaea1a2455d90d5c2009d87820cc54fcf2 not found: ID does not exist"
Aug 05 16:42:16.078212 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.078211    2575 scope.go:117] "RemoveContainer" containerID="bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e"
Aug 05 16:42:16.078407 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.078392    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e"} err="failed to get container status \"bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e\": rpc error: code = NotFound desc = could not find container \"bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e\": container with ID starting with bd6adbe6ca5bf5d6b5d19d7829eb5ed57475c753f96ac1fdabac81b2ef6a5a1e not found: ID does not exist"
Aug 05 16:42:16.078456 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.078407    2575 scope.go:117] "RemoveContainer" containerID="911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5"
Aug 05 16:42:16.078617 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.078601    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5"} err="failed to get container status \"911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5\": rpc error: code = NotFound desc = could not find container \"911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5\": container with ID starting with 911c03b1a433052b34d26f7e7677b87d82b116f9d07149f747aa3b55e74126c5 not found: ID does not exist"
Aug 05 16:42:16.092683 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.092659    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:42:16.092956 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.092943    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="config-reloader"
Aug 05 16:42:16.093006 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.092959    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="config-reloader"
Aug 05 16:42:16.093006 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.092967    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="prom-label-proxy"
Aug 05 16:42:16.093006 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.092973    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="prom-label-proxy"
Aug 05 16:42:16.093006 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.092983    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="alertmanager"
Aug 05 16:42:16.093006 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.092989    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="alertmanager"
Aug 05 16:42:16.093006 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.092994    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="kube-rbac-proxy-metric"
Aug 05 16:42:16.093006 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.093000    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="kube-rbac-proxy-metric"
Aug 05 16:42:16.093230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.093013    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="init-config-reloader"
Aug 05 16:42:16.093230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.093019    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="init-config-reloader"
Aug 05 16:42:16.093230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.093026    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="kube-rbac-proxy-web"
Aug 05 16:42:16.093230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.093031    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="kube-rbac-proxy-web"
Aug 05 16:42:16.093230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.093037    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="kube-rbac-proxy"
Aug 05 16:42:16.093230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.093041    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="kube-rbac-proxy"
Aug 05 16:42:16.093230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.093087    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="kube-rbac-proxy"
Aug 05 16:42:16.093230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.093097    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="prom-label-proxy"
Aug 05 16:42:16.093230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.093103    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="config-reloader"
Aug 05 16:42:16.093230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.093109    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="alertmanager"
Aug 05 16:42:16.093230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.093114    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="kube-rbac-proxy-metric"
Aug 05 16:42:16.093230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.093121    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" containerName="kube-rbac-proxy-web"
Aug 05 16:42:16.098121 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.098105    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.100641 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.100621    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 05 16:42:16.100716 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.100646    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 05 16:42:16.100793 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.100757    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 05 16:42:16.101023 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.101004    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 05 16:42:16.101114 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.101094    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 05 16:42:16.101174 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.101112    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dgvbn\""
Aug 05 16:42:16.101174 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.101097    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 05 16:42:16.101174 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.101153    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 05 16:42:16.101434 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.101421    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 05 16:42:16.109262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.109246    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 05 16:42:16.114208 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.114189    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:42:16.227017 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.226985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvjjb\" (UniqueName: \"kubernetes.io/projected/489ecca6-1e00-4435-836c-958afc542a36-kube-api-access-pvjjb\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.227168 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.227033    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.227168 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.227063    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.227275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.227157    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-config-volume\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.227275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.227205    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/489ecca6-1e00-4435-836c-958afc542a36-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.227275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.227259    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.227385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.227286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/489ecca6-1e00-4435-836c-958afc542a36-config-out\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.227385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.227316    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/489ecca6-1e00-4435-836c-958afc542a36-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.227385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.227355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.227385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.227379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-web-config\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.227531 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.227397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/489ecca6-1e00-4435-836c-958afc542a36-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.227531 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.227431    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.227531 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.227512    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/489ecca6-1e00-4435-836c-958afc542a36-tls-assets\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.328791 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.328708    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-config-volume\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.328791 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.328750    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/489ecca6-1e00-4435-836c-958afc542a36-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.328791 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.328776    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.329093 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.328797    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/489ecca6-1e00-4435-836c-958afc542a36-config-out\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.329093 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.328847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/489ecca6-1e00-4435-836c-958afc542a36-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.329093 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.328866    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.329093 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.328884    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-web-config\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.329093 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.328905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/489ecca6-1e00-4435-836c-958afc542a36-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.329093 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.328929    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.329093 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.328974    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/489ecca6-1e00-4435-836c-958afc542a36-tls-assets\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.329093 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.329030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvjjb\" (UniqueName: \"kubernetes.io/projected/489ecca6-1e00-4435-836c-958afc542a36-kube-api-access-pvjjb\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.329093 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.329059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.329093 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.329082    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.329564 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.329364    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/489ecca6-1e00-4435-836c-958afc542a36-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.329620 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.329601    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/489ecca6-1e00-4435-836c-958afc542a36-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.329928 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.329900    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/489ecca6-1e00-4435-836c-958afc542a36-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.332126 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.331951    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-web-config\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.332126 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.331990    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/489ecca6-1e00-4435-836c-958afc542a36-tls-assets\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.332126 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.332033    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.332126 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.332082    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.332363 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.332197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/489ecca6-1e00-4435-836c-958afc542a36-config-out\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.332472 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.332445    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.332517 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.332447    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-config-volume\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.332744 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.332728    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.334267 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.334246    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/489ecca6-1e00-4435-836c-958afc542a36-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.338899 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.338879    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvjjb\" (UniqueName: \"kubernetes.io/projected/489ecca6-1e00-4435-836c-958afc542a36-kube-api-access-pvjjb\") pod \"alertmanager-main-0\" (UID: \"489ecca6-1e00-4435-836c-958afc542a36\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.407676 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.407648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 16:42:16.562456 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:16.562428    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 16:42:16.564070 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:42:16.564043    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489ecca6_1e00_4435_836c_958afc542a36.slice/crio-80837bfe9b69aa9f9009c327699ed642e736f161bc8fc231f7fcb8bdedbe009b WatchSource:0}: Error finding container 80837bfe9b69aa9f9009c327699ed642e736f161bc8fc231f7fcb8bdedbe009b: Status 404 returned error can't find the container with id 80837bfe9b69aa9f9009c327699ed642e736f161bc8fc231f7fcb8bdedbe009b
Aug 05 16:42:17.030981 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:17.030950    2575 generic.go:356] "Generic (PLEG): container finished" podID="489ecca6-1e00-4435-836c-958afc542a36" containerID="a43fb9e492a0f31e1c7c61db982cfd0ba8402358ef16405040b5d8389fa4bbbd" exitCode=0
Aug 05 16:42:17.031185 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:17.030994    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"489ecca6-1e00-4435-836c-958afc542a36","Type":"ContainerDied","Data":"a43fb9e492a0f31e1c7c61db982cfd0ba8402358ef16405040b5d8389fa4bbbd"}
Aug 05 16:42:17.031185 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:17.031039    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"489ecca6-1e00-4435-836c-958afc542a36","Type":"ContainerStarted","Data":"80837bfe9b69aa9f9009c327699ed642e736f161bc8fc231f7fcb8bdedbe009b"}
Aug 05 16:42:18.012838 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.012792    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d" path="/var/lib/kubelet/pods/ec5fe900-8a78-4d30-bd37-d1a25fb2fd4d/volumes"
Aug 05 16:42:18.037737 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.037711    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"489ecca6-1e00-4435-836c-958afc542a36","Type":"ContainerStarted","Data":"3657b1101596284144573dc228c754d5a7add057d06dffa6aa549557b62ea293"}
Aug 05 16:42:18.037913 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.037781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"489ecca6-1e00-4435-836c-958afc542a36","Type":"ContainerStarted","Data":"735fdb63904b4980b26afb3fa618fea06b7f448e1347e2ca5d575a9a071ae194"}
Aug 05 16:42:18.037913 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.037842    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"489ecca6-1e00-4435-836c-958afc542a36","Type":"ContainerStarted","Data":"b2adf548be85f8a9821f25774394a2c827fb2db68ba94b5e53d60cc4129b71ac"}
Aug 05 16:42:18.037913 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.037886    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"489ecca6-1e00-4435-836c-958afc542a36","Type":"ContainerStarted","Data":"a1b2be2a15df8222dad8144993feaefdf7dd5d89592b6c1ada118adedec717c3"}
Aug 05 16:42:18.038066 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.037924    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"489ecca6-1e00-4435-836c-958afc542a36","Type":"ContainerStarted","Data":"7132be95ee99bdb063eb6c9dddbf38e8e1acf36d0603e5d988ac648424b57a37"}
Aug 05 16:42:18.038066 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.037963    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"489ecca6-1e00-4435-836c-958afc542a36","Type":"ContainerStarted","Data":"8ceb02ffbc1d4daea6d699a699d0900256c1107cdaf96b859b472745c1fcef55"}
Aug 05 16:42:18.071159 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.071110    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.055582679 podStartE2EDuration="2.071091383s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.508704ms" isStatefulPod=false podCreationTimestamp="2026-08-05 16:42:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:42:18.069593344 +0000 UTC m=+192.519139644" watchObservedRunningTime="2026-08-05 16:42:18.071091383 +0000 UTC m=+192.520637684"
Aug 05 16:42:18.422299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.422267    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:42:18.422583 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.422545    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="prometheus" containerID="cri-o://d87578ddf1fbc4d0d01cd863bcbaa84dd6c532e852c8f23fe2ba56da6ba7f174" gracePeriod=600
Aug 05 16:42:18.422583 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.422550    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="kube-rbac-proxy" containerID="cri-o://66c58d023a5ac4b6dd8f527db37fd2a2ec6084e8b04b28cbdf22433d4d430cf6" gracePeriod=600
Aug 05 16:42:18.422783 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.422583    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="thanos-sidecar" containerID="cri-o://481231d505b34fad61efa875bdfdcd9a9fe35156835e9526bb9bb0001bd0993c" gracePeriod=600
Aug 05 16:42:18.422783 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.422619    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="kube-rbac-proxy-web" containerID="cri-o://98521bb92c097c603d96705cfa3c17de7adf60d417bb0f387c3df42b3266b7c9" gracePeriod=600
Aug 05 16:42:18.422783 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.422606    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="config-reloader" containerID="cri-o://cc4261544937df466982ee3af4fec3939664a3a945b769bde8f39bc24ddfe535" gracePeriod=600
Aug 05 16:42:18.422783 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:18.422627    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c4f489f4e268dd31520d1ccf0df60350566873a980784de8d623cfa936f0e28c" gracePeriod=600
Aug 05 16:42:19.044768 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.044736    2575 generic.go:356] "Generic (PLEG): container finished" podID="51663f19-a642-4f2d-925e-afa6e293fadb" containerID="c4f489f4e268dd31520d1ccf0df60350566873a980784de8d623cfa936f0e28c" exitCode=0
Aug 05 16:42:19.044768 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.044761    2575 generic.go:356] "Generic (PLEG): container finished" podID="51663f19-a642-4f2d-925e-afa6e293fadb" containerID="66c58d023a5ac4b6dd8f527db37fd2a2ec6084e8b04b28cbdf22433d4d430cf6" exitCode=0
Aug 05 16:42:19.044768 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.044770    2575 generic.go:356] "Generic (PLEG): container finished" podID="51663f19-a642-4f2d-925e-afa6e293fadb" containerID="481231d505b34fad61efa875bdfdcd9a9fe35156835e9526bb9bb0001bd0993c" exitCode=0
Aug 05 16:42:19.044768 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.044777    2575 generic.go:356] "Generic (PLEG): container finished" podID="51663f19-a642-4f2d-925e-afa6e293fadb" containerID="cc4261544937df466982ee3af4fec3939664a3a945b769bde8f39bc24ddfe535" exitCode=0
Aug 05 16:42:19.044768 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.044785    2575 generic.go:356] "Generic (PLEG): container finished" podID="51663f19-a642-4f2d-925e-afa6e293fadb" containerID="d87578ddf1fbc4d0d01cd863bcbaa84dd6c532e852c8f23fe2ba56da6ba7f174" exitCode=0
Aug 05 16:42:19.045424 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.044824    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerDied","Data":"c4f489f4e268dd31520d1ccf0df60350566873a980784de8d623cfa936f0e28c"}
Aug 05 16:42:19.045424 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.044886    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerDied","Data":"66c58d023a5ac4b6dd8f527db37fd2a2ec6084e8b04b28cbdf22433d4d430cf6"}
Aug 05 16:42:19.045424 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.044914    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerDied","Data":"481231d505b34fad61efa875bdfdcd9a9fe35156835e9526bb9bb0001bd0993c"}
Aug 05 16:42:19.045424 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.044950    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerDied","Data":"cc4261544937df466982ee3af4fec3939664a3a945b769bde8f39bc24ddfe535"}
Aug 05 16:42:19.045424 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.044973    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerDied","Data":"d87578ddf1fbc4d0d01cd863bcbaa84dd6c532e852c8f23fe2ba56da6ba7f174"}
Aug 05 16:42:19.670075 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.670052    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:19.762270 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762191    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smbdc\" (UniqueName: \"kubernetes.io/projected/51663f19-a642-4f2d-925e-afa6e293fadb-kube-api-access-smbdc\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.762270 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762230    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51663f19-a642-4f2d-925e-afa6e293fadb-tls-assets\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.762270 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762270    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-serving-certs-ca-bundle\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.762542 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762292    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-web-config\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.762542 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762310    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-db\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.762542 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762366    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-grpc-tls\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.762542 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762400    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.762542 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762428    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-kube-rbac-proxy\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.762542 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762457    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-kubelet-serving-ca-bundle\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.762542 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762481    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-metrics-client-ca\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.762542 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762512    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-tls\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.762542 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762538    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-trusted-ca-bundle\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.763018 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762571    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-thanos-prometheus-http-client-file\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.763018 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762606    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51663f19-a642-4f2d-925e-afa6e293fadb-config-out\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.763018 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762631    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-metrics-client-certs\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.763018 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762656    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.763018 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762702    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-1\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.763018 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762728    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-2\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.763018 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762751    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-config\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.763018 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762787    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:42:19.763018 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762795    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-0\") pod \"51663f19-a642-4f2d-925e-afa6e293fadb\" (UID: \"51663f19-a642-4f2d-925e-afa6e293fadb\") "
Aug 05 16:42:19.763018 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.762913    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:42:19.763591 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.763563    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.763654 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.763596    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.764184 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.763907    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:42:19.764184 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.764156    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:42:19.764877 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.764849    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:19.765169 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.765146    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:42:19.765262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.765179    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51663f19-a642-4f2d-925e-afa6e293fadb-kube-api-access-smbdc" (OuterVolumeSpecName: "kube-api-access-smbdc") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "kube-api-access-smbdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:42:19.765678 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.765414    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:19.766209 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.765986    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:42:19.766209 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.766169    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:42:19.766519 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.766483    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:42:19.766624 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.766563    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51663f19-a642-4f2d-925e-afa6e293fadb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:42:19.766912 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.766886    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:19.766981 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.766910    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:19.767318 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.767297    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51663f19-a642-4f2d-925e-afa6e293fadb-config-out" (OuterVolumeSpecName: "config-out") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:42:19.767484 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.767466    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:19.768272 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.768244    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:19.768345 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.768255    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:19.768788 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.768768    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-config" (OuterVolumeSpecName: "config") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:19.776167 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.776146    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-web-config" (OuterVolumeSpecName: "web-config") pod "51663f19-a642-4f2d-925e-afa6e293fadb" (UID: "51663f19-a642-4f2d-925e-afa6e293fadb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:42:19.864123 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864095    2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-grpc-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864123 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864119    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864130    2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-kube-rbac-proxy\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864142    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-configmap-metrics-client-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864150    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864159    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864169    2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864178    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51663f19-a642-4f2d-925e-afa6e293fadb-config-out\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864185    2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-metrics-client-certs\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864194    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864203    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864211    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864220    2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-config\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864229    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864238    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smbdc\" (UniqueName: \"kubernetes.io/projected/51663f19-a642-4f2d-925e-afa6e293fadb-kube-api-access-smbdc\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864246    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51663f19-a642-4f2d-925e-afa6e293fadb-tls-assets\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864255    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51663f19-a642-4f2d-925e-afa6e293fadb-web-config\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:19.864275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:19.864262    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51663f19-a642-4f2d-925e-afa6e293fadb-prometheus-k8s-db\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 16:42:20.051460 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.051428    2575 generic.go:356] "Generic (PLEG): container finished" podID="51663f19-a642-4f2d-925e-afa6e293fadb" containerID="98521bb92c097c603d96705cfa3c17de7adf60d417bb0f387c3df42b3266b7c9" exitCode=0
Aug 05 16:42:20.051762 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.051513    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerDied","Data":"98521bb92c097c603d96705cfa3c17de7adf60d417bb0f387c3df42b3266b7c9"}
Aug 05 16:42:20.051762 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.051526    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.051762 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.051579    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51663f19-a642-4f2d-925e-afa6e293fadb","Type":"ContainerDied","Data":"060b11277441016e07200c13517abc0e39b827c20e969a8b98bf7899b3e14bbd"}
Aug 05 16:42:20.051762 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.051613    2575 scope.go:117] "RemoveContainer" containerID="c4f489f4e268dd31520d1ccf0df60350566873a980784de8d623cfa936f0e28c"
Aug 05 16:42:20.059701 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.059682    2575 scope.go:117] "RemoveContainer" containerID="66c58d023a5ac4b6dd8f527db37fd2a2ec6084e8b04b28cbdf22433d4d430cf6"
Aug 05 16:42:20.066361 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.066343    2575 scope.go:117] "RemoveContainer" containerID="98521bb92c097c603d96705cfa3c17de7adf60d417bb0f387c3df42b3266b7c9"
Aug 05 16:42:20.072684 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.072664    2575 scope.go:117] "RemoveContainer" containerID="481231d505b34fad61efa875bdfdcd9a9fe35156835e9526bb9bb0001bd0993c"
Aug 05 16:42:20.075204 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.075184    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:42:20.080850 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.080737    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:42:20.080995 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.080969    2575 scope.go:117] "RemoveContainer" containerID="cc4261544937df466982ee3af4fec3939664a3a945b769bde8f39bc24ddfe535"
Aug 05 16:42:20.092130 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.092104    2575 scope.go:117] "RemoveContainer" containerID="d87578ddf1fbc4d0d01cd863bcbaa84dd6c532e852c8f23fe2ba56da6ba7f174"
Aug 05 16:42:20.103636 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.103613    2575 scope.go:117] "RemoveContainer" containerID="02deb62acfcd6c510acaf2a43f0378f3fdd114f629001e87c47ff7f965cd62b4"
Aug 05 16:42:20.107905 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.107885    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:42:20.108244 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108230    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="thanos-sidecar"
Aug 05 16:42:20.108299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108246    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="thanos-sidecar"
Aug 05 16:42:20.108299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108259    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="kube-rbac-proxy-thanos"
Aug 05 16:42:20.108299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108265    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="kube-rbac-proxy-thanos"
Aug 05 16:42:20.108299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108274    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="kube-rbac-proxy"
Aug 05 16:42:20.108299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108279    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="kube-rbac-proxy"
Aug 05 16:42:20.108299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108291    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="init-config-reloader"
Aug 05 16:42:20.108299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108296    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="init-config-reloader"
Aug 05 16:42:20.108521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108302    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="prometheus"
Aug 05 16:42:20.108521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108307    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="prometheus"
Aug 05 16:42:20.108521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108316    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="config-reloader"
Aug 05 16:42:20.108521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108321    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="config-reloader"
Aug 05 16:42:20.108521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108328    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="kube-rbac-proxy-web"
Aug 05 16:42:20.108521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108333    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="kube-rbac-proxy-web"
Aug 05 16:42:20.108521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108388    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="kube-rbac-proxy-web"
Aug 05 16:42:20.108521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108394    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="kube-rbac-proxy-thanos"
Aug 05 16:42:20.108521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108402    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="thanos-sidecar"
Aug 05 16:42:20.108521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108409    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="kube-rbac-proxy"
Aug 05 16:42:20.108521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108415    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="prometheus"
Aug 05 16:42:20.108521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.108422    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" containerName="config-reloader"
Aug 05 16:42:20.110934 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.110916    2575 scope.go:117] "RemoveContainer" containerID="c4f489f4e268dd31520d1ccf0df60350566873a980784de8d623cfa936f0e28c"
Aug 05 16:42:20.111175 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:42:20.111156    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4f489f4e268dd31520d1ccf0df60350566873a980784de8d623cfa936f0e28c\": container with ID starting with c4f489f4e268dd31520d1ccf0df60350566873a980784de8d623cfa936f0e28c not found: ID does not exist" containerID="c4f489f4e268dd31520d1ccf0df60350566873a980784de8d623cfa936f0e28c"
Aug 05 16:42:20.111240 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.111183    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f489f4e268dd31520d1ccf0df60350566873a980784de8d623cfa936f0e28c"} err="failed to get container status \"c4f489f4e268dd31520d1ccf0df60350566873a980784de8d623cfa936f0e28c\": rpc error: code = NotFound desc = could not find container \"c4f489f4e268dd31520d1ccf0df60350566873a980784de8d623cfa936f0e28c\": container with ID starting with c4f489f4e268dd31520d1ccf0df60350566873a980784de8d623cfa936f0e28c not found: ID does not exist"
Aug 05 16:42:20.111240 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.111201    2575 scope.go:117] "RemoveContainer" containerID="66c58d023a5ac4b6dd8f527db37fd2a2ec6084e8b04b28cbdf22433d4d430cf6"
Aug 05 16:42:20.111461 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:42:20.111444    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66c58d023a5ac4b6dd8f527db37fd2a2ec6084e8b04b28cbdf22433d4d430cf6\": container with ID starting with 66c58d023a5ac4b6dd8f527db37fd2a2ec6084e8b04b28cbdf22433d4d430cf6 not found: ID does not exist" containerID="66c58d023a5ac4b6dd8f527db37fd2a2ec6084e8b04b28cbdf22433d4d430cf6"
Aug 05 16:42:20.111502 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.111467    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66c58d023a5ac4b6dd8f527db37fd2a2ec6084e8b04b28cbdf22433d4d430cf6"} err="failed to get container status \"66c58d023a5ac4b6dd8f527db37fd2a2ec6084e8b04b28cbdf22433d4d430cf6\": rpc error: code = NotFound desc = could not find container \"66c58d023a5ac4b6dd8f527db37fd2a2ec6084e8b04b28cbdf22433d4d430cf6\": container with ID starting with 66c58d023a5ac4b6dd8f527db37fd2a2ec6084e8b04b28cbdf22433d4d430cf6 not found: ID does not exist"
Aug 05 16:42:20.111502 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.111482    2575 scope.go:117] "RemoveContainer" containerID="98521bb92c097c603d96705cfa3c17de7adf60d417bb0f387c3df42b3266b7c9"
Aug 05 16:42:20.111709 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:42:20.111693    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98521bb92c097c603d96705cfa3c17de7adf60d417bb0f387c3df42b3266b7c9\": container with ID starting with 98521bb92c097c603d96705cfa3c17de7adf60d417bb0f387c3df42b3266b7c9 not found: ID does not exist" containerID="98521bb92c097c603d96705cfa3c17de7adf60d417bb0f387c3df42b3266b7c9"
Aug 05 16:42:20.111744 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.111712    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98521bb92c097c603d96705cfa3c17de7adf60d417bb0f387c3df42b3266b7c9"} err="failed to get container status \"98521bb92c097c603d96705cfa3c17de7adf60d417bb0f387c3df42b3266b7c9\": rpc error: code = NotFound desc = could not find container \"98521bb92c097c603d96705cfa3c17de7adf60d417bb0f387c3df42b3266b7c9\": container with ID starting with 98521bb92c097c603d96705cfa3c17de7adf60d417bb0f387c3df42b3266b7c9 not found: ID does not exist"
Aug 05 16:42:20.111744 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.111725    2575 scope.go:117] "RemoveContainer" containerID="481231d505b34fad61efa875bdfdcd9a9fe35156835e9526bb9bb0001bd0993c"
Aug 05 16:42:20.112009 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:42:20.111962    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"481231d505b34fad61efa875bdfdcd9a9fe35156835e9526bb9bb0001bd0993c\": container with ID starting with 481231d505b34fad61efa875bdfdcd9a9fe35156835e9526bb9bb0001bd0993c not found: ID does not exist" containerID="481231d505b34fad61efa875bdfdcd9a9fe35156835e9526bb9bb0001bd0993c"
Aug 05 16:42:20.112009 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.111986    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"481231d505b34fad61efa875bdfdcd9a9fe35156835e9526bb9bb0001bd0993c"} err="failed to get container status \"481231d505b34fad61efa875bdfdcd9a9fe35156835e9526bb9bb0001bd0993c\": rpc error: code = NotFound desc = could not find container \"481231d505b34fad61efa875bdfdcd9a9fe35156835e9526bb9bb0001bd0993c\": container with ID starting with 481231d505b34fad61efa875bdfdcd9a9fe35156835e9526bb9bb0001bd0993c not found: ID does not exist"
Aug 05 16:42:20.112009 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.111999    2575 scope.go:117] "RemoveContainer" containerID="cc4261544937df466982ee3af4fec3939664a3a945b769bde8f39bc24ddfe535"
Aug 05 16:42:20.112266 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:42:20.112245    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc4261544937df466982ee3af4fec3939664a3a945b769bde8f39bc24ddfe535\": container with ID starting with cc4261544937df466982ee3af4fec3939664a3a945b769bde8f39bc24ddfe535 not found: ID does not exist" containerID="cc4261544937df466982ee3af4fec3939664a3a945b769bde8f39bc24ddfe535"
Aug 05 16:42:20.112307 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.112268    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc4261544937df466982ee3af4fec3939664a3a945b769bde8f39bc24ddfe535"} err="failed to get container status \"cc4261544937df466982ee3af4fec3939664a3a945b769bde8f39bc24ddfe535\": rpc error: code = NotFound desc = could not find container \"cc4261544937df466982ee3af4fec3939664a3a945b769bde8f39bc24ddfe535\": container with ID starting with cc4261544937df466982ee3af4fec3939664a3a945b769bde8f39bc24ddfe535 not found: ID does not exist"
Aug 05 16:42:20.112307 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.112284    2575 scope.go:117] "RemoveContainer" containerID="d87578ddf1fbc4d0d01cd863bcbaa84dd6c532e852c8f23fe2ba56da6ba7f174"
Aug 05 16:42:20.112533 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:42:20.112514    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d87578ddf1fbc4d0d01cd863bcbaa84dd6c532e852c8f23fe2ba56da6ba7f174\": container with ID starting with d87578ddf1fbc4d0d01cd863bcbaa84dd6c532e852c8f23fe2ba56da6ba7f174 not found: ID does not exist" containerID="d87578ddf1fbc4d0d01cd863bcbaa84dd6c532e852c8f23fe2ba56da6ba7f174"
Aug 05 16:42:20.112608 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.112541    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87578ddf1fbc4d0d01cd863bcbaa84dd6c532e852c8f23fe2ba56da6ba7f174"} err="failed to get container status \"d87578ddf1fbc4d0d01cd863bcbaa84dd6c532e852c8f23fe2ba56da6ba7f174\": rpc error: code = NotFound desc = could not find container \"d87578ddf1fbc4d0d01cd863bcbaa84dd6c532e852c8f23fe2ba56da6ba7f174\": container with ID starting with d87578ddf1fbc4d0d01cd863bcbaa84dd6c532e852c8f23fe2ba56da6ba7f174 not found: ID does not exist"
Aug 05 16:42:20.112608 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.112561    2575 scope.go:117] "RemoveContainer" containerID="02deb62acfcd6c510acaf2a43f0378f3fdd114f629001e87c47ff7f965cd62b4"
Aug 05 16:42:20.112785 ip-10-0-130-35 kubenswrapper[2575]: E0805 16:42:20.112766    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02deb62acfcd6c510acaf2a43f0378f3fdd114f629001e87c47ff7f965cd62b4\": container with ID starting with 02deb62acfcd6c510acaf2a43f0378f3fdd114f629001e87c47ff7f965cd62b4 not found: ID does not exist" containerID="02deb62acfcd6c510acaf2a43f0378f3fdd114f629001e87c47ff7f965cd62b4"
Aug 05 16:42:20.112847 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.112790    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02deb62acfcd6c510acaf2a43f0378f3fdd114f629001e87c47ff7f965cd62b4"} err="failed to get container status \"02deb62acfcd6c510acaf2a43f0378f3fdd114f629001e87c47ff7f965cd62b4\": rpc error: code = NotFound desc = could not find container \"02deb62acfcd6c510acaf2a43f0378f3fdd114f629001e87c47ff7f965cd62b4\": container with ID starting with 02deb62acfcd6c510acaf2a43f0378f3fdd114f629001e87c47ff7f965cd62b4 not found: ID does not exist"
Aug 05 16:42:20.113899 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.113885    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.116491 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.116471    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 05 16:42:20.116985 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.116952    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 05 16:42:20.117140 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.117015    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 05 16:42:20.117140 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.117034    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 05 16:42:20.117140 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.117034    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 05 16:42:20.117380 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.117165    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 05 16:42:20.117459 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.117387    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 05 16:42:20.117459 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.117387    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lrxwj\""
Aug 05 16:42:20.117459 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.117450    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 05 16:42:20.117604 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.117474    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 05 16:42:20.117855 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.117837    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 05 16:42:20.117953 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.117896    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7kqq67ou11ev5\""
Aug 05 16:42:20.118373 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.118356    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 05 16:42:20.118523 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.118443    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 05 16:42:20.121542 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.121518    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 05 16:42:20.123032 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.123015    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 05 16:42:20.130038 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.130021    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:42:20.267688 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.267656    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.267688 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.267689    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.267937 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.267708    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.267937 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.267726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.267937 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.267744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-config\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.267937 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.267794    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.267937 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.267860    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.267937 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.267883    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rmjt\" (UniqueName: \"kubernetes.io/projected/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-kube-api-access-2rmjt\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.267937 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.267903    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.267937 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.267920    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.268242 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.267984    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.268242 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.268051    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.268242 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.268069    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.268242 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.268088    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.268242 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.268118    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.268242 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.268180    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.268242 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.268203    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.268242 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.268228    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.268491 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.268250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.268491 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.268270    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.369289 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369227    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.369289 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369261    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-config\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.369289 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369280    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.369505 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.369505 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369323    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rmjt\" (UniqueName: \"kubernetes.io/projected/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-kube-api-access-2rmjt\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.369505 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.369505 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369470    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.369746 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.369746 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369550    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.369746 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.369746 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369603    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.369746 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.369746 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369691    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.369746 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.370110 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369760    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.370110 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.370110 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.370110 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369872    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.370110 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369897    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.370110 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.369919    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.370110 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.370107    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.370620 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.370122    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.370620 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.370352    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.370620 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.370476    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.371267 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.370926    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.372420 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.372388    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-config\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.372567 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.372535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.372705 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.372679    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.372774 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.372716    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.372870 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.372845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.373098 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.373071    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.373383 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.373361    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.373547 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.373505    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.373647 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.373554    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.373883 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.373864    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.374578 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.374559    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.374795 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.374777    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.375615 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.375596    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.375952 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.375935    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.383678 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.383663    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rmjt\" (UniqueName: \"kubernetes.io/projected/aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0-kube-api-access-2rmjt\") pod \"prometheus-k8s-0\" (UID: \"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.423782 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.423751    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:20.558741 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:20.558721    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:42:20.560852 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:42:20.560826    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa208187_7ebe_4fa5_8c73_1cd26ca2a5a0.slice/crio-2dd5ac59270efa50728d10301dc4ad254cd293493d175b303d72beabb7c9ff66 WatchSource:0}: Error finding container 2dd5ac59270efa50728d10301dc4ad254cd293493d175b303d72beabb7c9ff66: Status 404 returned error can't find the container with id 2dd5ac59270efa50728d10301dc4ad254cd293493d175b303d72beabb7c9ff66
Aug 05 16:42:21.058660 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:21.058629    2575 generic.go:356] "Generic (PLEG): container finished" podID="aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0" containerID="8da989a0582095ca03a464e5a6812717d3d34122354e11f501db7351fae9e5a2" exitCode=0
Aug 05 16:42:21.059076 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:21.058681    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0","Type":"ContainerDied","Data":"8da989a0582095ca03a464e5a6812717d3d34122354e11f501db7351fae9e5a2"}
Aug 05 16:42:21.059076 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:21.058730    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0","Type":"ContainerStarted","Data":"2dd5ac59270efa50728d10301dc4ad254cd293493d175b303d72beabb7c9ff66"}
Aug 05 16:42:22.016651 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:22.016616    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51663f19-a642-4f2d-925e-afa6e293fadb" path="/var/lib/kubelet/pods/51663f19-a642-4f2d-925e-afa6e293fadb/volumes"
Aug 05 16:42:22.065423 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:22.065394    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0","Type":"ContainerStarted","Data":"0a7eb8520f53ffa848cbafdaf051d4f03a313aff3a144b591565b861319d28cd"}
Aug 05 16:42:22.065827 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:22.065455    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0","Type":"ContainerStarted","Data":"670324ae144ac521d065c025f3ed7239b0d7012cf9df4f286fdd37b7f1f4c367"}
Aug 05 16:42:22.065827 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:22.065482    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0","Type":"ContainerStarted","Data":"c5667ed3d08f288320ada2b29b2bf9c9edbcd5cdde0426246652fe38e3a24341"}
Aug 05 16:42:22.065827 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:22.065505    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0","Type":"ContainerStarted","Data":"589b887d22bb239bf527b57d3c4c319e07d4ba878194c8ace36d659fa1ab304a"}
Aug 05 16:42:22.065827 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:22.065538    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0","Type":"ContainerStarted","Data":"dfe3b89bf00dd364f379c398b795f36dd2297413ce53a90088de7240c5618977"}
Aug 05 16:42:22.065827 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:22.065564    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0","Type":"ContainerStarted","Data":"210025bf5129d1133467dc238cdeaf3d810555d37942c9dae74ca324ffab7b6d"}
Aug 05 16:42:22.101957 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:22.101906    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.08296441 podStartE2EDuration="2.10188881s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.9244ms" isStatefulPod=false podCreationTimestamp="2026-08-05 16:42:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:42:22.101188891 +0000 UTC m=+196.550735190" watchObservedRunningTime="2026-08-05 16:42:22.10188881 +0000 UTC m=+196.551435112"
Aug 05 16:42:22.126350 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:22.126322    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:42:22.209040 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:22.209014    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:42:25.424588 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:25.424535    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:42:30.335819 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:30.335779    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:42:30.466693 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:30.466664    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:42:30.582299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:30.582262    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:42:31.046694 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:31.046669    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:42:41.166676 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:41.166649    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:42:41.365503 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:41.365468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:42:41.468652 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:42:41.468549    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:14.564420 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:14.564370    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:14.638859 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:14.638829    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:20.424541 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:20.424504    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:43:20.439949 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:20.439923    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:43:21.311593 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:21.311566    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:43:26.928909 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:26.928863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:27.098446 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:27.098392    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:48.538412 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:48.538383    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:49.773275 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:49.773239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:52.152585 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:52.152553    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:52.253412 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:52.253379    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:54.246050 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:54.246012    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:54.342879 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:54.342846    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:54.845020 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:54.844992    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:55.032297 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:55.032262    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:56.279778 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:56.279741    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:56.649497 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:56.649421    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:59.427365 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:59.427328    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:43:59.502238 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:43:59.502213    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:03.408657 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:03.408616    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:03.685053 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:03.684965    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:03.815221 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:03.815193    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:05.499777 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:05.499742    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:05.905219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:05.905192    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 16:44:05.910658 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:05.910637    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 16:44:05.911104 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:05.911089    2575 kubelet.go:1648] "Image garbage collection succeeded"
Aug 05 16:44:17.268160 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:17.268114    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:17.472144 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:17.472106    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:18.513131 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.513097    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q9rns"]
Aug 05 16:44:18.516478 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.516462    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q9rns"
Aug 05 16:44:18.519325 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.519305    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 05 16:44:18.520219 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.520201    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:44:18.520394 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.520377    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zgk2c\""
Aug 05 16:44:18.527508 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.527489    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q9rns"]
Aug 05 16:44:18.560213 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.560182    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t6pl\" (UniqueName: \"kubernetes.io/projected/2bb77051-4fc9-4352-ab42-a67a9c4f7cea-kube-api-access-8t6pl\") pod \"openshift-lws-operator-fd8ccff4c-q9rns\" (UID: \"2bb77051-4fc9-4352-ab42-a67a9c4f7cea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q9rns"
Aug 05 16:44:18.560330 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.560263    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb77051-4fc9-4352-ab42-a67a9c4f7cea-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q9rns\" (UID: \"2bb77051-4fc9-4352-ab42-a67a9c4f7cea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q9rns"
Aug 05 16:44:18.660923 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.660897    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb77051-4fc9-4352-ab42-a67a9c4f7cea-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q9rns\" (UID: \"2bb77051-4fc9-4352-ab42-a67a9c4f7cea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q9rns"
Aug 05 16:44:18.661095 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.660944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t6pl\" (UniqueName: \"kubernetes.io/projected/2bb77051-4fc9-4352-ab42-a67a9c4f7cea-kube-api-access-8t6pl\") pod \"openshift-lws-operator-fd8ccff4c-q9rns\" (UID: \"2bb77051-4fc9-4352-ab42-a67a9c4f7cea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q9rns"
Aug 05 16:44:18.661263 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.661243    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb77051-4fc9-4352-ab42-a67a9c4f7cea-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q9rns\" (UID: \"2bb77051-4fc9-4352-ab42-a67a9c4f7cea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q9rns"
Aug 05 16:44:18.675795 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.675777    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t6pl\" (UniqueName: \"kubernetes.io/projected/2bb77051-4fc9-4352-ab42-a67a9c4f7cea-kube-api-access-8t6pl\") pod \"openshift-lws-operator-fd8ccff4c-q9rns\" (UID: \"2bb77051-4fc9-4352-ab42-a67a9c4f7cea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q9rns"
Aug 05 16:44:18.837209 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.837128    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q9rns"
Aug 05 16:44:18.981796 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.981771    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q9rns"]
Aug 05 16:44:18.984380 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:44:18.984357    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bb77051_4fc9_4352_ab42_a67a9c4f7cea.slice/crio-6d2c4e609da01436fc22f87eec28d149712fb25909cc207c94bcb5d66f990016 WatchSource:0}: Error finding container 6d2c4e609da01436fc22f87eec28d149712fb25909cc207c94bcb5d66f990016: Status 404 returned error can't find the container with id 6d2c4e609da01436fc22f87eec28d149712fb25909cc207c94bcb5d66f990016
Aug 05 16:44:18.986439 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:18.986417    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:44:19.514846 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:19.514801    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q9rns" event={"ID":"2bb77051-4fc9-4352-ab42-a67a9c4f7cea","Type":"ContainerStarted","Data":"6d2c4e609da01436fc22f87eec28d149712fb25909cc207c94bcb5d66f990016"}
Aug 05 16:44:22.527786 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:22.527747    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q9rns" event={"ID":"2bb77051-4fc9-4352-ab42-a67a9c4f7cea","Type":"ContainerStarted","Data":"0d96dec142d7bda9d81e2ecb9972d81254278b3357355a1db67e48ec9e8e9524"}
Aug 05 16:44:22.552094 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:22.552044    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q9rns" podStartSLOduration=2.040473463 podStartE2EDuration="4.5520273s" totalImagesPullingTime="2.511553837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:44:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:44:22.550034532 +0000 UTC m=+316.999580831" watchObservedRunningTime="2026-08-05 16:44:22.5520273 +0000 UTC m=+317.001573653"
Aug 05 16:44:23.823287 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:23.823253    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:23.924531 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:23.924486    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:25.447492 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:25.447446    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:37.855324 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:37.855281    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:38.887437 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:38.887402    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"]
Aug 05 16:44:38.891033 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:38.891007    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:38.895735 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:38.895717    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 05 16:44:38.895884 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:38.895835    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-knfx2\""
Aug 05 16:44:38.896490 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:38.896475    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 05 16:44:38.896578 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:38.896478    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 05 16:44:38.897289 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:38.897273    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 05 16:44:38.926383 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:38.926357    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"]
Aug 05 16:44:39.036034 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.036004    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a287a66d-2fdd-4362-b253-57499b2f0073-manifests\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.036034 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.036037    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a287a66d-2fdd-4362-b253-57499b2f0073-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.036229 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.036056    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a287a66d-2fdd-4362-b253-57499b2f0073-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.036229 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.036077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78xdm\" (UniqueName: \"kubernetes.io/projected/a287a66d-2fdd-4362-b253-57499b2f0073-kube-api-access-78xdm\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.036229 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.036209    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a287a66d-2fdd-4362-b253-57499b2f0073-tmp\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.136961 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.136932    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a287a66d-2fdd-4362-b253-57499b2f0073-manifests\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.137123 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.136971    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a287a66d-2fdd-4362-b253-57499b2f0073-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.137123 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.136999    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a287a66d-2fdd-4362-b253-57499b2f0073-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.137123 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.137027    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78xdm\" (UniqueName: \"kubernetes.io/projected/a287a66d-2fdd-4362-b253-57499b2f0073-kube-api-access-78xdm\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.137384 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.137356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a287a66d-2fdd-4362-b253-57499b2f0073-tmp\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.137485 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.137422    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a287a66d-2fdd-4362-b253-57499b2f0073-manifests\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.139501 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.139475    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a287a66d-2fdd-4362-b253-57499b2f0073-tmp\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.140227 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.140209    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a287a66d-2fdd-4362-b253-57499b2f0073-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.140319 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.140302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a287a66d-2fdd-4362-b253-57499b2f0073-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.151078 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.151050    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78xdm\" (UniqueName: \"kubernetes.io/projected/a287a66d-2fdd-4362-b253-57499b2f0073-kube-api-access-78xdm\") pod \"opendatahub-operator-controller-manager-7b469b89cc-ptw9z\" (UID: \"a287a66d-2fdd-4362-b253-57499b2f0073\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.171496 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.171471    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:39.202216 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.202197    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:39.279109 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.279079    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:39.342262 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.342229    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"]
Aug 05 16:44:39.345925 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:44:39.345895    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda287a66d_2fdd_4362_b253_57499b2f0073.slice/crio-8e5efce28d193a983842cad495163a337a1906e6f20dc896f4be08eeee01b787 WatchSource:0}: Error finding container 8e5efce28d193a983842cad495163a337a1906e6f20dc896f4be08eeee01b787: Status 404 returned error can't find the container with id 8e5efce28d193a983842cad495163a337a1906e6f20dc896f4be08eeee01b787
Aug 05 16:44:39.375364 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.375336    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:39.483228 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.483192    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:39.577233 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.577200    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:39.596779 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:39.596752    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z" event={"ID":"a287a66d-2fdd-4362-b253-57499b2f0073","Type":"ContainerStarted","Data":"8e5efce28d193a983842cad495163a337a1906e6f20dc896f4be08eeee01b787"}
Aug 05 16:44:41.722696 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:41.722649    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:41.874833 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:41.873308    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:42.615556 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:42.615473    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z" event={"ID":"a287a66d-2fdd-4362-b253-57499b2f0073","Type":"ContainerStarted","Data":"db10ca89edcb4d18552c8c1eb4c01b88d49f047fca11a664686f46690d668fbb"}
Aug 05 16:44:43.621749 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:43.621667    2575 generic.go:356] "Generic (PLEG): container finished" podID="a287a66d-2fdd-4362-b253-57499b2f0073" containerID="db10ca89edcb4d18552c8c1eb4c01b88d49f047fca11a664686f46690d668fbb" exitCode=0
Aug 05 16:44:43.622116 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:43.621747    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z" event={"ID":"a287a66d-2fdd-4362-b253-57499b2f0073","Type":"ContainerDied","Data":"db10ca89edcb4d18552c8c1eb4c01b88d49f047fca11a664686f46690d668fbb"}
Aug 05 16:44:44.628939 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:44.628898    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z" event={"ID":"a287a66d-2fdd-4362-b253-57499b2f0073","Type":"ContainerStarted","Data":"59bb2cf0b96c8dbae25e709f4c207d46b4a0bae2ebcd020bbcf18d6532314556"}
Aug 05 16:44:44.629420 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:44.629044    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:44.664925 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:44.664879    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z" podStartSLOduration=2.347410385 podStartE2EDuration="6.664861948s" totalImagesPullingTime="3.313518862s" totalInitContainerRuntime="1.003932701s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:44:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:44:44.662334366 +0000 UTC m=+339.111880665" watchObservedRunningTime="2026-08-05 16:44:44.664861948 +0000 UTC m=+339.114408247"
Aug 05 16:44:55.635302 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:55.635274    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-ptw9z"
Aug 05 16:44:57.885685 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:57.885652    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:58.000523 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:58.000486    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:58.603714 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:58.603674    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:58.713500 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:58.713468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:58.811534 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:58.811497    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:59.183070 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:59.183035    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:59.273187 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:59.273159    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:44:59.451142 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:44:59.451058    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:01.516897 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:01.516861    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:01.738789 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:01.738760    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:03.278607 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:03.278567    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:03.400422 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:03.400387    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:04.876194 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:04.876162    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:06.085229 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.085196    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"]
Aug 05 16:45:06.090093 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.090072    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:06.092971 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.092952    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 05 16:45:06.093692 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.093672    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 05 16:45:06.093777 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.093675    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 05 16:45:06.093777 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.093746    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4bdhp\""
Aug 05 16:45:06.102969 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.102947    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"]
Aug 05 16:45:06.187775 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.187744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0413b4b4-f539-4890-88f4-2736d768dc7d-cert\") pod \"lws-controller-manager-598789449f-x2z7q\" (UID: \"0413b4b4-f539-4890-88f4-2736d768dc7d\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:06.187775 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.187777    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glqr9\" (UniqueName: \"kubernetes.io/projected/0413b4b4-f539-4890-88f4-2736d768dc7d-kube-api-access-glqr9\") pod \"lws-controller-manager-598789449f-x2z7q\" (UID: \"0413b4b4-f539-4890-88f4-2736d768dc7d\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:06.187978 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.187800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0413b4b4-f539-4890-88f4-2736d768dc7d-metrics-cert\") pod \"lws-controller-manager-598789449f-x2z7q\" (UID: \"0413b4b4-f539-4890-88f4-2736d768dc7d\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:06.187978 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.187874    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0413b4b4-f539-4890-88f4-2736d768dc7d-manager-config\") pod \"lws-controller-manager-598789449f-x2z7q\" (UID: \"0413b4b4-f539-4890-88f4-2736d768dc7d\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:06.288271 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.288244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0413b4b4-f539-4890-88f4-2736d768dc7d-cert\") pod \"lws-controller-manager-598789449f-x2z7q\" (UID: \"0413b4b4-f539-4890-88f4-2736d768dc7d\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:06.288422 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.288276    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glqr9\" (UniqueName: \"kubernetes.io/projected/0413b4b4-f539-4890-88f4-2736d768dc7d-kube-api-access-glqr9\") pod \"lws-controller-manager-598789449f-x2z7q\" (UID: \"0413b4b4-f539-4890-88f4-2736d768dc7d\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:06.288422 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.288314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0413b4b4-f539-4890-88f4-2736d768dc7d-metrics-cert\") pod \"lws-controller-manager-598789449f-x2z7q\" (UID: \"0413b4b4-f539-4890-88f4-2736d768dc7d\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:06.288422 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.288362    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0413b4b4-f539-4890-88f4-2736d768dc7d-manager-config\") pod \"lws-controller-manager-598789449f-x2z7q\" (UID: \"0413b4b4-f539-4890-88f4-2736d768dc7d\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:06.289067 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.289042    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0413b4b4-f539-4890-88f4-2736d768dc7d-manager-config\") pod \"lws-controller-manager-598789449f-x2z7q\" (UID: \"0413b4b4-f539-4890-88f4-2736d768dc7d\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:06.290644 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.290623    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0413b4b4-f539-4890-88f4-2736d768dc7d-metrics-cert\") pod \"lws-controller-manager-598789449f-x2z7q\" (UID: \"0413b4b4-f539-4890-88f4-2736d768dc7d\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:06.290753 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.290705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0413b4b4-f539-4890-88f4-2736d768dc7d-cert\") pod \"lws-controller-manager-598789449f-x2z7q\" (UID: \"0413b4b4-f539-4890-88f4-2736d768dc7d\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:06.302457 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.302434    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glqr9\" (UniqueName: \"kubernetes.io/projected/0413b4b4-f539-4890-88f4-2736d768dc7d-kube-api-access-glqr9\") pod \"lws-controller-manager-598789449f-x2z7q\" (UID: \"0413b4b4-f539-4890-88f4-2736d768dc7d\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:06.398941 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.398869    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:06.537374 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.537349    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"]
Aug 05 16:45:06.539544 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:45:06.539516    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0413b4b4_f539_4890_88f4_2736d768dc7d.slice/crio-a914bdceaf6866719e172047ff154da1fabf4cac005f02effe54faff5356d515 WatchSource:0}: Error finding container a914bdceaf6866719e172047ff154da1fabf4cac005f02effe54faff5356d515: Status 404 returned error can't find the container with id a914bdceaf6866719e172047ff154da1fabf4cac005f02effe54faff5356d515
Aug 05 16:45:06.730160 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.730128    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q" event={"ID":"0413b4b4-f539-4890-88f4-2736d768dc7d","Type":"ContainerStarted","Data":"a914bdceaf6866719e172047ff154da1fabf4cac005f02effe54faff5356d515"}
Aug 05 16:45:06.839698 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.839669    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"]
Aug 05 16:45:06.844230 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.844210    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.850190 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.850164    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 05 16:45:06.850314 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.850238    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 05 16:45:06.850379 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.850310    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5dmv6\""
Aug 05 16:45:06.850700 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.850651    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 05 16:45:06.851420 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.851399    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 05 16:45:06.866346 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.864716    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"]
Aug 05 16:45:06.893520 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.893488    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3cad0713-1b43-41e8-8f38-7b98594140ea-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.893704 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.893612    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3cad0713-1b43-41e8-8f38-7b98594140ea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.893704 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.893680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3cad0713-1b43-41e8-8f38-7b98594140ea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.893841 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.893724    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cad0713-1b43-41e8-8f38-7b98594140ea-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.893841 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.893785    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj4w6\" (UniqueName: \"kubernetes.io/projected/3cad0713-1b43-41e8-8f38-7b98594140ea-kube-api-access-pj4w6\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.893959 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.893856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cad0713-1b43-41e8-8f38-7b98594140ea-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.893959 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.893893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3cad0713-1b43-41e8-8f38-7b98594140ea-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.995012 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.994916    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3cad0713-1b43-41e8-8f38-7b98594140ea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.995012 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.994965    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3cad0713-1b43-41e8-8f38-7b98594140ea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.995012 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.994990    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cad0713-1b43-41e8-8f38-7b98594140ea-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.995012 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.995012    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj4w6\" (UniqueName: \"kubernetes.io/projected/3cad0713-1b43-41e8-8f38-7b98594140ea-kube-api-access-pj4w6\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.995348 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.995038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cad0713-1b43-41e8-8f38-7b98594140ea-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.995348 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.995062    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3cad0713-1b43-41e8-8f38-7b98594140ea-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.995348 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.995106    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3cad0713-1b43-41e8-8f38-7b98594140ea-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.995725 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.995694    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3cad0713-1b43-41e8-8f38-7b98594140ea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.997459 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.997436    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cad0713-1b43-41e8-8f38-7b98594140ea-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.997572 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.997488    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3cad0713-1b43-41e8-8f38-7b98594140ea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.997572 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.997553    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3cad0713-1b43-41e8-8f38-7b98594140ea-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:06.997692 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:06.997647    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3cad0713-1b43-41e8-8f38-7b98594140ea-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:07.010717 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:07.010688    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj4w6\" (UniqueName: \"kubernetes.io/projected/3cad0713-1b43-41e8-8f38-7b98594140ea-kube-api-access-pj4w6\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:07.031090 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:07.031069    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cad0713-1b43-41e8-8f38-7b98594140ea-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2f692\" (UID: \"3cad0713-1b43-41e8-8f38-7b98594140ea\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:07.155558 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:07.155528    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:07.293923 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:07.293898    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"]
Aug 05 16:45:07.295502 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:45:07.295470    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cad0713_1b43_41e8_8f38_7b98594140ea.slice/crio-a3f9a225f5d53a19e35f7cb63308250cb15189813b70463e0607c446e7aef1b9 WatchSource:0}: Error finding container a3f9a225f5d53a19e35f7cb63308250cb15189813b70463e0607c446e7aef1b9: Status 404 returned error can't find the container with id a3f9a225f5d53a19e35f7cb63308250cb15189813b70463e0607c446e7aef1b9
Aug 05 16:45:07.735588 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:07.735556    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692" event={"ID":"3cad0713-1b43-41e8-8f38-7b98594140ea","Type":"ContainerStarted","Data":"a3f9a225f5d53a19e35f7cb63308250cb15189813b70463e0607c446e7aef1b9"}
Aug 05 16:45:08.232231 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:08.232193    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:08.527483 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:08.527378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:08.664258 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:08.664222    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:09.799300 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:09.799246    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:45:09.799772 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:09.799326    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:45:09.912828 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:09.912768    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:10.134097 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:10.133973    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:10.254422 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:10.254355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:10.365063 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:10.365026    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:10.534166 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:10.534130    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:10.752488 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:10.752460    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692" event={"ID":"3cad0713-1b43-41e8-8f38-7b98594140ea","Type":"ContainerStarted","Data":"f8005bc73baa6ffed913b2adee302e654c6f3459fbb9ddba481a5eeb815ed5c7"}
Aug 05 16:45:10.752642 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:10.752621    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:10.754553 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:10.754527    2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-2f692 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 16:45:10.754654 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:10.754576    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692" podUID="3cad0713-1b43-41e8-8f38-7b98594140ea" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 16:45:10.839567 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:10.839517    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692" podStartSLOduration=2.338124991 podStartE2EDuration="4.839501437s" totalImagesPullingTime="2.501376446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:45:10.834160132 +0000 UTC m=+365.283706456" watchObservedRunningTime="2026-08-05 16:45:10.839501437 +0000 UTC m=+365.289047735"
Aug 05 16:45:10.968759 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:10.968721    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:11.265432 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:11.265398    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:11.361063 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:11.361028    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:11.502747 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:11.502719    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:11.762443 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:11.762404    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q" event={"ID":"0413b4b4-f539-4890-88f4-2736d768dc7d","Type":"ContainerStarted","Data":"50766ce09bb54a6f2e5536b95a2427cdae592f50c97dc496252763218ed21312"}
Aug 05 16:45:11.762903 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:11.762847    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:11.763637 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:11.763615    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2f692"
Aug 05 16:45:11.820615 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:11.820562    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q" podStartSLOduration=1.621914602 podStartE2EDuration="5.820543744s" totalImagesPullingTime="4.198629142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:45:11.785511915 +0000 UTC m=+366.235058219" watchObservedRunningTime="2026-08-05 16:45:11.820543744 +0000 UTC m=+366.270090042"
Aug 05 16:45:22.769597 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:22.769566    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-598789449f-x2z7q"
Aug 05 16:45:25.700329 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:25.700294    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:25.777140 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:25.777100    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:27.646717 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:27.646687    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:27.711928 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:27.711898    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:59.591296 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:59.591247    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:45:59.682995 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:45:59.682964    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:12.561287 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:12.561250    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:15.906204 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:15.906175    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:16.909648 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:16.909605    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:17.379099 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:17.379018    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:17.525040 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:17.525007    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:18.567979 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:18.567945    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:19.936501 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:19.936469    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:20.678282 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:20.678252    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:20.783329 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:20.783294    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:22.170565 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:22.170531    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:22.291485 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:22.291452    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:24.919271 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:24.919237    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:25.020024 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:25.019988    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:27.739551 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:27.739519    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:27.807695 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:27.807667    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:28.333602 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:28.333560    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:28.436299 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:28.436260    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:30.547927 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:30.547897    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:30.993532 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:30.993501    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:32.865018 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:32.864974    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:32.981986 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:32.981953    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:37.527682 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:37.527645    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:37.628603 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:37.628577    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:37.728541 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:37.728513    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:38.310340 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:38.310301    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:38.411760 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:38.411726    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:38.902211 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:38.902180    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:39.009441 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:39.009406    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:44.244999 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:44.244963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:44.346102 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:44.346067    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:47.466377 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:47.466343    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:47.559945 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:47.559906    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:51.878353 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:51.878320    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:51.981580 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:51.981549    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:52.081385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:52.081355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:56.997071 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:56.997035    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:57.096366 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:57.096328    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:46:57.199015 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:46:57.198966    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:10.453150 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:10.453117    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:10.688339 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:10.688309    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:12.268163 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.268125    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:12.340360 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.340328    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:12.487657 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.487621    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:47:12.491105 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.491085    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bq685"
Aug 05 16:47:12.494025 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.494005    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 05 16:47:12.494585 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.494567    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 05 16:47:12.495016 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.494998    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 05 16:47:12.495133 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.495073    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g7n27\""
Aug 05 16:47:12.503619 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.503597    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:47:12.517545 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.517524    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:47:12.530319 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.530261    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4f8a3195-c5bf-4d71-9b08-072a37eae537-config-file\") pod \"limitador-limitador-85d9db4d5d-bq685\" (UID: \"4f8a3195-c5bf-4d71-9b08-072a37eae537\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bq685"
Aug 05 16:47:12.530319 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.530310    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh4j4\" (UniqueName: \"kubernetes.io/projected/4f8a3195-c5bf-4d71-9b08-072a37eae537-kube-api-access-gh4j4\") pod \"limitador-limitador-85d9db4d5d-bq685\" (UID: \"4f8a3195-c5bf-4d71-9b08-072a37eae537\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bq685"
Aug 05 16:47:12.631577 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.631554    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4f8a3195-c5bf-4d71-9b08-072a37eae537-config-file\") pod \"limitador-limitador-85d9db4d5d-bq685\" (UID: \"4f8a3195-c5bf-4d71-9b08-072a37eae537\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bq685"
Aug 05 16:47:12.631685 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.631607    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh4j4\" (UniqueName: \"kubernetes.io/projected/4f8a3195-c5bf-4d71-9b08-072a37eae537-kube-api-access-gh4j4\") pod \"limitador-limitador-85d9db4d5d-bq685\" (UID: \"4f8a3195-c5bf-4d71-9b08-072a37eae537\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bq685"
Aug 05 16:47:12.632162 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.632144    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4f8a3195-c5bf-4d71-9b08-072a37eae537-config-file\") pod \"limitador-limitador-85d9db4d5d-bq685\" (UID: \"4f8a3195-c5bf-4d71-9b08-072a37eae537\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bq685"
Aug 05 16:47:12.641392 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.641366    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh4j4\" (UniqueName: \"kubernetes.io/projected/4f8a3195-c5bf-4d71-9b08-072a37eae537-kube-api-access-gh4j4\") pod \"limitador-limitador-85d9db4d5d-bq685\" (UID: \"4f8a3195-c5bf-4d71-9b08-072a37eae537\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-bq685"
Aug 05 16:47:12.801164 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.801078    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bq685"
Aug 05 16:47:12.932621 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.932598    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:47:12.935018 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:47:12.934992    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8a3195_c5bf_4d71_9b08_072a37eae537.slice/crio-ba5e5058b46eeb7294ebe4df69ab72b008fe98a49944daa6f1e6c47f862a6ab4 WatchSource:0}: Error finding container ba5e5058b46eeb7294ebe4df69ab72b008fe98a49944daa6f1e6c47f862a6ab4: Status 404 returned error can't find the container with id ba5e5058b46eeb7294ebe4df69ab72b008fe98a49944daa6f1e6c47f862a6ab4
Aug 05 16:47:12.983514 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:12.983487    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:13.088290 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:13.088211    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:13.293265 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:13.293226    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bq685" event={"ID":"4f8a3195-c5bf-4d71-9b08-072a37eae537","Type":"ContainerStarted","Data":"ba5e5058b46eeb7294ebe4df69ab72b008fe98a49944daa6f1e6c47f862a6ab4"}
Aug 05 16:47:16.309298 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:16.309266    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bq685" event={"ID":"4f8a3195-c5bf-4d71-9b08-072a37eae537","Type":"ContainerStarted","Data":"b4783eddcb03ec302c9c3ef2d2125ebc3ed31733b3b84a8dd96f8613062ff766"}
Aug 05 16:47:16.309661 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:16.309383    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bq685"
Aug 05 16:47:16.332376 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:16.332311    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bq685" podStartSLOduration=1.870215556 podStartE2EDuration="4.332293567s" totalImagesPullingTime="2.462078011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:47:16.332106892 +0000 UTC m=+490.781653192" watchObservedRunningTime="2026-08-05 16:47:16.332293567 +0000 UTC m=+490.781839867"
Aug 05 16:47:27.314992 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:27.314965    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-bq685"
Aug 05 16:47:33.259038 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:33.259008    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:33.417882 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:33.417853    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:33.846195 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:33.846160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:47.515745 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:47.515712    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:47.889407 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:47.889305    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:54.020259 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:54.020213    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:54.152927 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:54.152893    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:54.252663 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:54.252610    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:57.324012 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:57.323982    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:47:57.419590 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:47:57.419556    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:48:28.937752 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:48:28.937668    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:48:29.040464 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:48:29.040431    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:48:30.433547 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:48:30.433514    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:48:31.062758 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:48:31.062729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:48:31.165103 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:48:31.165073    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:48:31.362906 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:48:31.362802    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:48:32.650022 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:48:32.649992    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:48:35.320385 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:48:35.320350    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:48:41.730902 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:48:41.730869    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:48:41.833477 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:48:41.833446    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:48:45.671999 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:48:45.671967    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:48:46.394825 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:48:46.394774    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:48:51.046791 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:48:51.046758    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:48:51.713718 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:48:51.713678    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:49:00.129622 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:00.129593    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:49:01.143500 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:01.143468    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:49:05.938002 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:05.937974    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 16:49:05.941309 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:05.941288    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 16:49:11.946314 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:11.946281    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:49:12.047077 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:12.047034    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:49:15.699101 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.699072    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"]
Aug 05 16:49:15.702487 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.702467    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.704899 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.704840    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5pwrv\""
Aug 05 16:49:15.705776 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.705758    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 05 16:49:15.705910 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.705758    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 05 16:49:15.705910 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.705793    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Aug 05 16:49:15.718847 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.718822    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"]
Aug 05 16:49:15.741893 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.741861    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:49:15.822492 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.822466    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b8a280-3bcd-4134-8256-f5d47cecf850-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.822645 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.822515    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b8a280-3bcd-4134-8256-f5d47cecf850-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.822645 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.822543    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b8a280-3bcd-4134-8256-f5d47cecf850-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.822645 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.822626    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b8a280-3bcd-4134-8256-f5d47cecf850-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.822791 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.822672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b8a280-3bcd-4134-8256-f5d47cecf850-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.822791 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.822735    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9hcp\" (UniqueName: \"kubernetes.io/projected/44b8a280-3bcd-4134-8256-f5d47cecf850-kube-api-access-r9hcp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.923681 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.923644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b8a280-3bcd-4134-8256-f5d47cecf850-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.923915 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.923693    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b8a280-3bcd-4134-8256-f5d47cecf850-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.923915 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.923728    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b8a280-3bcd-4134-8256-f5d47cecf850-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.923915 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.923753    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b8a280-3bcd-4134-8256-f5d47cecf850-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.923915 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.923832    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9hcp\" (UniqueName: \"kubernetes.io/projected/44b8a280-3bcd-4134-8256-f5d47cecf850-kube-api-access-r9hcp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.923915 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.923898    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b8a280-3bcd-4134-8256-f5d47cecf850-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.924256 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.924235    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b8a280-3bcd-4134-8256-f5d47cecf850-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.924332 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.924242    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b8a280-3bcd-4134-8256-f5d47cecf850-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.924533 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.924499    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b8a280-3bcd-4134-8256-f5d47cecf850-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.926213 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.926187    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b8a280-3bcd-4134-8256-f5d47cecf850-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.926483 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.926463    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b8a280-3bcd-4134-8256-f5d47cecf850-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:15.932503 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:15.932480    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9hcp\" (UniqueName: \"kubernetes.io/projected/44b8a280-3bcd-4134-8256-f5d47cecf850-kube-api-access-r9hcp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj\" (UID: \"44b8a280-3bcd-4134-8256-f5d47cecf850\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:16.012797 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:16.012729    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:16.149612 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:16.149588    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"]
Aug 05 16:49:16.152099 ip-10-0-130-35 kubenswrapper[2575]: W0805 16:49:16.152070    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b8a280_3bcd_4134_8256_f5d47cecf850.slice/crio-570922d576fd430981b9dc53658702169cda2bec5fb672aa1b5fde2f4d347a10 WatchSource:0}: Error finding container 570922d576fd430981b9dc53658702169cda2bec5fb672aa1b5fde2f4d347a10: Status 404 returned error can't find the container with id 570922d576fd430981b9dc53658702169cda2bec5fb672aa1b5fde2f4d347a10
Aug 05 16:49:16.838483 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:16.838439    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj" event={"ID":"44b8a280-3bcd-4134-8256-f5d47cecf850","Type":"ContainerStarted","Data":"570922d576fd430981b9dc53658702169cda2bec5fb672aa1b5fde2f4d347a10"}
Aug 05 16:49:16.913481 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:16.913444    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:49:17.843922 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:17.843884    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj" event={"ID":"44b8a280-3bcd-4134-8256-f5d47cecf850","Type":"ContainerStarted","Data":"874138febf79322ec8a2d89883c237f9eb4dc17d35a79df9af6a19e060cd0573"}
Aug 05 16:49:17.864073 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:17.864007    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj" podStartSLOduration=1.9319670260000001 podStartE2EDuration="2.863991303s" totalImagesPullingTime="932.024277ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:49:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:49:17.862735813 +0000 UTC m=+612.312282113" watchObservedRunningTime="2026-08-05 16:49:17.863991303 +0000 UTC m=+612.313537601"
Aug 05 16:49:26.013863 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:26.013833    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:26.014321 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:26.013881    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:26.025705 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:26.025681    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:26.896955 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:26.896920    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj"
Aug 05 16:49:33.734715 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:33.734685    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:49:35.897069 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:35.897036    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:49:38.211505 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:38.211473    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:49:42.131905 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:42.131865    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:49:44.300839 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:44.300795    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:49:49.245699 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:49.245665    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:49:49.345638 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:49:49.345602    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:50:05.303577 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:50:05.303545    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:50:21.782142 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:50:21.782109    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:50:21.888151 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:50:21.888120    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:50:22.893174 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:50:22.893148    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:50:23.015185 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:50:23.015158    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:50:49.695126 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:50:49.695090    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:50:50.180232 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:50:50.180199    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:50:59.603233 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:50:59.603150    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:51:11.003444 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:51:11.003406    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:51:22.966845 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:51:22.966787    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:52:27.075172 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:52:27.075138    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:52:28.354627 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:52:28.354551    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:52:46.084445 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:52:46.084408    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:52:49.597542 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:52:49.597509    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:52:59.922848 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:52:59.922798    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:53:29.634331 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:53:29.634280    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:53:29.726196 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:53:29.726165    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:53:29.856730 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:53:29.856704    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:53:36.653559 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:53:36.653522    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:53:36.868214 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:53:36.868186    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:53:37.011560 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:53:37.011524    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:53:37.181498 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:53:37.181469    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:53:44.229280 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:53:44.229243    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:53:44.357694 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:53:44.357663    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:54:00.302919 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:54:00.302826    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:54:05.967552 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:54:05.967524    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 16:54:05.968254 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:54:05.968237    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 16:54:07.326660 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:54:07.326623    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:54:22.707071 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:54:22.707033    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:54:29.502086 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:54:29.502045    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:54:41.140977 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:54:41.140942    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:54:47.119278 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:54:47.119242    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:54:58.908777 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:54:58.908739    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:55:04.102175 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:55:04.102139    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:55:12.309236 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:55:12.309194    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:55:18.302602 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:55:18.302565    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:55:30.830521 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:55:30.830446    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:55:41.621266 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:55:41.621227    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:55:59.940468 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:55:59.940427    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:56:05.603923 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:56:05.603888    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:56:15.908403 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:56:15.908369    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:56:22.417050 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:56:22.417013    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:56:28.895489 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:56:28.895452    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:56:38.024250 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:56:38.024216    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:56:42.901770 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:56:42.901736    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:56:47.897093 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:56:47.897059    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:56:55.122483 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:56:55.122452    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:57:07.139752 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:57:07.139668    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:57:13.244184 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:57:13.244149    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 16:57:16.027091 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:57:16.027054    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:57:24.406718 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:57:24.406680    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:57:37.646590 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:57:37.646556    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:57:45.728797 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:57:45.728762    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:57:50.854224 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:57:50.854185    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:58:02.726102 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:58:02.726065    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 16:59:06.001575 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:59:06.001548    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 16:59:06.002137 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:59:06.001825    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 16:59:15.904071 ip-10-0-130-35 kubenswrapper[2575]: I0805 16:59:15.904034    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:00:21.001206 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:00:21.001170    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:00:27.899481 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:00:27.899446    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:00:50.403653 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:00:50.403620    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:01:21.516262 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:01:21.516227    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:01:27.835838 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:01:27.835792    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:01:37.318097 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:01:37.318065    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:01:43.823713 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:01:43.823676    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:01:52.959622 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:01:52.959562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:01:53.611697 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:01:53.611663    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:01:54.777170 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:01:54.777130    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:02:03.722352 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:02:03.722315    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:02:08.740534 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:02:08.740500    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:02:13.618029 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:02:13.617998    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:02:23.608672 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:02:23.608639    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:02:30.020065 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:02:30.020037    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:02:39.613484 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:02:39.613449    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:03:01.844278 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:03:01.844194    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:03:09.015422 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:03:09.015387    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:03:19.680530 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:03:19.680492    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:03:22.706763 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:03:22.706729    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:03:32.445784 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:03:32.445748    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:03:35.215227 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:03:35.215191    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:03:49.647820 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:03:49.647756    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:03:51.963037 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:03:51.963004    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:03:53.420113 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:03:53.420071    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:03:53.748049 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:03:53.747962    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:04:05.223345 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:04:05.223312    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:04:06.036426 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:04:06.036398    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:04:06.037410 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:04:06.037390    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:04:11.119263 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:04:11.119229    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:04:17.289141 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:04:17.289107    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:04:27.809425 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:04:27.809389    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:04:34.764072 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:04:34.764037    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:04:44.730730 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:04:44.730692    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:04:45.115948 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:04:45.115856    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:04:52.299755 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:04:52.299723    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:05:05.002133 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:05:05.002099    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:05:10.231564 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:05:10.231455    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:05:25.221954 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:05:25.221917    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:05:31.817766 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:05:31.817727    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:05:43.911334 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:05:43.911299    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:05:52.015405 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:05:52.015372    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:05:58.708066 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:05:58.707982    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:06:05.307446 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:06:05.307407    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:06:11.502255 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:06:11.502218    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:06:21.211737 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:06:21.211706    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:06:28.218123 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:06:28.218082    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:06:30.590823 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:06:30.590788    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:06:38.212541 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:06:38.212507    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:06:41.585056 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:06:41.585021    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:06:45.617110 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:06:45.617068    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:06:55.497481 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:06:55.497452    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:07:10.814963 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:10.814924    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:07:17.140691 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:17.140654    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:07:20.488179 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:20.488148    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:07:23.618725 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:23.618691    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:07:32.089787 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:32.089753    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:07:32.206923 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:32.206885    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:07:34.859655 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:34.859623    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:07:43.599585 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:43.599539    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:07:46.637884 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:46.637848    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:07:49.306157 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:49.306123    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:07:49.852632 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:49.852584    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:07:50.007375 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:50.007340    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:07:50.470174 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:50.470141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:07:57.212845 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:57.212796    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:07:57.310237 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:57.310208    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:07:57.698650 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:57.698618    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:07:57.894085 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:57.894055    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:07:58.215510 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:07:58.215475    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:00.826749 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:00.826717    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:00.959139 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:00.959092    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:01.902388 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:01.902362    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"]
Aug 05 17:08:01.905888 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:01.905871    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:01.908587 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:01.908563    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 17:08:01.908587 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:01.908578    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:08:01.909217 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:01.909201    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-fba92dbb-serving-cert\""
Aug 05 17:08:01.909274 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:01.909221    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nplzm\""
Aug 05 17:08:01.922547 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:01.922527    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"]
Aug 05 17:08:01.964255 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:01.964223    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:02.034182 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.034156    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dacfef1-c6e2-4264-94c4-7671d00a9645-maas-api-tls\") pod \"maas-api-e2e-ait-fba92dbb-857944856f-2dppd\" (UID: \"3dacfef1-c6e2-4264-94c4-7671d00a9645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:02.034310 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.034239    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5q4k\" (UniqueName: \"kubernetes.io/projected/3dacfef1-c6e2-4264-94c4-7671d00a9645-kube-api-access-b5q4k\") pod \"maas-api-e2e-ait-fba92dbb-857944856f-2dppd\" (UID: \"3dacfef1-c6e2-4264-94c4-7671d00a9645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:02.034310 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.034294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dacfef1-c6e2-4264-94c4-7671d00a9645-openshift-service-ca\") pod \"maas-api-e2e-ait-fba92dbb-857944856f-2dppd\" (UID: \"3dacfef1-c6e2-4264-94c4-7671d00a9645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:02.134978 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.134945    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5q4k\" (UniqueName: \"kubernetes.io/projected/3dacfef1-c6e2-4264-94c4-7671d00a9645-kube-api-access-b5q4k\") pod \"maas-api-e2e-ait-fba92dbb-857944856f-2dppd\" (UID: \"3dacfef1-c6e2-4264-94c4-7671d00a9645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:02.135129 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.135015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dacfef1-c6e2-4264-94c4-7671d00a9645-openshift-service-ca\") pod \"maas-api-e2e-ait-fba92dbb-857944856f-2dppd\" (UID: \"3dacfef1-c6e2-4264-94c4-7671d00a9645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:02.135129 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.135058    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dacfef1-c6e2-4264-94c4-7671d00a9645-maas-api-tls\") pod \"maas-api-e2e-ait-fba92dbb-857944856f-2dppd\" (UID: \"3dacfef1-c6e2-4264-94c4-7671d00a9645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:02.135661 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.135641    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dacfef1-c6e2-4264-94c4-7671d00a9645-openshift-service-ca\") pod \"maas-api-e2e-ait-fba92dbb-857944856f-2dppd\" (UID: \"3dacfef1-c6e2-4264-94c4-7671d00a9645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:02.137540 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.137516    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dacfef1-c6e2-4264-94c4-7671d00a9645-maas-api-tls\") pod \"maas-api-e2e-ait-fba92dbb-857944856f-2dppd\" (UID: \"3dacfef1-c6e2-4264-94c4-7671d00a9645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:02.145141 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.145119    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5q4k\" (UniqueName: \"kubernetes.io/projected/3dacfef1-c6e2-4264-94c4-7671d00a9645-kube-api-access-b5q4k\") pod \"maas-api-e2e-ait-fba92dbb-857944856f-2dppd\" (UID: \"3dacfef1-c6e2-4264-94c4-7671d00a9645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:02.215765 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.215742    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:02.309125 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.309087    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:02.361421 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.361400    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"]
Aug 05 17:08:02.363370 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:08:02.363341    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dacfef1_c6e2_4264_94c4_7671d00a9645.slice/crio-4c7128e6efa98faebb551ae7b0a163b3a3122903b5f3b34385a6769d08c812ca WatchSource:0}: Error finding container 4c7128e6efa98faebb551ae7b0a163b3a3122903b5f3b34385a6769d08c812ca: Status 404 returned error can't find the container with id 4c7128e6efa98faebb551ae7b0a163b3a3122903b5f3b34385a6769d08c812ca
Aug 05 17:08:02.364703 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.364683    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:08:02.708052 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.708021    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:02.813249 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.813218    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:02.855619 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:02.855591    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd" event={"ID":"3dacfef1-c6e2-4264-94c4-7671d00a9645","Type":"ContainerStarted","Data":"4c7128e6efa98faebb551ae7b0a163b3a3122903b5f3b34385a6769d08c812ca"}
Aug 05 17:08:05.735726 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:05.735692    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:08:05.872153 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:05.872122    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd" event={"ID":"3dacfef1-c6e2-4264-94c4-7671d00a9645","Type":"ContainerStarted","Data":"3af4e4ffb52cd980c00a81b3c3ba7a5b4f35add701ba54f0ad3092eb1a62f966"}
Aug 05 17:08:05.872352 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:05.872233    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:05.896506 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:05.896460    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd" podStartSLOduration=2.20939536 podStartE2EDuration="4.896446985s" totalImagesPullingTime="2.687051625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:08:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:08:05.895919255 +0000 UTC m=+1740.345465566" watchObservedRunningTime="2026-08-05 17:08:05.896446985 +0000 UTC m=+1740.345993285"
Aug 05 17:08:11.883082 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:11.883052    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:26.365655 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:26.365614    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn"]
Aug 05 17:08:26.374254 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:26.374232    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn"
Aug 05 17:08:26.380613 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:26.380590    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:08:26.381955 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:26.381931    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn"]
Aug 05 17:08:26.447616 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:26.447591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/deec5e2e-e719-4dd2-b056-c934ba2d58c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn\" (UID: \"deec5e2e-e719-4dd2-b056-c934ba2d58c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn"
Aug 05 17:08:26.548892 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:26.548863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/deec5e2e-e719-4dd2-b056-c934ba2d58c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn\" (UID: \"deec5e2e-e719-4dd2-b056-c934ba2d58c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn"
Aug 05 17:08:26.549427 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:26.549409    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/deec5e2e-e719-4dd2-b056-c934ba2d58c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn\" (UID: \"deec5e2e-e719-4dd2-b056-c934ba2d58c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn"
Aug 05 17:08:26.686286 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:26.686257    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn"
Aug 05 17:08:26.821332 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:26.821296    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn"]
Aug 05 17:08:26.827164 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:08:26.827136    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeec5e2e_e719_4dd2_b056_c934ba2d58c9.slice/crio-a9aef0cada59a680f82f918d5f33e3bf228ca8f5134e522a2819746e7e60af9e WatchSource:0}: Error finding container a9aef0cada59a680f82f918d5f33e3bf228ca8f5134e522a2819746e7e60af9e: Status 404 returned error can't find the container with id a9aef0cada59a680f82f918d5f33e3bf228ca8f5134e522a2819746e7e60af9e
Aug 05 17:08:26.968580 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:26.968501    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn" event={"ID":"deec5e2e-e719-4dd2-b056-c934ba2d58c9","Type":"ContainerStarted","Data":"a9aef0cada59a680f82f918d5f33e3bf228ca8f5134e522a2819746e7e60af9e"}
Aug 05 17:08:29.984783 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:29.984751    2575 generic.go:356] "Generic (PLEG): container finished" podID="deec5e2e-e719-4dd2-b056-c934ba2d58c9" containerID="e314661ddfb021a48235179e882cbf0adee1acaf8922a37e0d21887305e9c87a" exitCode=0
Aug 05 17:08:29.985116 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:29.984835    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn" event={"ID":"deec5e2e-e719-4dd2-b056-c934ba2d58c9","Type":"ContainerDied","Data":"e314661ddfb021a48235179e882cbf0adee1acaf8922a37e0d21887305e9c87a"}
Aug 05 17:08:31.120365 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:31.120338    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn"
Aug 05 17:08:31.188152 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:31.188123    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/deec5e2e-e719-4dd2-b056-c934ba2d58c9-maas-api-service-ca\") pod \"deec5e2e-e719-4dd2-b056-c934ba2d58c9\" (UID: \"deec5e2e-e719-4dd2-b056-c934ba2d58c9\") "
Aug 05 17:08:31.188456 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:31.188434    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deec5e2e-e719-4dd2-b056-c934ba2d58c9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "deec5e2e-e719-4dd2-b056-c934ba2d58c9" (UID: "deec5e2e-e719-4dd2-b056-c934ba2d58c9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:08:31.289672 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:31.289593    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/deec5e2e-e719-4dd2-b056-c934ba2d58c9-maas-api-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:08:31.997078 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:31.997041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn" event={"ID":"deec5e2e-e719-4dd2-b056-c934ba2d58c9","Type":"ContainerDied","Data":"a9aef0cada59a680f82f918d5f33e3bf228ca8f5134e522a2819746e7e60af9e"}
Aug 05 17:08:31.997325 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:31.997112    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9aef0cada59a680f82f918d5f33e3bf228ca8f5134e522a2819746e7e60af9e"
Aug 05 17:08:31.997325 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:31.997050    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn"
Aug 05 17:08:42.641749 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:42.641715    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"]
Aug 05 17:08:42.642287 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:42.641985    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd" podUID="3dacfef1-c6e2-4264-94c4-7671d00a9645" containerName="maas-api" containerID="cri-o://3af4e4ffb52cd980c00a81b3c3ba7a5b4f35add701ba54f0ad3092eb1a62f966" gracePeriod=30
Aug 05 17:08:42.677387 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:42.677360    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:42.873956 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:42.873927    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:42.905616 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:42.905591    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:42.997343 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:42.997317    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dacfef1-c6e2-4264-94c4-7671d00a9645-openshift-service-ca\") pod \"3dacfef1-c6e2-4264-94c4-7671d00a9645\" (UID: \"3dacfef1-c6e2-4264-94c4-7671d00a9645\") "
Aug 05 17:08:42.997343 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:42.997347    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5q4k\" (UniqueName: \"kubernetes.io/projected/3dacfef1-c6e2-4264-94c4-7671d00a9645-kube-api-access-b5q4k\") pod \"3dacfef1-c6e2-4264-94c4-7671d00a9645\" (UID: \"3dacfef1-c6e2-4264-94c4-7671d00a9645\") "
Aug 05 17:08:42.997543 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:42.997448    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dacfef1-c6e2-4264-94c4-7671d00a9645-maas-api-tls\") pod \"3dacfef1-c6e2-4264-94c4-7671d00a9645\" (UID: \"3dacfef1-c6e2-4264-94c4-7671d00a9645\") "
Aug 05 17:08:42.997716 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:42.997692    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dacfef1-c6e2-4264-94c4-7671d00a9645-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3dacfef1-c6e2-4264-94c4-7671d00a9645" (UID: "3dacfef1-c6e2-4264-94c4-7671d00a9645"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:08:42.999576 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:42.999554    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dacfef1-c6e2-4264-94c4-7671d00a9645-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3dacfef1-c6e2-4264-94c4-7671d00a9645" (UID: "3dacfef1-c6e2-4264-94c4-7671d00a9645"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:08:42.999702 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:42.999681    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dacfef1-c6e2-4264-94c4-7671d00a9645-kube-api-access-b5q4k" (OuterVolumeSpecName: "kube-api-access-b5q4k") pod "3dacfef1-c6e2-4264-94c4-7671d00a9645" (UID: "3dacfef1-c6e2-4264-94c4-7671d00a9645"). InnerVolumeSpecName "kube-api-access-b5q4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:08:43.057863 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.057803    2575 generic.go:356] "Generic (PLEG): container finished" podID="3dacfef1-c6e2-4264-94c4-7671d00a9645" containerID="3af4e4ffb52cd980c00a81b3c3ba7a5b4f35add701ba54f0ad3092eb1a62f966" exitCode=0
Aug 05 17:08:43.057863 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.057852    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd" event={"ID":"3dacfef1-c6e2-4264-94c4-7671d00a9645","Type":"ContainerDied","Data":"3af4e4ffb52cd980c00a81b3c3ba7a5b4f35add701ba54f0ad3092eb1a62f966"}
Aug 05 17:08:43.057863 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.057865    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"
Aug 05 17:08:43.058052 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.057908    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd" event={"ID":"3dacfef1-c6e2-4264-94c4-7671d00a9645","Type":"ContainerDied","Data":"4c7128e6efa98faebb551ae7b0a163b3a3122903b5f3b34385a6769d08c812ca"}
Aug 05 17:08:43.058052 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.057924    2575 scope.go:117] "RemoveContainer" containerID="3af4e4ffb52cd980c00a81b3c3ba7a5b4f35add701ba54f0ad3092eb1a62f966"
Aug 05 17:08:43.068085 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.068064    2575 scope.go:117] "RemoveContainer" containerID="3af4e4ffb52cd980c00a81b3c3ba7a5b4f35add701ba54f0ad3092eb1a62f966"
Aug 05 17:08:43.068347 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:08:43.068328    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3af4e4ffb52cd980c00a81b3c3ba7a5b4f35add701ba54f0ad3092eb1a62f966\": container with ID starting with 3af4e4ffb52cd980c00a81b3c3ba7a5b4f35add701ba54f0ad3092eb1a62f966 not found: ID does not exist" containerID="3af4e4ffb52cd980c00a81b3c3ba7a5b4f35add701ba54f0ad3092eb1a62f966"
Aug 05 17:08:43.068402 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.068356    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3af4e4ffb52cd980c00a81b3c3ba7a5b4f35add701ba54f0ad3092eb1a62f966"} err="failed to get container status \"3af4e4ffb52cd980c00a81b3c3ba7a5b4f35add701ba54f0ad3092eb1a62f966\": rpc error: code = NotFound desc = could not find container \"3af4e4ffb52cd980c00a81b3c3ba7a5b4f35add701ba54f0ad3092eb1a62f966\": container with ID starting with 3af4e4ffb52cd980c00a81b3c3ba7a5b4f35add701ba54f0ad3092eb1a62f966 not found: ID does not exist"
Aug 05 17:08:43.091466 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.091442    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"]
Aug 05 17:08:43.094545 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.094525    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fba92dbb-857944856f-2dppd"]
Aug 05 17:08:43.098958 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.098938    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3dacfef1-c6e2-4264-94c4-7671d00a9645-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:08:43.099050 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.098962    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3dacfef1-c6e2-4264-94c4-7671d00a9645-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:08:43.099050 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.098976    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5q4k\" (UniqueName: \"kubernetes.io/projected/3dacfef1-c6e2-4264-94c4-7671d00a9645-kube-api-access-b5q4k\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:08:43.111339 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.111322    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:43.139904 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.139864    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn"]
Aug 05 17:08:43.141975 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.141958    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fba92dbb-8ddzn"]
Aug 05 17:08:43.192557 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.192484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:43.341320 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.341286    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:43.576597 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.576518    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:43.852658 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.852568    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:43.970947 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:43.970915    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:44.013900 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:44.013873    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dacfef1-c6e2-4264-94c4-7671d00a9645" path="/var/lib/kubelet/pods/3dacfef1-c6e2-4264-94c4-7671d00a9645/volumes"
Aug 05 17:08:44.014284 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:44.014269    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deec5e2e-e719-4dd2-b056-c934ba2d58c9" path="/var/lib/kubelet/pods/deec5e2e-e719-4dd2-b056-c934ba2d58c9/volumes"
Aug 05 17:08:44.084906 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:44.084876    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:44.571466 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:44.571435    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:44.947256 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:44.947228    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:45.931046 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:45.931019    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:08:47.334485 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.334448    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:47.429453 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.429426    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"]
Aug 05 17:08:47.429793 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.429780    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deec5e2e-e719-4dd2-b056-c934ba2d58c9" containerName="revoke-keys"
Aug 05 17:08:47.429793 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.429794    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="deec5e2e-e719-4dd2-b056-c934ba2d58c9" containerName="revoke-keys"
Aug 05 17:08:47.429902 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.429833    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dacfef1-c6e2-4264-94c4-7671d00a9645" containerName="maas-api"
Aug 05 17:08:47.429902 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.429842    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dacfef1-c6e2-4264-94c4-7671d00a9645" containerName="maas-api"
Aug 05 17:08:47.429902 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.429899    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="deec5e2e-e719-4dd2-b056-c934ba2d58c9" containerName="revoke-keys"
Aug 05 17:08:47.430007 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.429908    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dacfef1-c6e2-4264-94c4-7671d00a9645" containerName="maas-api"
Aug 05 17:08:47.434017 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.433998    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:08:47.437864 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.437848    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-1678b097-serving-cert\""
Aug 05 17:08:47.437975 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.437849    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:08:47.438158 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.438144    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 17:08:47.439002 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.438986    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nplzm\""
Aug 05 17:08:47.452844 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.452822    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"]
Aug 05 17:08:47.500027 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.499997    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:47.538500 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.538475    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133bdb5e-0687-4862-8467-3bfd71fc3f17-openshift-service-ca\") pod \"maas-api-e2e-migrate-1678b097-79dd945798-c6tgx\" (UID: \"133bdb5e-0687-4862-8467-3bfd71fc3f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:08:47.538654 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.538530    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133bdb5e-0687-4862-8467-3bfd71fc3f17-maas-api-tls\") pod \"maas-api-e2e-migrate-1678b097-79dd945798-c6tgx\" (UID: \"133bdb5e-0687-4862-8467-3bfd71fc3f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:08:47.538654 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.538558    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsvwr\" (UniqueName: \"kubernetes.io/projected/133bdb5e-0687-4862-8467-3bfd71fc3f17-kube-api-access-tsvwr\") pod \"maas-api-e2e-migrate-1678b097-79dd945798-c6tgx\" (UID: \"133bdb5e-0687-4862-8467-3bfd71fc3f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:08:47.598509 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.598433    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:47.639362 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.639332    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133bdb5e-0687-4862-8467-3bfd71fc3f17-maas-api-tls\") pod \"maas-api-e2e-migrate-1678b097-79dd945798-c6tgx\" (UID: \"133bdb5e-0687-4862-8467-3bfd71fc3f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:08:47.639522 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.639375    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsvwr\" (UniqueName: \"kubernetes.io/projected/133bdb5e-0687-4862-8467-3bfd71fc3f17-kube-api-access-tsvwr\") pod \"maas-api-e2e-migrate-1678b097-79dd945798-c6tgx\" (UID: \"133bdb5e-0687-4862-8467-3bfd71fc3f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:08:47.639522 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.639487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133bdb5e-0687-4862-8467-3bfd71fc3f17-openshift-service-ca\") pod \"maas-api-e2e-migrate-1678b097-79dd945798-c6tgx\" (UID: \"133bdb5e-0687-4862-8467-3bfd71fc3f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:08:47.640153 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.640128    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133bdb5e-0687-4862-8467-3bfd71fc3f17-openshift-service-ca\") pod \"maas-api-e2e-migrate-1678b097-79dd945798-c6tgx\" (UID: \"133bdb5e-0687-4862-8467-3bfd71fc3f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:08:47.641882 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.641861    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133bdb5e-0687-4862-8467-3bfd71fc3f17-maas-api-tls\") pod \"maas-api-e2e-migrate-1678b097-79dd945798-c6tgx\" (UID: \"133bdb5e-0687-4862-8467-3bfd71fc3f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:08:47.654095 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.654069    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsvwr\" (UniqueName: \"kubernetes.io/projected/133bdb5e-0687-4862-8467-3bfd71fc3f17-kube-api-access-tsvwr\") pod \"maas-api-e2e-migrate-1678b097-79dd945798-c6tgx\" (UID: \"133bdb5e-0687-4862-8467-3bfd71fc3f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:08:47.744214 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.744171    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:08:47.886846 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:47.886798    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"]
Aug 05 17:08:47.889025 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:08:47.888996    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133bdb5e_0687_4862_8467_3bfd71fc3f17.slice/crio-ba3c88163c287793bfdb920366c3a3ea89851dda10a584bed2c02684ed6575c9 WatchSource:0}: Error finding container ba3c88163c287793bfdb920366c3a3ea89851dda10a584bed2c02684ed6575c9: Status 404 returned error can't find the container with id ba3c88163c287793bfdb920366c3a3ea89851dda10a584bed2c02684ed6575c9
Aug 05 17:08:48.082349 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:48.082317    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx" event={"ID":"133bdb5e-0687-4862-8467-3bfd71fc3f17","Type":"ContainerStarted","Data":"ba3c88163c287793bfdb920366c3a3ea89851dda10a584bed2c02684ed6575c9"}
Aug 05 17:08:48.313564 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:48.313529    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:48.481206 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:48.481179    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:08:49.089000 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:49.088963    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx" event={"ID":"133bdb5e-0687-4862-8467-3bfd71fc3f17","Type":"ContainerStarted","Data":"c2c0f80e57d6ac8557b3b91c08ee3bd559c56175ce44182ffb45d1d8f28a04a4"}
Aug 05 17:08:49.089244 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:49.089096    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:08:49.114651 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:49.114605    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx" podStartSLOduration=1.728133405 podStartE2EDuration="2.114591367s" totalImagesPullingTime="386.457962ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:08:49.113406195 +0000 UTC m=+1783.562952495" watchObservedRunningTime="2026-08-05 17:08:49.114591367 +0000 UTC m=+1783.564137643"
Aug 05 17:08:54.938677 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:54.938643    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:08:55.098575 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:08:55.098545    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:09:06.068025 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:06.067990    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:09:06.070039 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:06.070014    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:09:07.106170 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:07.106134    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:12.117754 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:12.117717    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn"]
Aug 05 17:09:12.121143 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:12.121126    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn"
Aug 05 17:09:12.124483 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:12.124459    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:09:12.132436 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:12.132416    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn"]
Aug 05 17:09:12.254830 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:12.254776    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6ab81e7-36f5-4220-9220-59b8a4209de7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn\" (UID: \"f6ab81e7-36f5-4220-9220-59b8a4209de7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn"
Aug 05 17:09:12.355222 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:12.355191    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6ab81e7-36f5-4220-9220-59b8a4209de7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn\" (UID: \"f6ab81e7-36f5-4220-9220-59b8a4209de7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn"
Aug 05 17:09:12.355800 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:12.355780    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6ab81e7-36f5-4220-9220-59b8a4209de7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn\" (UID: \"f6ab81e7-36f5-4220-9220-59b8a4209de7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn"
Aug 05 17:09:12.431859 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:12.431824    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn"
Aug 05 17:09:12.770891 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:12.770865    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn"]
Aug 05 17:09:12.773459 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:09:12.773425    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ab81e7_36f5_4220_9220_59b8a4209de7.slice/crio-53d1fc1886b535f1942070369d94a98103216b54ca2c4d181024b540328efd18 WatchSource:0}: Error finding container 53d1fc1886b535f1942070369d94a98103216b54ca2c4d181024b540328efd18: Status 404 returned error can't find the container with id 53d1fc1886b535f1942070369d94a98103216b54ca2c4d181024b540328efd18
Aug 05 17:09:13.197305 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:13.197269    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn" event={"ID":"f6ab81e7-36f5-4220-9220-59b8a4209de7","Type":"ContainerStarted","Data":"a190ef35b544e27e6c39d3da921b74337aed7ed2eb5325615059c9ba2dc7a83e"}
Aug 05 17:09:13.197747 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:13.197321    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn" event={"ID":"f6ab81e7-36f5-4220-9220-59b8a4209de7","Type":"ContainerStarted","Data":"53d1fc1886b535f1942070369d94a98103216b54ca2c4d181024b540328efd18"}
Aug 05 17:09:13.232094 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:13.232048    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn" podStartSLOduration=1.232032896 podStartE2EDuration="1.232032896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:09:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:09:13.229481711 +0000 UTC m=+1807.679028010" watchObservedRunningTime="2026-08-05 17:09:13.232032896 +0000 UTC m=+1807.681579197"
Aug 05 17:09:14.203556 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:14.203522    2575 generic.go:356] "Generic (PLEG): container finished" podID="f6ab81e7-36f5-4220-9220-59b8a4209de7" containerID="a190ef35b544e27e6c39d3da921b74337aed7ed2eb5325615059c9ba2dc7a83e" exitCode=0
Aug 05 17:09:14.204045 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:14.203590    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn" event={"ID":"f6ab81e7-36f5-4220-9220-59b8a4209de7","Type":"ContainerDied","Data":"a190ef35b544e27e6c39d3da921b74337aed7ed2eb5325615059c9ba2dc7a83e"}
Aug 05 17:09:15.336279 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:15.336254    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn"
Aug 05 17:09:15.485797 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:15.485724    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6ab81e7-36f5-4220-9220-59b8a4209de7-maas-api-service-ca\") pod \"f6ab81e7-36f5-4220-9220-59b8a4209de7\" (UID: \"f6ab81e7-36f5-4220-9220-59b8a4209de7\") "
Aug 05 17:09:15.486063 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:15.486041    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6ab81e7-36f5-4220-9220-59b8a4209de7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f6ab81e7-36f5-4220-9220-59b8a4209de7" (UID: "f6ab81e7-36f5-4220-9220-59b8a4209de7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:09:15.587131 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:15.587103    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6ab81e7-36f5-4220-9220-59b8a4209de7-maas-api-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:09:16.214008 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:16.213978    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn"
Aug 05 17:09:16.214176 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:16.213975    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn" event={"ID":"f6ab81e7-36f5-4220-9220-59b8a4209de7","Type":"ContainerDied","Data":"53d1fc1886b535f1942070369d94a98103216b54ca2c4d181024b540328efd18"}
Aug 05 17:09:16.214176 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:16.214113    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53d1fc1886b535f1942070369d94a98103216b54ca2c4d181024b540328efd18"
Aug 05 17:09:17.667433 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:17.667400    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"]
Aug 05 17:09:17.667905 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:17.667652    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx" podUID="133bdb5e-0687-4862-8467-3bfd71fc3f17" containerName="maas-api" containerID="cri-o://c2c0f80e57d6ac8557b3b91c08ee3bd559c56175ce44182ffb45d1d8f28a04a4" gracePeriod=30
Aug 05 17:09:17.694564 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:17.694536    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:17.796249 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:17.796218    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:17.889623 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:17.889593    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:17.912471 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:17.912450    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:09:17.953147 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:17.953075    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn"]
Aug 05 17:09:17.956869 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:17.956844    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1678b097-v8pcn"]
Aug 05 17:09:17.998748 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:17.998720    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:18.009743 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.009719    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsvwr\" (UniqueName: \"kubernetes.io/projected/133bdb5e-0687-4862-8467-3bfd71fc3f17-kube-api-access-tsvwr\") pod \"133bdb5e-0687-4862-8467-3bfd71fc3f17\" (UID: \"133bdb5e-0687-4862-8467-3bfd71fc3f17\") "
Aug 05 17:09:18.009832 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.009780    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133bdb5e-0687-4862-8467-3bfd71fc3f17-maas-api-tls\") pod \"133bdb5e-0687-4862-8467-3bfd71fc3f17\" (UID: \"133bdb5e-0687-4862-8467-3bfd71fc3f17\") "
Aug 05 17:09:18.009967 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.009953    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133bdb5e-0687-4862-8467-3bfd71fc3f17-openshift-service-ca\") pod \"133bdb5e-0687-4862-8467-3bfd71fc3f17\" (UID: \"133bdb5e-0687-4862-8467-3bfd71fc3f17\") "
Aug 05 17:09:18.010284 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.010261    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/133bdb5e-0687-4862-8467-3bfd71fc3f17-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "133bdb5e-0687-4862-8467-3bfd71fc3f17" (UID: "133bdb5e-0687-4862-8467-3bfd71fc3f17"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:09:18.011773 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.011752    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/133bdb5e-0687-4862-8467-3bfd71fc3f17-kube-api-access-tsvwr" (OuterVolumeSpecName: "kube-api-access-tsvwr") pod "133bdb5e-0687-4862-8467-3bfd71fc3f17" (UID: "133bdb5e-0687-4862-8467-3bfd71fc3f17"). InnerVolumeSpecName "kube-api-access-tsvwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:18.012204 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.012187    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/133bdb5e-0687-4862-8467-3bfd71fc3f17-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "133bdb5e-0687-4862-8467-3bfd71fc3f17" (UID: "133bdb5e-0687-4862-8467-3bfd71fc3f17"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:09:18.014699 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.014674    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6ab81e7-36f5-4220-9220-59b8a4209de7" path="/var/lib/kubelet/pods/f6ab81e7-36f5-4220-9220-59b8a4209de7/volumes"
Aug 05 17:09:18.111601 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.111570    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133bdb5e-0687-4862-8467-3bfd71fc3f17-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:09:18.111601 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.111594    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsvwr\" (UniqueName: \"kubernetes.io/projected/133bdb5e-0687-4862-8467-3bfd71fc3f17-kube-api-access-tsvwr\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:09:18.111601 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.111606    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133bdb5e-0687-4862-8467-3bfd71fc3f17-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:09:18.173781 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.173747    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:18.224700 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.224619    2575 generic.go:356] "Generic (PLEG): container finished" podID="133bdb5e-0687-4862-8467-3bfd71fc3f17" containerID="c2c0f80e57d6ac8557b3b91c08ee3bd559c56175ce44182ffb45d1d8f28a04a4" exitCode=0
Aug 05 17:09:18.224700 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.224671    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"
Aug 05 17:09:18.224910 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.224712    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx" event={"ID":"133bdb5e-0687-4862-8467-3bfd71fc3f17","Type":"ContainerDied","Data":"c2c0f80e57d6ac8557b3b91c08ee3bd559c56175ce44182ffb45d1d8f28a04a4"}
Aug 05 17:09:18.224910 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.224763    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx" event={"ID":"133bdb5e-0687-4862-8467-3bfd71fc3f17","Type":"ContainerDied","Data":"ba3c88163c287793bfdb920366c3a3ea89851dda10a584bed2c02684ed6575c9"}
Aug 05 17:09:18.224910 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.224785    2575 scope.go:117] "RemoveContainer" containerID="c2c0f80e57d6ac8557b3b91c08ee3bd559c56175ce44182ffb45d1d8f28a04a4"
Aug 05 17:09:18.233747 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.233722    2575 scope.go:117] "RemoveContainer" containerID="c2c0f80e57d6ac8557b3b91c08ee3bd559c56175ce44182ffb45d1d8f28a04a4"
Aug 05 17:09:18.234070 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:09:18.234043    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2c0f80e57d6ac8557b3b91c08ee3bd559c56175ce44182ffb45d1d8f28a04a4\": container with ID starting with c2c0f80e57d6ac8557b3b91c08ee3bd559c56175ce44182ffb45d1d8f28a04a4 not found: ID does not exist" containerID="c2c0f80e57d6ac8557b3b91c08ee3bd559c56175ce44182ffb45d1d8f28a04a4"
Aug 05 17:09:18.234182 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.234081    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2c0f80e57d6ac8557b3b91c08ee3bd559c56175ce44182ffb45d1d8f28a04a4"} err="failed to get container status \"c2c0f80e57d6ac8557b3b91c08ee3bd559c56175ce44182ffb45d1d8f28a04a4\": rpc error: code = NotFound desc = could not find container \"c2c0f80e57d6ac8557b3b91c08ee3bd559c56175ce44182ffb45d1d8f28a04a4\": container with ID starting with c2c0f80e57d6ac8557b3b91c08ee3bd559c56175ce44182ffb45d1d8f28a04a4 not found: ID does not exist"
Aug 05 17:09:18.246527 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.246504    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"]
Aug 05 17:09:18.251265 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.251243    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1678b097-79dd945798-c6tgx"]
Aug 05 17:09:18.354096 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.354056    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:18.616630 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:18.616543    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:19.129115 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:19.129086    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:19.245920 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:19.245890    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:20.014412 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:20.014377    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="133bdb5e-0687-4862-8467-3bfd71fc3f17" path="/var/lib/kubelet/pods/133bdb5e-0687-4862-8467-3bfd71fc3f17/volumes"
Aug 05 17:09:20.706904 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:20.706868    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:09:21.233867 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:21.233770    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:21.323600 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:21.323571    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:22.353174 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.353144    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"]
Aug 05 17:09:22.353538 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.353471    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ab81e7-36f5-4220-9220-59b8a4209de7" containerName="revoke-keys"
Aug 05 17:09:22.353538 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.353482    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ab81e7-36f5-4220-9220-59b8a4209de7" containerName="revoke-keys"
Aug 05 17:09:22.353538 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.353501    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133bdb5e-0687-4862-8467-3bfd71fc3f17" containerName="maas-api"
Aug 05 17:09:22.353538 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.353507    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="133bdb5e-0687-4862-8467-3bfd71fc3f17" containerName="maas-api"
Aug 05 17:09:22.353669 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.353559    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="133bdb5e-0687-4862-8467-3bfd71fc3f17" containerName="maas-api"
Aug 05 17:09:22.353669 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.353570    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6ab81e7-36f5-4220-9220-59b8a4209de7" containerName="revoke-keys"
Aug 05 17:09:22.357698 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.357681    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:22.360743 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.360723    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:09:22.360988 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.360972    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nplzm\""
Aug 05 17:09:22.361224 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.361207    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-324ed8e0-serving-cert\""
Aug 05 17:09:22.361292 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.361278    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 17:09:22.373253 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.373233    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"]
Aug 05 17:09:22.417504 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.417468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:22.450716 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.450691    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12ed1e3a-b70b-41b2-b7f0-37c283813428-maas-api-tls\") pod \"maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2\" (UID: \"12ed1e3a-b70b-41b2-b7f0-37c283813428\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:22.450859 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.450723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12ed1e3a-b70b-41b2-b7f0-37c283813428-openshift-service-ca\") pod \"maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2\" (UID: \"12ed1e3a-b70b-41b2-b7f0-37c283813428\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:22.450859 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.450744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbc4g\" (UniqueName: \"kubernetes.io/projected/12ed1e3a-b70b-41b2-b7f0-37c283813428-kube-api-access-wbc4g\") pod \"maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2\" (UID: \"12ed1e3a-b70b-41b2-b7f0-37c283813428\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:22.551879 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.551851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12ed1e3a-b70b-41b2-b7f0-37c283813428-maas-api-tls\") pod \"maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2\" (UID: \"12ed1e3a-b70b-41b2-b7f0-37c283813428\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:22.552039 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.551886    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12ed1e3a-b70b-41b2-b7f0-37c283813428-openshift-service-ca\") pod \"maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2\" (UID: \"12ed1e3a-b70b-41b2-b7f0-37c283813428\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:22.552039 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.551913    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbc4g\" (UniqueName: \"kubernetes.io/projected/12ed1e3a-b70b-41b2-b7f0-37c283813428-kube-api-access-wbc4g\") pod \"maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2\" (UID: \"12ed1e3a-b70b-41b2-b7f0-37c283813428\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:22.552570 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.552545    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12ed1e3a-b70b-41b2-b7f0-37c283813428-openshift-service-ca\") pod \"maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2\" (UID: \"12ed1e3a-b70b-41b2-b7f0-37c283813428\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:22.554296 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.554274    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12ed1e3a-b70b-41b2-b7f0-37c283813428-maas-api-tls\") pod \"maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2\" (UID: \"12ed1e3a-b70b-41b2-b7f0-37c283813428\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:22.562911 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.562885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbc4g\" (UniqueName: \"kubernetes.io/projected/12ed1e3a-b70b-41b2-b7f0-37c283813428-kube-api-access-wbc4g\") pod \"maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2\" (UID: \"12ed1e3a-b70b-41b2-b7f0-37c283813428\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:22.579175 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.579150    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:22.667961 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.667935    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:22.821510 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:22.821479    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"]
Aug 05 17:09:22.822708 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:09:22.822676    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ed1e3a_b70b_41b2_b7f0_37c283813428.slice/crio-e3d505e6035527b6d7b3d134b8776ce7dc8aff4663eafa60689abeb7c4c416f7 WatchSource:0}: Error finding container e3d505e6035527b6d7b3d134b8776ce7dc8aff4663eafa60689abeb7c4c416f7: Status 404 returned error can't find the container with id e3d505e6035527b6d7b3d134b8776ce7dc8aff4663eafa60689abeb7c4c416f7
Aug 05 17:09:23.164413 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:23.164380    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:23.248775 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:23.248744    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2" event={"ID":"12ed1e3a-b70b-41b2-b7f0-37c283813428","Type":"ContainerStarted","Data":"e3d505e6035527b6d7b3d134b8776ce7dc8aff4663eafa60689abeb7c4c416f7"}
Aug 05 17:09:23.371949 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:23.371780    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:24.255841 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:24.255789    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2" event={"ID":"12ed1e3a-b70b-41b2-b7f0-37c283813428","Type":"ContainerStarted","Data":"09fcf6492f96e971780df1a158753aac535a6b47ce4fbbfb508fa20e056bc8a1"}
Aug 05 17:09:24.256018 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:24.255936    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:24.279778 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:24.279728    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2" podStartSLOduration=1.747282558 podStartE2EDuration="2.279713392s" totalImagesPullingTime="532.430834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:09:24.277568202 +0000 UTC m=+1818.727114502" watchObservedRunningTime="2026-08-05 17:09:24.279713392 +0000 UTC m=+1818.729259691"
Aug 05 17:09:29.814801 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:29.814769    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:09:30.266203 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:30.266173    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:52.227928 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:52.227896    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78"]
Aug 05 17:09:52.231429 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:52.231413    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78"
Aug 05 17:09:52.234192 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:52.234171    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:09:52.242021 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:52.241998    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78"]
Aug 05 17:09:52.308309 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:52.308283    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/124cb369-463c-474a-a87d-a2e2a6725236-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-324ed8e0-64m78\" (UID: \"124cb369-463c-474a-a87d-a2e2a6725236\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78"
Aug 05 17:09:52.409488 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:52.409460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/124cb369-463c-474a-a87d-a2e2a6725236-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-324ed8e0-64m78\" (UID: \"124cb369-463c-474a-a87d-a2e2a6725236\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78"
Aug 05 17:09:52.410093 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:52.410074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/124cb369-463c-474a-a87d-a2e2a6725236-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-324ed8e0-64m78\" (UID: \"124cb369-463c-474a-a87d-a2e2a6725236\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78"
Aug 05 17:09:52.543322 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:52.543258    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78"
Aug 05 17:09:52.693901 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:52.693870    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78"]
Aug 05 17:09:52.697336 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:09:52.697311    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124cb369_463c_474a_a87d_a2e2a6725236.slice/crio-fba12edac45dbfb25e2e090af71b24346eb50d1c57efbb645eaa29f27511f893 WatchSource:0}: Error finding container fba12edac45dbfb25e2e090af71b24346eb50d1c57efbb645eaa29f27511f893: Status 404 returned error can't find the container with id fba12edac45dbfb25e2e090af71b24346eb50d1c57efbb645eaa29f27511f893
Aug 05 17:09:53.390870 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:53.390839    2575 generic.go:356] "Generic (PLEG): container finished" podID="124cb369-463c-474a-a87d-a2e2a6725236" containerID="4cdf5830119ffd31f9f2f14bd7a54f04bdf53142bfef00ff7f97818028805aaf" exitCode=0
Aug 05 17:09:53.391204 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:53.390879    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78" event={"ID":"124cb369-463c-474a-a87d-a2e2a6725236","Type":"ContainerDied","Data":"4cdf5830119ffd31f9f2f14bd7a54f04bdf53142bfef00ff7f97818028805aaf"}
Aug 05 17:09:53.391204 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:53.390924    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78" event={"ID":"124cb369-463c-474a-a87d-a2e2a6725236","Type":"ContainerStarted","Data":"fba12edac45dbfb25e2e090af71b24346eb50d1c57efbb645eaa29f27511f893"}
Aug 05 17:09:54.529940 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:54.529918    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78"
Aug 05 17:09:54.631163 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:54.631130    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/124cb369-463c-474a-a87d-a2e2a6725236-maas-api-service-ca\") pod \"124cb369-463c-474a-a87d-a2e2a6725236\" (UID: \"124cb369-463c-474a-a87d-a2e2a6725236\") "
Aug 05 17:09:54.631459 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:54.631439    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/124cb369-463c-474a-a87d-a2e2a6725236-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "124cb369-463c-474a-a87d-a2e2a6725236" (UID: "124cb369-463c-474a-a87d-a2e2a6725236"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:09:54.732073 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:54.732043    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/124cb369-463c-474a-a87d-a2e2a6725236-maas-api-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:09:55.401137 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:55.401101    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78" event={"ID":"124cb369-463c-474a-a87d-a2e2a6725236","Type":"ContainerDied","Data":"fba12edac45dbfb25e2e090af71b24346eb50d1c57efbb645eaa29f27511f893"}
Aug 05 17:09:55.401288 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:55.401152    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fba12edac45dbfb25e2e090af71b24346eb50d1c57efbb645eaa29f27511f893"
Aug 05 17:09:55.401288 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:55.401119    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78"
Aug 05 17:09:56.663844 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:56.663795    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"]
Aug 05 17:09:56.664217 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:56.664089    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2" podUID="12ed1e3a-b70b-41b2-b7f0-37c283813428" containerName="maas-api" containerID="cri-o://09fcf6492f96e971780df1a158753aac535a6b47ce4fbbfb508fa20e056bc8a1" gracePeriod=30
Aug 05 17:09:56.705083 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:56.705051    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:56.798274 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:56.798241    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:56.915536 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:56.915482    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:56.939966 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:56.939941    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:57.009708 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.009681    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78"]
Aug 05 17:09:57.014706 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.014684    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-324ed8e0-64m78"]
Aug 05 17:09:57.053207 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.053183    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12ed1e3a-b70b-41b2-b7f0-37c283813428-maas-api-tls\") pod \"12ed1e3a-b70b-41b2-b7f0-37c283813428\" (UID: \"12ed1e3a-b70b-41b2-b7f0-37c283813428\") "
Aug 05 17:09:57.053294 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.053212    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbc4g\" (UniqueName: \"kubernetes.io/projected/12ed1e3a-b70b-41b2-b7f0-37c283813428-kube-api-access-wbc4g\") pod \"12ed1e3a-b70b-41b2-b7f0-37c283813428\" (UID: \"12ed1e3a-b70b-41b2-b7f0-37c283813428\") "
Aug 05 17:09:57.053294 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.053268    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12ed1e3a-b70b-41b2-b7f0-37c283813428-openshift-service-ca\") pod \"12ed1e3a-b70b-41b2-b7f0-37c283813428\" (UID: \"12ed1e3a-b70b-41b2-b7f0-37c283813428\") "
Aug 05 17:09:57.053760 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.053729    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12ed1e3a-b70b-41b2-b7f0-37c283813428-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "12ed1e3a-b70b-41b2-b7f0-37c283813428" (UID: "12ed1e3a-b70b-41b2-b7f0-37c283813428"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:09:57.055288 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.055261    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12ed1e3a-b70b-41b2-b7f0-37c283813428-kube-api-access-wbc4g" (OuterVolumeSpecName: "kube-api-access-wbc4g") pod "12ed1e3a-b70b-41b2-b7f0-37c283813428" (UID: "12ed1e3a-b70b-41b2-b7f0-37c283813428"). InnerVolumeSpecName "kube-api-access-wbc4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:57.055372 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.055295    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12ed1e3a-b70b-41b2-b7f0-37c283813428-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "12ed1e3a-b70b-41b2-b7f0-37c283813428" (UID: "12ed1e3a-b70b-41b2-b7f0-37c283813428"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:09:57.136011 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.135983    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:57.154894 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.154875    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12ed1e3a-b70b-41b2-b7f0-37c283813428-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:09:57.154894 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.154893    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbc4g\" (UniqueName: \"kubernetes.io/projected/12ed1e3a-b70b-41b2-b7f0-37c283813428-kube-api-access-wbc4g\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:09:57.155005 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.154903    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12ed1e3a-b70b-41b2-b7f0-37c283813428-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:09:57.413938 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.413902    2575 generic.go:356] "Generic (PLEG): container finished" podID="12ed1e3a-b70b-41b2-b7f0-37c283813428" containerID="09fcf6492f96e971780df1a158753aac535a6b47ce4fbbfb508fa20e056bc8a1" exitCode=0
Aug 05 17:09:57.414085 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.413951    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"
Aug 05 17:09:57.414085 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.413993    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2" event={"ID":"12ed1e3a-b70b-41b2-b7f0-37c283813428","Type":"ContainerDied","Data":"09fcf6492f96e971780df1a158753aac535a6b47ce4fbbfb508fa20e056bc8a1"}
Aug 05 17:09:57.414085 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.414049    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2" event={"ID":"12ed1e3a-b70b-41b2-b7f0-37c283813428","Type":"ContainerDied","Data":"e3d505e6035527b6d7b3d134b8776ce7dc8aff4663eafa60689abeb7c4c416f7"}
Aug 05 17:09:57.414085 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.414073    2575 scope.go:117] "RemoveContainer" containerID="09fcf6492f96e971780df1a158753aac535a6b47ce4fbbfb508fa20e056bc8a1"
Aug 05 17:09:57.422868 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.422852    2575 scope.go:117] "RemoveContainer" containerID="09fcf6492f96e971780df1a158753aac535a6b47ce4fbbfb508fa20e056bc8a1"
Aug 05 17:09:57.423104 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:09:57.423083    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09fcf6492f96e971780df1a158753aac535a6b47ce4fbbfb508fa20e056bc8a1\": container with ID starting with 09fcf6492f96e971780df1a158753aac535a6b47ce4fbbfb508fa20e056bc8a1 not found: ID does not exist" containerID="09fcf6492f96e971780df1a158753aac535a6b47ce4fbbfb508fa20e056bc8a1"
Aug 05 17:09:57.423154 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.423113    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09fcf6492f96e971780df1a158753aac535a6b47ce4fbbfb508fa20e056bc8a1"} err="failed to get container status \"09fcf6492f96e971780df1a158753aac535a6b47ce4fbbfb508fa20e056bc8a1\": rpc error: code = NotFound desc = could not find container \"09fcf6492f96e971780df1a158753aac535a6b47ce4fbbfb508fa20e056bc8a1\": container with ID starting with 09fcf6492f96e971780df1a158753aac535a6b47ce4fbbfb508fa20e056bc8a1 not found: ID does not exist"
Aug 05 17:09:57.443636 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.443609    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"]
Aug 05 17:09:57.445002 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:57.444983    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-324ed8e0-54865f579d-lr8x2"]
Aug 05 17:09:58.013884 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:58.013856    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="124cb369-463c-474a-a87d-a2e2a6725236" path="/var/lib/kubelet/pods/124cb369-463c-474a-a87d-a2e2a6725236/volumes"
Aug 05 17:09:58.014249 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:58.014229    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12ed1e3a-b70b-41b2-b7f0-37c283813428" path="/var/lib/kubelet/pods/12ed1e3a-b70b-41b2-b7f0-37c283813428/volumes"
Aug 05 17:09:58.280147 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:58.280060    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:58.478922 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:58.478887    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:58.798280 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:58.798244    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:59.116099 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:59.115998    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:59.247372 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:59.247333    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:09:59.907138 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:09:59.907104    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:10:01.585414 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:01.585374    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:01.754384 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:01.754346    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:02.636078 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.636047    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"]
Aug 05 17:10:02.636443 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.636377    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12ed1e3a-b70b-41b2-b7f0-37c283813428" containerName="maas-api"
Aug 05 17:10:02.636443 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.636389    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="12ed1e3a-b70b-41b2-b7f0-37c283813428" containerName="maas-api"
Aug 05 17:10:02.636443 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.636410    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="124cb369-463c-474a-a87d-a2e2a6725236" containerName="revoke-keys"
Aug 05 17:10:02.636443 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.636416    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="124cb369-463c-474a-a87d-a2e2a6725236" containerName="revoke-keys"
Aug 05 17:10:02.636578 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.636467    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="124cb369-463c-474a-a87d-a2e2a6725236" containerName="revoke-keys"
Aug 05 17:10:02.636578 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.636477    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="12ed1e3a-b70b-41b2-b7f0-37c283813428" containerName="maas-api"
Aug 05 17:10:02.641173 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.641158    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:02.644542 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.644512    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-8bdcbc9e-serving-cert\""
Aug 05 17:10:02.644666 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.644542    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:10:02.644666 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.644569    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 17:10:02.645361 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.645343    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nplzm\""
Aug 05 17:10:02.654546 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.654523    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"]
Aug 05 17:10:02.677100 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.677075    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:02.703708 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.703683    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-openshift-service-ca\") pod \"maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n\" (UID: \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:02.703862 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.703745    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhhxj\" (UniqueName: \"kubernetes.io/projected/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-kube-api-access-zhhxj\") pod \"maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n\" (UID: \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:02.703862 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.703783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-maas-api-tls\") pod \"maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n\" (UID: \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:02.805027 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.804996    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-openshift-service-ca\") pod \"maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n\" (UID: \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:02.805193 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.805047    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhhxj\" (UniqueName: \"kubernetes.io/projected/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-kube-api-access-zhhxj\") pod \"maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n\" (UID: \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:02.805193 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.805072    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-maas-api-tls\") pod \"maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n\" (UID: \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:02.805266 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:10:02.805209    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-serving-cert: secret "maas-api-e2e-derive-8bdcbc9e-serving-cert" not found
Aug 05 17:10:02.805298 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:10:02.805276    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-maas-api-tls podName:4620fc5f-63f2-4cb8-be17-3d688a3ac89a nodeName:}" failed. No retries permitted until 2026-08-05 17:10:03.305257584 +0000 UTC m=+1857.754803862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-maas-api-tls") pod "maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n" (UID: "4620fc5f-63f2-4cb8-be17-3d688a3ac89a") : secret "maas-api-e2e-derive-8bdcbc9e-serving-cert" not found
Aug 05 17:10:02.805614 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.805597    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-openshift-service-ca\") pod \"maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n\" (UID: \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:02.818332 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:02.818300    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhhxj\" (UniqueName: \"kubernetes.io/projected/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-kube-api-access-zhhxj\") pod \"maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n\" (UID: \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:03.194643 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:03.194611    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:03.294339 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:03.294306    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:03.309561 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:03.309534    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-maas-api-tls\") pod \"maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n\" (UID: \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:03.311941 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:03.311920    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-maas-api-tls\") pod \"maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n\" (UID: \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:03.551095 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:03.551017    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:03.689165 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:03.689140    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"]
Aug 05 17:10:03.691209 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:10:03.691178    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4620fc5f_63f2_4cb8_be17_3d688a3ac89a.slice/crio-f073e5dd0af09af19764e142508b4f78b49d94d60e64752964c355c10bf09589 WatchSource:0}: Error finding container f073e5dd0af09af19764e142508b4f78b49d94d60e64752964c355c10bf09589: Status 404 returned error can't find the container with id f073e5dd0af09af19764e142508b4f78b49d94d60e64752964c355c10bf09589
Aug 05 17:10:04.450012 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:04.449974    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n" event={"ID":"4620fc5f-63f2-4cb8-be17-3d688a3ac89a","Type":"ContainerStarted","Data":"329df750e229c82b5f5e3708f410e74a179b65c921b4d752749f1d84dcb54fdc"}
Aug 05 17:10:04.450174 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:04.450031    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n" event={"ID":"4620fc5f-63f2-4cb8-be17-3d688a3ac89a","Type":"ContainerStarted","Data":"f073e5dd0af09af19764e142508b4f78b49d94d60e64752964c355c10bf09589"}
Aug 05 17:10:04.450174 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:04.450086    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:06.412159 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:06.412105    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n" podStartSLOduration=4.050214875 podStartE2EDuration="4.41208908s" totalImagesPullingTime="361.874205ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:10:04.481253512 +0000 UTC m=+1858.930799812" watchObservedRunningTime="2026-08-05 17:10:06.41208908 +0000 UTC m=+1860.861635382"
Aug 05 17:10:06.412588 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:06.412571    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:10:10.459284 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:10.459258    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:16.175786 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:16.175756    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx"]
Aug 05 17:10:16.179256 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:16.179232    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx"
Aug 05 17:10:16.181800 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:16.181778    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:10:16.200709 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:16.200686    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx"]
Aug 05 17:10:16.334603 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:16.334570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx\" (UID: \"d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx"
Aug 05 17:10:16.435308 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:16.435228    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx\" (UID: \"d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx"
Aug 05 17:10:16.435938 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:16.435914    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx\" (UID: \"d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx"
Aug 05 17:10:16.489714 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:16.489687    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx"
Aug 05 17:10:16.832142 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:16.832119    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx"]
Aug 05 17:10:16.833062 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:10:16.833040    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd687e7f6_112b_4b1c_bc74_e91a1a5c5a2a.slice/crio-46c29f2f691634ca0a76cb83cd8ebfc701b5957ea75858c786b0a282ec0af1a4 WatchSource:0}: Error finding container 46c29f2f691634ca0a76cb83cd8ebfc701b5957ea75858c786b0a282ec0af1a4: Status 404 returned error can't find the container with id 46c29f2f691634ca0a76cb83cd8ebfc701b5957ea75858c786b0a282ec0af1a4
Aug 05 17:10:17.510139 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:17.510104    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx" event={"ID":"d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a","Type":"ContainerStarted","Data":"a1da08a52fee0560c6e383666867ec69841a46834770d18ce9fa8533d81db448"}
Aug 05 17:10:17.510619 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:17.510161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx" event={"ID":"d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a","Type":"ContainerStarted","Data":"46c29f2f691634ca0a76cb83cd8ebfc701b5957ea75858c786b0a282ec0af1a4"}
Aug 05 17:10:17.528028 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:17.527972    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx" podStartSLOduration=1.527952466 podStartE2EDuration="1.527952466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:10:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:10:17.526912473 +0000 UTC m=+1871.976458773" watchObservedRunningTime="2026-08-05 17:10:17.527952466 +0000 UTC m=+1871.977498765"
Aug 05 17:10:18.515821 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:18.515764    2575 generic.go:356] "Generic (PLEG): container finished" podID="d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a" containerID="a1da08a52fee0560c6e383666867ec69841a46834770d18ce9fa8533d81db448" exitCode=0
Aug 05 17:10:18.516211 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:18.515827    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx" event={"ID":"d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a","Type":"ContainerDied","Data":"a1da08a52fee0560c6e383666867ec69841a46834770d18ce9fa8533d81db448"}
Aug 05 17:10:19.648215 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:19.648187    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx"
Aug 05 17:10:19.763261 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:19.763230    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a-maas-api-service-ca\") pod \"d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a\" (UID: \"d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a\") "
Aug 05 17:10:19.763531 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:19.763512    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a" (UID: "d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:10:19.864857 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:19.864767    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a-maas-api-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:10:20.525670 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:20.525640    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx"
Aug 05 17:10:20.525861 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:20.525672    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx" event={"ID":"d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a","Type":"ContainerDied","Data":"46c29f2f691634ca0a76cb83cd8ebfc701b5957ea75858c786b0a282ec0af1a4"}
Aug 05 17:10:20.525861 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:20.525718    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46c29f2f691634ca0a76cb83cd8ebfc701b5957ea75858c786b0a282ec0af1a4"
Aug 05 17:10:22.189868 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.189837    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"]
Aug 05 17:10:22.190275 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.190038    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n" podUID="4620fc5f-63f2-4cb8-be17-3d688a3ac89a" containerName="maas-api" containerID="cri-o://329df750e229c82b5f5e3708f410e74a179b65c921b4d752749f1d84dcb54fdc" gracePeriod=30
Aug 05 17:10:22.257688 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.257661    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:22.348021 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.347989    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:22.439675 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.439648    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:22.475557 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.475485    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:22.537589 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.537550    2575 generic.go:356] "Generic (PLEG): container finished" podID="4620fc5f-63f2-4cb8-be17-3d688a3ac89a" containerID="329df750e229c82b5f5e3708f410e74a179b65c921b4d752749f1d84dcb54fdc" exitCode=0
Aug 05 17:10:22.537740 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.537601    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n" event={"ID":"4620fc5f-63f2-4cb8-be17-3d688a3ac89a","Type":"ContainerDied","Data":"329df750e229c82b5f5e3708f410e74a179b65c921b4d752749f1d84dcb54fdc"}
Aug 05 17:10:22.537740 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.537608    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"
Aug 05 17:10:22.537740 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.537650    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n" event={"ID":"4620fc5f-63f2-4cb8-be17-3d688a3ac89a","Type":"ContainerDied","Data":"f073e5dd0af09af19764e142508b4f78b49d94d60e64752964c355c10bf09589"}
Aug 05 17:10:22.537740 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.537675    2575 scope.go:117] "RemoveContainer" containerID="329df750e229c82b5f5e3708f410e74a179b65c921b4d752749f1d84dcb54fdc"
Aug 05 17:10:22.539236 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.539212    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx"]
Aug 05 17:10:22.546965 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.546944    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8bdcbc9e-vx6mx"]
Aug 05 17:10:22.547519 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.547502    2575 scope.go:117] "RemoveContainer" containerID="329df750e229c82b5f5e3708f410e74a179b65c921b4d752749f1d84dcb54fdc"
Aug 05 17:10:22.547751 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:10:22.547734    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"329df750e229c82b5f5e3708f410e74a179b65c921b4d752749f1d84dcb54fdc\": container with ID starting with 329df750e229c82b5f5e3708f410e74a179b65c921b4d752749f1d84dcb54fdc not found: ID does not exist" containerID="329df750e229c82b5f5e3708f410e74a179b65c921b4d752749f1d84dcb54fdc"
Aug 05 17:10:22.547797 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.547762    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"329df750e229c82b5f5e3708f410e74a179b65c921b4d752749f1d84dcb54fdc"} err="failed to get container status \"329df750e229c82b5f5e3708f410e74a179b65c921b4d752749f1d84dcb54fdc\": rpc error: code = NotFound desc = could not find container \"329df750e229c82b5f5e3708f410e74a179b65c921b4d752749f1d84dcb54fdc\": container with ID starting with 329df750e229c82b5f5e3708f410e74a179b65c921b4d752749f1d84dcb54fdc not found: ID does not exist"
Aug 05 17:10:22.570610 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.570591    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:22.587734 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.587710    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-openshift-service-ca\") pod \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\" (UID: \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\") "
Aug 05 17:10:22.587857 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.587736    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhhxj\" (UniqueName: \"kubernetes.io/projected/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-kube-api-access-zhhxj\") pod \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\" (UID: \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\") "
Aug 05 17:10:22.587857 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.587761    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-maas-api-tls\") pod \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\" (UID: \"4620fc5f-63f2-4cb8-be17-3d688a3ac89a\") "
Aug 05 17:10:22.588143 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.588121    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4620fc5f-63f2-4cb8-be17-3d688a3ac89a" (UID: "4620fc5f-63f2-4cb8-be17-3d688a3ac89a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:10:22.589836 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.589801    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-kube-api-access-zhhxj" (OuterVolumeSpecName: "kube-api-access-zhhxj") pod "4620fc5f-63f2-4cb8-be17-3d688a3ac89a" (UID: "4620fc5f-63f2-4cb8-be17-3d688a3ac89a"). InnerVolumeSpecName "kube-api-access-zhhxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:10:22.589945 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.589927    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4620fc5f-63f2-4cb8-be17-3d688a3ac89a" (UID: "4620fc5f-63f2-4cb8-be17-3d688a3ac89a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:10:22.688966 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.688933    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:10:22.688966 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.688961    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhhxj\" (UniqueName: \"kubernetes.io/projected/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-kube-api-access-zhhxj\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:10:22.688966 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.688974    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4620fc5f-63f2-4cb8-be17-3d688a3ac89a-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:10:22.704550 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.704527    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:22.860451 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.860418    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"]
Aug 05 17:10:22.864674 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.864645    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8bdcbc9e-6bff8c97d4-nrl6n"]
Aug 05 17:10:22.928375 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:22.928315    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:23.491415 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:23.491380    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:23.625893 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:23.625856    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:24.014278 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:24.014248    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4620fc5f-63f2-4cb8-be17-3d688a3ac89a" path="/var/lib/kubelet/pods/4620fc5f-63f2-4cb8-be17-3d688a3ac89a/volumes"
Aug 05 17:10:24.014568 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:24.014555    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a" path="/var/lib/kubelet/pods/d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a/volumes"
Aug 05 17:10:25.419240 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:25.419210    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:10:35.458686 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:35.458648    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:38.510704 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:38.510673    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:10:43.353008 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:43.352957    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:43.523965 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:43.523934    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:43.746404 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:43.746375    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:10:44.167031 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:10:44.166997    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:11:10.170580 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:11:10.170539    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:11:10.570562 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:11:10.570475    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:11:18.792125 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:11:18.792087    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:11:19.061954 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:11:19.061855    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:11:19.212240 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:11:19.212203    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:11:35.025051 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:11:35.024987    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:11:42.138715 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:11:42.138677    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:11:42.308123 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:11:42.308092    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:11:52.879359 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:11:52.879326    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:11:53.616228 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:11:53.616195    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:11:53.714667 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:11:53.714630    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:03.980901 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:03.980824    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:13.104393 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:13.104355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:13.410694 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:13.410668    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:14.060011 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:14.059975    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:14.531624 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:14.531589    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:16.109569 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:16.109535    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:16.675486 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:16.675454    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:12:25.557068 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:25.557024    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:26.731568 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:26.731537    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:12:27.423980 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:27.423952    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:34.916679 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:34.916642    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:35.312616 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:35.312483    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:35.485528 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:35.485484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:35.746628 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:35.746598    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:36.136656 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:36.136517    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:37.710958 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:37.710912    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:12:38.961059 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:38.961023    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:39.195218 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:39.195185    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:40.265596 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.265562    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"]
Aug 05 17:12:40.265979 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.265943    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a" containerName="revoke-keys"
Aug 05 17:12:40.265979 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.265955    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a" containerName="revoke-keys"
Aug 05 17:12:40.265979 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.265972    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4620fc5f-63f2-4cb8-be17-3d688a3ac89a" containerName="maas-api"
Aug 05 17:12:40.265979 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.265978    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4620fc5f-63f2-4cb8-be17-3d688a3ac89a" containerName="maas-api"
Aug 05 17:12:40.266108 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.266039    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4620fc5f-63f2-4cb8-be17-3d688a3ac89a" containerName="maas-api"
Aug 05 17:12:40.266108 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.266046    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d687e7f6-112b-4b1c-bc74-e91a1a5c5a2a" containerName="revoke-keys"
Aug 05 17:12:40.269070 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.269051    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:12:40.273097 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:12:40.273072    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-dockercfg-nplzm\" is forbidden: User \"system:node:ip-10-0-130-35.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-130-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nplzm\"" type="*v1.Secret"
Aug 05 17:12:40.273204 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:12:40.273106    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-e2e-mt-12b0b9f5-serving-cert\" is forbidden: User \"system:node:ip-10-0-130-35.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-130-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-12b0b9f5-serving-cert\"" type="*v1.Secret"
Aug 05 17:12:40.273979 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:12:40.273960    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-35.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-130-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Aug 05 17:12:40.285382 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:12:40.285352    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-35.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-130-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Aug 05 17:12:40.285977 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:12:40.285945    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch\" is forbidden: User \"system:node:ip-10-0-130-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-130-35.ec2.internal' and this object" podUID="7b6425c2-cf7f-40f6-91ad-dd10826a1932" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:12:40.293449 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.293425    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcwd2\" (UniqueName: \"kubernetes.io/projected/7b6425c2-cf7f-40f6-91ad-dd10826a1932-kube-api-access-wcwd2\") pod \"maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch\" (UID: \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:12:40.293539 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.293477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b6425c2-cf7f-40f6-91ad-dd10826a1932-openshift-service-ca\") pod \"maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch\" (UID: \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:12:40.293539 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.293536    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b6425c2-cf7f-40f6-91ad-dd10826a1932-maas-api-tls\") pod \"maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch\" (UID: \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:12:40.297398 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.297378    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"]
Aug 05 17:12:40.393999 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.393967    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcwd2\" (UniqueName: \"kubernetes.io/projected/7b6425c2-cf7f-40f6-91ad-dd10826a1932-kube-api-access-wcwd2\") pod \"maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch\" (UID: \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:12:40.394199 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.394030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b6425c2-cf7f-40f6-91ad-dd10826a1932-openshift-service-ca\") pod \"maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch\" (UID: \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:12:40.394199 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.394090    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b6425c2-cf7f-40f6-91ad-dd10826a1932-maas-api-tls\") pod \"maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch\" (UID: \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:12:40.435546 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.435504    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:40.756489 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:40.756450    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:41.078412 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:41.078336    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 17:12:41.124009 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:41.123978    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-12b0b9f5-serving-cert\""
Aug 05 17:12:41.127208 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:41.127184    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b6425c2-cf7f-40f6-91ad-dd10826a1932-maas-api-tls\") pod \"maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch\" (UID: \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:12:41.146121 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:41.146099    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nplzm\""
Aug 05 17:12:41.149437 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:41.149420    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:12:41.154601 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:41.154580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcwd2\" (UniqueName: \"kubernetes.io/projected/7b6425c2-cf7f-40f6-91ad-dd10826a1932-kube-api-access-wcwd2\") pod \"maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch\" (UID: \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:12:41.154601 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:41.154594    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b6425c2-cf7f-40f6-91ad-dd10826a1932-openshift-service-ca\") pod \"maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch\" (UID: \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:12:41.178458 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:41.178430    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:12:41.347594 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:41.347396    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"]
Aug 05 17:12:41.350229 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:12:41.350197    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6425c2_cf7f_40f6_91ad_dd10826a1932.slice/crio-3661e9e4404e690217099bb3b67f2df5d6c1dece1ddf194d153c82b8778a9192 WatchSource:0}: Error finding container 3661e9e4404e690217099bb3b67f2df5d6c1dece1ddf194d153c82b8778a9192: Status 404 returned error can't find the container with id 3661e9e4404e690217099bb3b67f2df5d6c1dece1ddf194d153c82b8778a9192
Aug 05 17:12:41.458005 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:41.457977    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:41.646334 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:41.646268    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:42.192887 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:42.192837    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch" event={"ID":"7b6425c2-cf7f-40f6-91ad-dd10826a1932","Type":"ContainerStarted","Data":"3e14b62324ad3d994b930be0e3d7fbc2c185ecba92ed801b025fae41f825337e"}
Aug 05 17:12:42.193068 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:42.192907    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch" event={"ID":"7b6425c2-cf7f-40f6-91ad-dd10826a1932","Type":"ContainerStarted","Data":"3661e9e4404e690217099bb3b67f2df5d6c1dece1ddf194d153c82b8778a9192"}
Aug 05 17:12:42.193068 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:42.192932    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:12:43.328557 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:43.328504    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch" podStartSLOduration=2.872977529 podStartE2EDuration="3.328484816s" totalImagesPullingTime="455.507287ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:42.235797771 +0000 UTC m=+2016.685344070" watchObservedRunningTime="2026-08-05 17:12:43.328484816 +0000 UTC m=+2017.778031120"
Aug 05 17:12:43.328985 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:43.328787    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:12:48.203122 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:48.203092    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:12:53.738219 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:53.738175    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:54.461421 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:54.461345    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:54.670453 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:54.670381    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:12:54.928185 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:12:54.928148    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:02.101189 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:02.101158    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:02.217293 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:02.217267    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:02.510476 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:02.510442    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx"]
Aug 05 17:13:02.515000 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:02.514980    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx"
Aug 05 17:13:02.517705 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:02.517680    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:13:02.532504 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:02.532483    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx"]
Aug 05 17:13:02.595904 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:02.595877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565527a0-fab6-4ff1-a46f-0a66990be9e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx\" (UID: \"565527a0-fab6-4ff1-a46f-0a66990be9e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx"
Aug 05 17:13:02.696982 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:02.696954    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565527a0-fab6-4ff1-a46f-0a66990be9e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx\" (UID: \"565527a0-fab6-4ff1-a46f-0a66990be9e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx"
Aug 05 17:13:02.697539 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:02.697520    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565527a0-fab6-4ff1-a46f-0a66990be9e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx\" (UID: \"565527a0-fab6-4ff1-a46f-0a66990be9e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx"
Aug 05 17:13:02.825337 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:02.825248    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx"
Aug 05 17:13:03.007314 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:03.007283    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx"]
Aug 05 17:13:03.008264 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:13:03.008237    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod565527a0_fab6_4ff1_a46f_0a66990be9e9.slice/crio-5060f4876b6fe9c53213eaa1827773d1258de1d45f354b8b2dab5f7cf1517778 WatchSource:0}: Error finding container 5060f4876b6fe9c53213eaa1827773d1258de1d45f354b8b2dab5f7cf1517778: Status 404 returned error can't find the container with id 5060f4876b6fe9c53213eaa1827773d1258de1d45f354b8b2dab5f7cf1517778
Aug 05 17:13:03.296185 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:03.296153    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx" event={"ID":"565527a0-fab6-4ff1-a46f-0a66990be9e9","Type":"ContainerStarted","Data":"0dc0bd0b24d82c7f17ddeb7e29ccbf585e5a8e7a434bc404822e993b6757525f"}
Aug 05 17:13:03.296598 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:03.296215    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx" event={"ID":"565527a0-fab6-4ff1-a46f-0a66990be9e9","Type":"ContainerStarted","Data":"5060f4876b6fe9c53213eaa1827773d1258de1d45f354b8b2dab5f7cf1517778"}
Aug 05 17:13:03.326668 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:03.326618    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx" podStartSLOduration=1.32660244 podStartE2EDuration="1.32660244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:13:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:03.324927451 +0000 UTC m=+2037.774473749" watchObservedRunningTime="2026-08-05 17:13:03.32660244 +0000 UTC m=+2037.776148738"
Aug 05 17:13:04.302389 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:04.302354    2575 generic.go:356] "Generic (PLEG): container finished" podID="565527a0-fab6-4ff1-a46f-0a66990be9e9" containerID="0dc0bd0b24d82c7f17ddeb7e29ccbf585e5a8e7a434bc404822e993b6757525f" exitCode=0
Aug 05 17:13:04.302792 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:04.302439    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx" event={"ID":"565527a0-fab6-4ff1-a46f-0a66990be9e9","Type":"ContainerDied","Data":"0dc0bd0b24d82c7f17ddeb7e29ccbf585e5a8e7a434bc404822e993b6757525f"}
Aug 05 17:13:05.430909 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:05.430883    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx"
Aug 05 17:13:05.524320 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:05.524289    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565527a0-fab6-4ff1-a46f-0a66990be9e9-maas-api-service-ca\") pod \"565527a0-fab6-4ff1-a46f-0a66990be9e9\" (UID: \"565527a0-fab6-4ff1-a46f-0a66990be9e9\") "
Aug 05 17:13:05.524633 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:05.524611    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/565527a0-fab6-4ff1-a46f-0a66990be9e9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "565527a0-fab6-4ff1-a46f-0a66990be9e9" (UID: "565527a0-fab6-4ff1-a46f-0a66990be9e9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:13:05.625724 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:05.625658    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565527a0-fab6-4ff1-a46f-0a66990be9e9-maas-api-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:13:06.314507 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:06.314424    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx" event={"ID":"565527a0-fab6-4ff1-a46f-0a66990be9e9","Type":"ContainerDied","Data":"5060f4876b6fe9c53213eaa1827773d1258de1d45f354b8b2dab5f7cf1517778"}
Aug 05 17:13:06.314507 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:06.314477    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5060f4876b6fe9c53213eaa1827773d1258de1d45f354b8b2dab5f7cf1517778"
Aug 05 17:13:06.314507 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:06.314441    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx"
Aug 05 17:13:11.065398 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.065362    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"]
Aug 05 17:13:11.065765 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.065581    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch" podUID="7b6425c2-cf7f-40f6-91ad-dd10826a1932" containerName="maas-api" containerID="cri-o://3e14b62324ad3d994b930be0e3d7fbc2c185ecba92ed801b025fae41f825337e" gracePeriod=30
Aug 05 17:13:11.095038 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.094971    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:11.202054 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.202023    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:11.295937 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.295910    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:11.315200 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.315179    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:13:11.338785 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.338720    2575 generic.go:356] "Generic (PLEG): container finished" podID="7b6425c2-cf7f-40f6-91ad-dd10826a1932" containerID="3e14b62324ad3d994b930be0e3d7fbc2c185ecba92ed801b025fae41f825337e" exitCode=0
Aug 05 17:13:11.338785 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.338757    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"
Aug 05 17:13:11.338960 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.338796    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch" event={"ID":"7b6425c2-cf7f-40f6-91ad-dd10826a1932","Type":"ContainerDied","Data":"3e14b62324ad3d994b930be0e3d7fbc2c185ecba92ed801b025fae41f825337e"}
Aug 05 17:13:11.338960 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.338863    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch" event={"ID":"7b6425c2-cf7f-40f6-91ad-dd10826a1932","Type":"ContainerDied","Data":"3661e9e4404e690217099bb3b67f2df5d6c1dece1ddf194d153c82b8778a9192"}
Aug 05 17:13:11.338960 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.338887    2575 scope.go:117] "RemoveContainer" containerID="3e14b62324ad3d994b930be0e3d7fbc2c185ecba92ed801b025fae41f825337e"
Aug 05 17:13:11.348748 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.348723    2575 scope.go:117] "RemoveContainer" containerID="3e14b62324ad3d994b930be0e3d7fbc2c185ecba92ed801b025fae41f825337e"
Aug 05 17:13:11.349040 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:13:11.349023    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e14b62324ad3d994b930be0e3d7fbc2c185ecba92ed801b025fae41f825337e\": container with ID starting with 3e14b62324ad3d994b930be0e3d7fbc2c185ecba92ed801b025fae41f825337e not found: ID does not exist" containerID="3e14b62324ad3d994b930be0e3d7fbc2c185ecba92ed801b025fae41f825337e"
Aug 05 17:13:11.349097 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.349048    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e14b62324ad3d994b930be0e3d7fbc2c185ecba92ed801b025fae41f825337e"} err="failed to get container status \"3e14b62324ad3d994b930be0e3d7fbc2c185ecba92ed801b025fae41f825337e\": rpc error: code = NotFound desc = could not find container \"3e14b62324ad3d994b930be0e3d7fbc2c185ecba92ed801b025fae41f825337e\": container with ID starting with 3e14b62324ad3d994b930be0e3d7fbc2c185ecba92ed801b025fae41f825337e not found: ID does not exist"
Aug 05 17:13:11.353731 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.353709    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx"]
Aug 05 17:13:11.359749 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.359729    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12b0b9f5-j5lzx"]
Aug 05 17:13:11.410116 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.410091    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:11.478892 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.478864    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b6425c2-cf7f-40f6-91ad-dd10826a1932-openshift-service-ca\") pod \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\" (UID: \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\") "
Aug 05 17:13:11.479016 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.478913    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b6425c2-cf7f-40f6-91ad-dd10826a1932-maas-api-tls\") pod \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\" (UID: \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\") "
Aug 05 17:13:11.479016 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.478952    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcwd2\" (UniqueName: \"kubernetes.io/projected/7b6425c2-cf7f-40f6-91ad-dd10826a1932-kube-api-access-wcwd2\") pod \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\" (UID: \"7b6425c2-cf7f-40f6-91ad-dd10826a1932\") "
Aug 05 17:13:11.479290 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.479264    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b6425c2-cf7f-40f6-91ad-dd10826a1932-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7b6425c2-cf7f-40f6-91ad-dd10826a1932" (UID: "7b6425c2-cf7f-40f6-91ad-dd10826a1932"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:13:11.481047 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.481022    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b6425c2-cf7f-40f6-91ad-dd10826a1932-kube-api-access-wcwd2" (OuterVolumeSpecName: "kube-api-access-wcwd2") pod "7b6425c2-cf7f-40f6-91ad-dd10826a1932" (UID: "7b6425c2-cf7f-40f6-91ad-dd10826a1932"). InnerVolumeSpecName "kube-api-access-wcwd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:13:11.481118 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.481088    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b6425c2-cf7f-40f6-91ad-dd10826a1932-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7b6425c2-cf7f-40f6-91ad-dd10826a1932" (UID: "7b6425c2-cf7f-40f6-91ad-dd10826a1932"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:13:11.580399 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.580372    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b6425c2-cf7f-40f6-91ad-dd10826a1932-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:13:11.580399 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.580397    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcwd2\" (UniqueName: \"kubernetes.io/projected/7b6425c2-cf7f-40f6-91ad-dd10826a1932-kube-api-access-wcwd2\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:13:11.580532 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.580407    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b6425c2-cf7f-40f6-91ad-dd10826a1932-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:13:11.661521 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.661493    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"]
Aug 05 17:13:11.671800 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.671776    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12b0b9f5-7dff598757-gwvch"]
Aug 05 17:13:11.741965 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:11.741939    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:12.013484 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:12.013456    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="565527a0-fab6-4ff1-a46f-0a66990be9e9" path="/var/lib/kubelet/pods/565527a0-fab6-4ff1-a46f-0a66990be9e9/volumes"
Aug 05 17:13:12.013846 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:12.013801    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b6425c2-cf7f-40f6-91ad-dd10826a1932" path="/var/lib/kubelet/pods/7b6425c2-cf7f-40f6-91ad-dd10826a1932/volumes"
Aug 05 17:13:13.208019 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:13.207985    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:13:18.470223 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:18.470190    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:18.612396 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:18.612362    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:18.808263 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:18.808184    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:19.009751 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:19.009723    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:19.183058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:19.183023    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:19.408028 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:19.407992    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:19.603233 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:19.603149    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:23.552760 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:23.552723    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:23.683151 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:23.683106    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:26.659943 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:26.659908    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:26.821087 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:26.821059    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:26.983770 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:26.983690    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:27.138880 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:27.138843    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:34.032900 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:34.032867    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:34.275706 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:34.275671    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:53.428600 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:13:53.428564    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:14:06.097192 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:14:06.097165    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:14:06.100382 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:14:06.100364    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:15:06.153980 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:06.153952    2575 scope.go:117] "RemoveContainer" containerID="e314661ddfb021a48235179e882cbf0adee1acaf8922a37e0d21887305e9c87a"
Aug 05 17:15:37.509704 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:37.509664    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:37.859828 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:37.859732    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:38.108204 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:38.108164    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:41.098281 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:41.098243    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:41.152148 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:41.152120    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:15:41.332259 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:41.332229    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:42.316757 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.316722    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"]
Aug 05 17:15:42.317153 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.317053    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b6425c2-cf7f-40f6-91ad-dd10826a1932" containerName="maas-api"
Aug 05 17:15:42.317153 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.317063    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b6425c2-cf7f-40f6-91ad-dd10826a1932" containerName="maas-api"
Aug 05 17:15:42.317153 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.317077    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="565527a0-fab6-4ff1-a46f-0a66990be9e9" containerName="revoke-keys"
Aug 05 17:15:42.317153 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.317083    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="565527a0-fab6-4ff1-a46f-0a66990be9e9" containerName="revoke-keys"
Aug 05 17:15:42.317153 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.317146    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="565527a0-fab6-4ff1-a46f-0a66990be9e9" containerName="revoke-keys"
Aug 05 17:15:42.317153 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.317156    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b6425c2-cf7f-40f6-91ad-dd10826a1932" containerName="maas-api"
Aug 05 17:15:42.320134 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.320116    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:15:42.326821 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.326769    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-dcd532bc-serving-cert\""
Aug 05 17:15:42.326821 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.326782    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:15:42.327027 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.326863    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nplzm\""
Aug 05 17:15:42.327079 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.327066    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 17:15:42.333142 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.333120    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:42.338069 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.338049    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"]
Aug 05 17:15:42.405737 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.405706    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq8xq\" (UniqueName: \"kubernetes.io/projected/75decb25-79c6-4ddb-a241-201cc09604cf-kube-api-access-bq8xq\") pod \"maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2\" (UID: \"75decb25-79c6-4ddb-a241-201cc09604cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:15:42.405977 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.405796    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75decb25-79c6-4ddb-a241-201cc09604cf-openshift-service-ca\") pod \"maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2\" (UID: \"75decb25-79c6-4ddb-a241-201cc09604cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:15:42.405977 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.405842    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75decb25-79c6-4ddb-a241-201cc09604cf-maas-api-tls\") pod \"maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2\" (UID: \"75decb25-79c6-4ddb-a241-201cc09604cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:15:42.506951 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.506921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq8xq\" (UniqueName: \"kubernetes.io/projected/75decb25-79c6-4ddb-a241-201cc09604cf-kube-api-access-bq8xq\") pod \"maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2\" (UID: \"75decb25-79c6-4ddb-a241-201cc09604cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:15:42.507102 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.507011    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75decb25-79c6-4ddb-a241-201cc09604cf-openshift-service-ca\") pod \"maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2\" (UID: \"75decb25-79c6-4ddb-a241-201cc09604cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:15:42.507102 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.507032    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75decb25-79c6-4ddb-a241-201cc09604cf-maas-api-tls\") pod \"maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2\" (UID: \"75decb25-79c6-4ddb-a241-201cc09604cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:15:42.507192 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:15:42.507127    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-serving-cert: secret "maas-api-e2e-mt-dcd532bc-serving-cert" not found
Aug 05 17:15:42.507230 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:15:42.507193    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75decb25-79c6-4ddb-a241-201cc09604cf-maas-api-tls podName:75decb25-79c6-4ddb-a241-201cc09604cf nodeName:}" failed. No retries permitted until 2026-08-05 17:15:43.007174037 +0000 UTC m=+2197.456720315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/75decb25-79c6-4ddb-a241-201cc09604cf-maas-api-tls") pod "maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2" (UID: "75decb25-79c6-4ddb-a241-201cc09604cf") : secret "maas-api-e2e-mt-dcd532bc-serving-cert" not found
Aug 05 17:15:42.507595 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.507576    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75decb25-79c6-4ddb-a241-201cc09604cf-openshift-service-ca\") pod \"maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2\" (UID: \"75decb25-79c6-4ddb-a241-201cc09604cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:15:42.519380 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.519360    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq8xq\" (UniqueName: \"kubernetes.io/projected/75decb25-79c6-4ddb-a241-201cc09604cf-kube-api-access-bq8xq\") pod \"maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2\" (UID: \"75decb25-79c6-4ddb-a241-201cc09604cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:15:42.750318 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:42.750282    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:43.011563 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:43.011463    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75decb25-79c6-4ddb-a241-201cc09604cf-maas-api-tls\") pod \"maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2\" (UID: \"75decb25-79c6-4ddb-a241-201cc09604cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:15:43.014658 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:43.014600    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75decb25-79c6-4ddb-a241-201cc09604cf-maas-api-tls\") pod \"maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2\" (UID: \"75decb25-79c6-4ddb-a241-201cc09604cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:15:43.230031 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:43.229993    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:15:43.389926 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:43.389696    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"]
Aug 05 17:15:43.393624 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:15:43.393574    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75decb25_79c6_4ddb_a241_201cc09604cf.slice/crio-4ea51c7721c703587fd0287e68d9ac033ba1f3aca87dec4c2199df86a9fef1da WatchSource:0}: Error finding container 4ea51c7721c703587fd0287e68d9ac033ba1f3aca87dec4c2199df86a9fef1da: Status 404 returned error can't find the container with id 4ea51c7721c703587fd0287e68d9ac033ba1f3aca87dec4c2199df86a9fef1da
Aug 05 17:15:43.394838 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:43.394790    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:43.395584 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:43.395564    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:15:43.603656 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:43.603574    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:44.040007 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:44.039973    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2" event={"ID":"75decb25-79c6-4ddb-a241-201cc09604cf","Type":"ContainerStarted","Data":"7f2e2d9eb29e30e0b9a86222a48261023ec95a580dd0e46fb982cb1bddaaa1d1"}
Aug 05 17:15:44.040178 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:44.040020    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2" event={"ID":"75decb25-79c6-4ddb-a241-201cc09604cf","Type":"ContainerStarted","Data":"4ea51c7721c703587fd0287e68d9ac033ba1f3aca87dec4c2199df86a9fef1da"}
Aug 05 17:15:44.040178 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:44.040148    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:15:44.086078 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:44.086027    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2" podStartSLOduration=1.587396203 podStartE2EDuration="2.086009682s" totalImagesPullingTime="498.613479ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:44.085846739 +0000 UTC m=+2198.535393037" watchObservedRunningTime="2026-08-05 17:15:44.086009682 +0000 UTC m=+2198.535555958"
Aug 05 17:15:50.049502 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:50.049472    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:15:51.711468 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:15:51.711432    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:16:06.176567 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:06.176531    2575 scope.go:117] "RemoveContainer" containerID="4cdf5830119ffd31f9f2f14bd7a54f04bdf53142bfef00ff7f97818028805aaf"
Aug 05 17:16:06.184372 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:06.184349    2575 scope.go:117] "RemoveContainer" containerID="a190ef35b544e27e6c39d3da921b74337aed7ed2eb5325615059c9ba2dc7a83e"
Aug 05 17:16:11.089711 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:11.089654    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:16:14.620391 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:14.620346    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:16:16.898470 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:16.898436    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:16:36.807062 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:36.807026    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:16:41.502119 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:41.502078    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:16:45.649331 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:45.649301    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644"]
Aug 05 17:16:45.652669 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:45.652654    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644"
Aug 05 17:16:45.655496 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:45.655471    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:16:45.661737 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:45.661715    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644"]
Aug 05 17:16:45.761795 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:45.761767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc93003-c80d-4045-b66f-6813777fb9dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dcd532bc-j5644\" (UID: \"ddc93003-c80d-4045-b66f-6813777fb9dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644"
Aug 05 17:16:45.862883 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:45.862836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc93003-c80d-4045-b66f-6813777fb9dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dcd532bc-j5644\" (UID: \"ddc93003-c80d-4045-b66f-6813777fb9dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644"
Aug 05 17:16:45.863492 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:45.863459    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc93003-c80d-4045-b66f-6813777fb9dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dcd532bc-j5644\" (UID: \"ddc93003-c80d-4045-b66f-6813777fb9dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644"
Aug 05 17:16:45.963627 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:45.963592    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644"
Aug 05 17:16:46.098327 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:46.098306    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644"]
Aug 05 17:16:46.100674 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:16:46.100647    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc93003_c80d_4045_b66f_6813777fb9dd.slice/crio-72b626ff7d3f4137ef556986dc1d8ab512ead5226dafcc2e940a27008730af38 WatchSource:0}: Error finding container 72b626ff7d3f4137ef556986dc1d8ab512ead5226dafcc2e940a27008730af38: Status 404 returned error can't find the container with id 72b626ff7d3f4137ef556986dc1d8ab512ead5226dafcc2e940a27008730af38
Aug 05 17:16:46.341967 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:46.341932    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644" event={"ID":"ddc93003-c80d-4045-b66f-6813777fb9dd","Type":"ContainerStarted","Data":"72b626ff7d3f4137ef556986dc1d8ab512ead5226dafcc2e940a27008730af38"}
Aug 05 17:16:47.348412 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:47.348373    2575 generic.go:356] "Generic (PLEG): container finished" podID="ddc93003-c80d-4045-b66f-6813777fb9dd" containerID="d21615d3cb9abaffc93543e7418a925ba5cb69b96f91a227cfd8730c1de47586" exitCode=0
Aug 05 17:16:47.348884 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:47.348463    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644" event={"ID":"ddc93003-c80d-4045-b66f-6813777fb9dd","Type":"ContainerDied","Data":"d21615d3cb9abaffc93543e7418a925ba5cb69b96f91a227cfd8730c1de47586"}
Aug 05 17:16:48.485645 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:48.485621    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644"
Aug 05 17:16:48.586636 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:48.586608    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc93003-c80d-4045-b66f-6813777fb9dd-maas-api-service-ca\") pod \"ddc93003-c80d-4045-b66f-6813777fb9dd\" (UID: \"ddc93003-c80d-4045-b66f-6813777fb9dd\") "
Aug 05 17:16:48.587037 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:48.587017    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc93003-c80d-4045-b66f-6813777fb9dd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ddc93003-c80d-4045-b66f-6813777fb9dd" (UID: "ddc93003-c80d-4045-b66f-6813777fb9dd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:16:48.687569 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:48.687550    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc93003-c80d-4045-b66f-6813777fb9dd-maas-api-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:16:49.359983 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:49.359953    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644"
Aug 05 17:16:49.360156 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:49.359948    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644" event={"ID":"ddc93003-c80d-4045-b66f-6813777fb9dd","Type":"ContainerDied","Data":"72b626ff7d3f4137ef556986dc1d8ab512ead5226dafcc2e940a27008730af38"}
Aug 05 17:16:49.360156 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:49.360090    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72b626ff7d3f4137ef556986dc1d8ab512ead5226dafcc2e940a27008730af38"
Aug 05 17:16:58.713296 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:16:58.713262    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:17:01.152517 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.152477    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"]
Aug 05 17:17:01.152936 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.152684    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2" podUID="75decb25-79c6-4ddb-a241-201cc09604cf" containerName="maas-api" containerID="cri-o://7f2e2d9eb29e30e0b9a86222a48261023ec95a580dd0e46fb982cb1bddaaa1d1" gracePeriod=30
Aug 05 17:17:01.234298 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.234261    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:01.407539 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.407517    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:17:01.414957 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.414934    2575 generic.go:356] "Generic (PLEG): container finished" podID="75decb25-79c6-4ddb-a241-201cc09604cf" containerID="7f2e2d9eb29e30e0b9a86222a48261023ec95a580dd0e46fb982cb1bddaaa1d1" exitCode=0
Aug 05 17:17:01.415073 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.414971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2" event={"ID":"75decb25-79c6-4ddb-a241-201cc09604cf","Type":"ContainerDied","Data":"7f2e2d9eb29e30e0b9a86222a48261023ec95a580dd0e46fb982cb1bddaaa1d1"}
Aug 05 17:17:01.415073 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.415033    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2" event={"ID":"75decb25-79c6-4ddb-a241-201cc09604cf","Type":"ContainerDied","Data":"4ea51c7721c703587fd0287e68d9ac033ba1f3aca87dec4c2199df86a9fef1da"}
Aug 05 17:17:01.415073 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.414978    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"
Aug 05 17:17:01.415073 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.415062    2575 scope.go:117] "RemoveContainer" containerID="7f2e2d9eb29e30e0b9a86222a48261023ec95a580dd0e46fb982cb1bddaaa1d1"
Aug 05 17:17:01.422957 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.422941    2575 scope.go:117] "RemoveContainer" containerID="7f2e2d9eb29e30e0b9a86222a48261023ec95a580dd0e46fb982cb1bddaaa1d1"
Aug 05 17:17:01.423208 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:17:01.423188    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f2e2d9eb29e30e0b9a86222a48261023ec95a580dd0e46fb982cb1bddaaa1d1\": container with ID starting with 7f2e2d9eb29e30e0b9a86222a48261023ec95a580dd0e46fb982cb1bddaaa1d1 not found: ID does not exist" containerID="7f2e2d9eb29e30e0b9a86222a48261023ec95a580dd0e46fb982cb1bddaaa1d1"
Aug 05 17:17:01.423267 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.423216    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f2e2d9eb29e30e0b9a86222a48261023ec95a580dd0e46fb982cb1bddaaa1d1"} err="failed to get container status \"7f2e2d9eb29e30e0b9a86222a48261023ec95a580dd0e46fb982cb1bddaaa1d1\": rpc error: code = NotFound desc = could not find container \"7f2e2d9eb29e30e0b9a86222a48261023ec95a580dd0e46fb982cb1bddaaa1d1\": container with ID starting with 7f2e2d9eb29e30e0b9a86222a48261023ec95a580dd0e46fb982cb1bddaaa1d1 not found: ID does not exist"
Aug 05 17:17:01.469747 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.469722    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:01.503439 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.503415    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75decb25-79c6-4ddb-a241-201cc09604cf-openshift-service-ca\") pod \"75decb25-79c6-4ddb-a241-201cc09604cf\" (UID: \"75decb25-79c6-4ddb-a241-201cc09604cf\") "
Aug 05 17:17:01.503560 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.503504    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75decb25-79c6-4ddb-a241-201cc09604cf-maas-api-tls\") pod \"75decb25-79c6-4ddb-a241-201cc09604cf\" (UID: \"75decb25-79c6-4ddb-a241-201cc09604cf\") "
Aug 05 17:17:01.503621 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.503577    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq8xq\" (UniqueName: \"kubernetes.io/projected/75decb25-79c6-4ddb-a241-201cc09604cf-kube-api-access-bq8xq\") pod \"75decb25-79c6-4ddb-a241-201cc09604cf\" (UID: \"75decb25-79c6-4ddb-a241-201cc09604cf\") "
Aug 05 17:17:01.503862 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.503840    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75decb25-79c6-4ddb-a241-201cc09604cf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "75decb25-79c6-4ddb-a241-201cc09604cf" (UID: "75decb25-79c6-4ddb-a241-201cc09604cf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:17:01.505545 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.505523    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75decb25-79c6-4ddb-a241-201cc09604cf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "75decb25-79c6-4ddb-a241-201cc09604cf" (UID: "75decb25-79c6-4ddb-a241-201cc09604cf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:17:01.505664 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.505620    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75decb25-79c6-4ddb-a241-201cc09604cf-kube-api-access-bq8xq" (OuterVolumeSpecName: "kube-api-access-bq8xq") pod "75decb25-79c6-4ddb-a241-201cc09604cf" (UID: "75decb25-79c6-4ddb-a241-201cc09604cf"). InnerVolumeSpecName "kube-api-access-bq8xq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:17:01.604278 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.604246    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75decb25-79c6-4ddb-a241-201cc09604cf-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:17:01.604278 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.604275    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq8xq\" (UniqueName: \"kubernetes.io/projected/75decb25-79c6-4ddb-a241-201cc09604cf-kube-api-access-bq8xq\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:17:01.604457 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.604288    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75decb25-79c6-4ddb-a241-201cc09604cf-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:17:01.658431 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.658344    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:01.725782 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.725752    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644"]
Aug 05 17:17:01.727339 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.727315    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dcd532bc-j5644"]
Aug 05 17:17:01.743551 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.743529    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"]
Aug 05 17:17:01.746459 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.746439    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dcd532bc-679cfd4968-bgkm2"]
Aug 05 17:17:01.764735 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:01.764709    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:02.014497 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:02.014416    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75decb25-79c6-4ddb-a241-201cc09604cf" path="/var/lib/kubelet/pods/75decb25-79c6-4ddb-a241-201cc09604cf/volumes"
Aug 05 17:17:02.014750 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:02.014737    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddc93003-c80d-4045-b66f-6813777fb9dd" path="/var/lib/kubelet/pods/ddc93003-c80d-4045-b66f-6813777fb9dd/volumes"
Aug 05 17:17:04.610789 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:04.610754    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:17:05.125798 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:05.125763    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:06.205088 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:06.205061    2575 scope.go:117] "RemoveContainer" containerID="a1da08a52fee0560c6e383666867ec69841a46834770d18ce9fa8533d81db448"
Aug 05 17:17:10.206261 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:10.206222    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:19.748122 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:19.748085    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:47.983597 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:47.983559    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:49.564210 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:49.564172    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:56.322013 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:56.321974    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:56.527996 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:56.527951    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:56.713660 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:56.713625    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:56.843854 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:56.843791    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:58.705016 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:17:58.704937    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:18:08.217859 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:08.217818    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:08.356138 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:08.356103    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:08.530290 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:08.530199    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:09.106630 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:09.106591    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:09.210157 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:09.210124    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:10.023822 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:10.023783    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:18:10.617478 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:10.617449    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:17.017176 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:17.017137    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:18:19.501139 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:19.501100    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:19.611420 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:19.611384    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:20.202783 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:20.202747    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:24.813598 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:24.813561    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:18:28.654855 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:28.654798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:28.775069 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:28.775037    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:28.890138 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:28.890102    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:39.386952 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:39.386917    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:39.634237 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:39.634195    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:42.374085 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:18:42.374039    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:00.684775 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:00.684732    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:06.125402 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:06.125371    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:19:06.129523 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:06.129505    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:19:06.234760 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:06.234733    2575 scope.go:117] "RemoveContainer" containerID="0dc0bd0b24d82c7f17ddeb7e29ccbf585e5a8e7a434bc404822e993b6757525f"
Aug 05 17:19:06.921864 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:06.921824    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:06.993045 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:06.993014    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:07.277139 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:07.277056    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:07.596515 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:07.596434    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:08.010190 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:08.010151    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:11.005653 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:11.005616    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:11.114482 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:11.114453    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:12.211420 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.211392    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"]
Aug 05 17:19:12.211791 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.211743    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc93003-c80d-4045-b66f-6813777fb9dd" containerName="revoke-keys"
Aug 05 17:19:12.211791 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.211757    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc93003-c80d-4045-b66f-6813777fb9dd" containerName="revoke-keys"
Aug 05 17:19:12.211791 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.211776    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75decb25-79c6-4ddb-a241-201cc09604cf" containerName="maas-api"
Aug 05 17:19:12.211791 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.211782    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="75decb25-79c6-4ddb-a241-201cc09604cf" containerName="maas-api"
Aug 05 17:19:12.211943 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.211873    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc93003-c80d-4045-b66f-6813777fb9dd" containerName="revoke-keys"
Aug 05 17:19:12.211943 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.211885    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="75decb25-79c6-4ddb-a241-201cc09604cf" containerName="maas-api"
Aug 05 17:19:12.215045 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.215022    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:19:12.217753 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.217555    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 17:19:12.217753 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.217717    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nplzm\""
Aug 05 17:19:12.217975 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.217766    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-c15c3d-serving-cert\""
Aug 05 17:19:12.218358 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.218340    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:19:12.229421 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.229394    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"]
Aug 05 17:19:12.269443 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.269408    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:12.360630 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.360596    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:12.362579 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.362555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb86n\" (UniqueName: \"kubernetes.io/projected/38adc30a-9faa-41b5-8e3f-3507ff8e704d-kube-api-access-rb86n\") pod \"maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5\" (UID: \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:19:12.362705 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.362615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38adc30a-9faa-41b5-8e3f-3507ff8e704d-maas-api-tls\") pod \"maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5\" (UID: \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:19:12.362763 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.362747    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38adc30a-9faa-41b5-8e3f-3507ff8e704d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5\" (UID: \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:19:12.463749 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.463641    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb86n\" (UniqueName: \"kubernetes.io/projected/38adc30a-9faa-41b5-8e3f-3507ff8e704d-kube-api-access-rb86n\") pod \"maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5\" (UID: \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:19:12.463749 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.463708    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38adc30a-9faa-41b5-8e3f-3507ff8e704d-maas-api-tls\") pod \"maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5\" (UID: \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:19:12.464035 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.463845    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38adc30a-9faa-41b5-8e3f-3507ff8e704d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5\" (UID: \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:19:12.464580 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.464561    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38adc30a-9faa-41b5-8e3f-3507ff8e704d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5\" (UID: \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:19:12.466580 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.466560    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38adc30a-9faa-41b5-8e3f-3507ff8e704d-maas-api-tls\") pod \"maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5\" (UID: \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:19:12.471958 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.471931    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb86n\" (UniqueName: \"kubernetes.io/projected/38adc30a-9faa-41b5-8e3f-3507ff8e704d-kube-api-access-rb86n\") pod \"maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5\" (UID: \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:19:12.525975 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.525949    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:19:12.659065 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.659040    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"]
Aug 05 17:19:12.660883 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:19:12.660848    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38adc30a_9faa_41b5_8e3f_3507ff8e704d.slice/crio-6b18d72258790607e0e53c9a903b514a56eafbdeeefcc20c1ce7d19cdccb6fc3 WatchSource:0}: Error finding container 6b18d72258790607e0e53c9a903b514a56eafbdeeefcc20c1ce7d19cdccb6fc3: Status 404 returned error can't find the container with id 6b18d72258790607e0e53c9a903b514a56eafbdeeefcc20c1ce7d19cdccb6fc3
Aug 05 17:19:12.923113 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:12.923074    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:13.017334 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:13.017301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5" event={"ID":"38adc30a-9faa-41b5-8e3f-3507ff8e704d","Type":"ContainerStarted","Data":"6b18d72258790607e0e53c9a903b514a56eafbdeeefcc20c1ce7d19cdccb6fc3"}
Aug 05 17:19:13.026587 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:13.026553    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:14.022590 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:14.022553    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5" event={"ID":"38adc30a-9faa-41b5-8e3f-3507ff8e704d","Type":"ContainerStarted","Data":"47f353ce0263bfeb8b8892bbbd95222340917a454bff96023242988315b3756c"}
Aug 05 17:19:14.022989 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:14.022666    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:19:14.048316 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:14.048274    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5" podStartSLOduration=1.425220762 podStartE2EDuration="2.048260519s" totalImagesPullingTime="623.039757ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:19:14.04761861 +0000 UTC m=+2408.497164909" watchObservedRunningTime="2026-08-05 17:19:14.048260519 +0000 UTC m=+2408.497806818"
Aug 05 17:19:15.104986 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:15.104956    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:19:20.033081 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:20.033052    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:19:36.011046 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:36.011007    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:36.345215 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:36.345124    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:36.713343 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:36.713313    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:37.401299 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:37.401258    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:40.139036 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:40.139002    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:40.237720 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:40.237693    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:41.270959 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.270928    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"]
Aug 05 17:19:41.275553 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.275528    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:19:41.278166 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.278145    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-161ce7-serving-cert\""
Aug 05 17:19:41.294700 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.294673    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"]
Aug 05 17:19:41.315396 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.315364    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2tkm\" (UniqueName: \"kubernetes.io/projected/019f25e6-9255-4c43-a639-423e83762689-kube-api-access-d2tkm\") pod \"maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2\" (UID: \"019f25e6-9255-4c43-a639-423e83762689\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:19:41.315532 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.315513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/019f25e6-9255-4c43-a639-423e83762689-maas-api-tls\") pod \"maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2\" (UID: \"019f25e6-9255-4c43-a639-423e83762689\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:19:41.315591 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.315547    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/019f25e6-9255-4c43-a639-423e83762689-openshift-service-ca\") pod \"maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2\" (UID: \"019f25e6-9255-4c43-a639-423e83762689\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:19:41.354591 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.354554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:41.416080 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.416044    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/019f25e6-9255-4c43-a639-423e83762689-maas-api-tls\") pod \"maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2\" (UID: \"019f25e6-9255-4c43-a639-423e83762689\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:19:41.416288 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.416097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/019f25e6-9255-4c43-a639-423e83762689-openshift-service-ca\") pod \"maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2\" (UID: \"019f25e6-9255-4c43-a639-423e83762689\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:19:41.416288 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.416153    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2tkm\" (UniqueName: \"kubernetes.io/projected/019f25e6-9255-4c43-a639-423e83762689-kube-api-access-d2tkm\") pod \"maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2\" (UID: \"019f25e6-9255-4c43-a639-423e83762689\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:19:41.416288 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:19:41.416218    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-serving-cert: secret "maas-api-e2e-inf-b-161ce7-serving-cert" not found
Aug 05 17:19:41.416484 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:19:41.416295    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/019f25e6-9255-4c43-a639-423e83762689-maas-api-tls podName:019f25e6-9255-4c43-a639-423e83762689 nodeName:}" failed. No retries permitted until 2026-08-05 17:19:41.916271149 +0000 UTC m=+2436.365817428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/019f25e6-9255-4c43-a639-423e83762689-maas-api-tls") pod "maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2" (UID: "019f25e6-9255-4c43-a639-423e83762689") : secret "maas-api-e2e-inf-b-161ce7-serving-cert" not found
Aug 05 17:19:41.416827 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.416788    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/019f25e6-9255-4c43-a639-423e83762689-openshift-service-ca\") pod \"maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2\" (UID: \"019f25e6-9255-4c43-a639-423e83762689\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:19:41.428220 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.428195    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2tkm\" (UniqueName: \"kubernetes.io/projected/019f25e6-9255-4c43-a639-423e83762689-kube-api-access-d2tkm\") pod \"maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2\" (UID: \"019f25e6-9255-4c43-a639-423e83762689\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:19:41.660917 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.660881    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:41.922466 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.922382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/019f25e6-9255-4c43-a639-423e83762689-maas-api-tls\") pod \"maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2\" (UID: \"019f25e6-9255-4c43-a639-423e83762689\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:19:41.924841 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:41.924795    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/019f25e6-9255-4c43-a639-423e83762689-maas-api-tls\") pod \"maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2\" (UID: \"019f25e6-9255-4c43-a639-423e83762689\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:19:42.082661 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.082628    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:42.174130 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.174053    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:42.185841 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.185797    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:19:42.341643 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.341615    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"]
Aug 05 17:19:42.344875 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:19:42.344844    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod019f25e6_9255_4c43_a639_423e83762689.slice/crio-2873e9148a8a9e7a768749e66a057439cb5eedbf40814b23f4b62b2161421271 WatchSource:0}: Error finding container 2873e9148a8a9e7a768749e66a057439cb5eedbf40814b23f4b62b2161421271: Status 404 returned error can't find the container with id 2873e9148a8a9e7a768749e66a057439cb5eedbf40814b23f4b62b2161421271
Aug 05 17:19:42.349181 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.349156    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"]
Aug 05 17:19:42.354313 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.354295    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"
Aug 05 17:19:42.357183 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.357168    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-161ce7-dockercfg-d9wrm\""
Aug 05 17:19:42.361021 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.361002    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-161ce7\""
Aug 05 17:19:42.374482 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.374458    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"]
Aug 05 17:19:42.428000 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.427930    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12392d24-9d2d-4afd-9b46-99cb7d38a839-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t\" (UID: \"12392d24-9d2d-4afd-9b46-99cb7d38a839\") " pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"
Aug 05 17:19:42.428000 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.427969    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpz7l\" (UniqueName: \"kubernetes.io/projected/12392d24-9d2d-4afd-9b46-99cb7d38a839-kube-api-access-jpz7l\") pod \"payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t\" (UID: \"12392d24-9d2d-4afd-9b46-99cb7d38a839\") " pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"
Aug 05 17:19:42.529211 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.529179    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpz7l\" (UniqueName: \"kubernetes.io/projected/12392d24-9d2d-4afd-9b46-99cb7d38a839-kube-api-access-jpz7l\") pod \"payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t\" (UID: \"12392d24-9d2d-4afd-9b46-99cb7d38a839\") " pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"
Aug 05 17:19:42.529362 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.529280    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12392d24-9d2d-4afd-9b46-99cb7d38a839-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t\" (UID: \"12392d24-9d2d-4afd-9b46-99cb7d38a839\") " pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"
Aug 05 17:19:42.529903 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.529885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12392d24-9d2d-4afd-9b46-99cb7d38a839-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t\" (UID: \"12392d24-9d2d-4afd-9b46-99cb7d38a839\") " pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"
Aug 05 17:19:42.547017 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.546984    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpz7l\" (UniqueName: \"kubernetes.io/projected/12392d24-9d2d-4afd-9b46-99cb7d38a839-kube-api-access-jpz7l\") pod \"payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t\" (UID: \"12392d24-9d2d-4afd-9b46-99cb7d38a839\") " pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"
Aug 05 17:19:42.665037 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.665000    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"
Aug 05 17:19:42.794570 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:42.794546    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"]
Aug 05 17:19:42.796792 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:19:42.796765    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12392d24_9d2d_4afd_9b46_99cb7d38a839.slice/crio-98340fd595f3e07a4170f96b52afb911c1f8e8846a68d74df1fa320dedc688d6 WatchSource:0}: Error finding container 98340fd595f3e07a4170f96b52afb911c1f8e8846a68d74df1fa320dedc688d6: Status 404 returned error can't find the container with id 98340fd595f3e07a4170f96b52afb911c1f8e8846a68d74df1fa320dedc688d6
Aug 05 17:19:43.152235 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:43.152195    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t" event={"ID":"12392d24-9d2d-4afd-9b46-99cb7d38a839","Type":"ContainerStarted","Data":"98340fd595f3e07a4170f96b52afb911c1f8e8846a68d74df1fa320dedc688d6"}
Aug 05 17:19:43.153570 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:43.153545    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2" event={"ID":"019f25e6-9255-4c43-a639-423e83762689","Type":"ContainerStarted","Data":"589067d6a2e16e281f4dcbdb5f8d5006b6e0809783a0d93cca901730de951064"}
Aug 05 17:19:43.153680 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:43.153588    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2" event={"ID":"019f25e6-9255-4c43-a639-423e83762689","Type":"ContainerStarted","Data":"2873e9148a8a9e7a768749e66a057439cb5eedbf40814b23f4b62b2161421271"}
Aug 05 17:19:43.153725 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:43.153677    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:19:43.174494 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:43.174449    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2" podStartSLOduration=1.57674279 podStartE2EDuration="2.174434709s" totalImagesPullingTime="597.691919ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:19:43.172662423 +0000 UTC m=+2437.622208725" watchObservedRunningTime="2026-08-05 17:19:43.174434709 +0000 UTC m=+2437.623981007"
Aug 05 17:19:44.390185 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:44.390147    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:19:46.171044 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:46.171009    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t" event={"ID":"12392d24-9d2d-4afd-9b46-99cb7d38a839","Type":"ContainerStarted","Data":"03bec71df76981af03e847e21d7b17fc965703af64a236f9a95e0dce6d9fd962"}
Aug 05 17:19:46.171421 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:46.171076    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"
Aug 05 17:19:46.188153 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:46.188108    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t" podStartSLOduration=1.180346967 podStartE2EDuration="4.188094536s" totalImagesPullingTime="3.007747569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:19:46.188040824 +0000 UTC m=+2440.637587125" watchObservedRunningTime="2026-08-05 17:19:46.188094536 +0000 UTC m=+2440.637640835"
Aug 05 17:19:49.165662 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:49.165633    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:19:57.177864 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:19:57.177832    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"
Aug 05 17:20:05.092976 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:20:05.092926    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:14.627463 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:20:14.627433    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:17.901216 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:20:17.901176    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:20:32.341247 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:20:32.341212    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:35.299833 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:20:35.296757    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:20:46.095623 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:20:46.095542    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:21:19.747020 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:19.746937    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:20.655168 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:20.655122    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:20.779941 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:20.779906    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx"]
Aug 05 17:21:20.783597 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:20.783573    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx"
Aug 05 17:21:20.787382 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:20.787361    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:21:20.794227 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:20.794203    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx"]
Aug 05 17:21:20.807800 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:20.807765    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e55398a-4e94-44ff-b939-a7872a34a275-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx\" (UID: \"5e55398a-4e94-44ff-b939-a7872a34a275\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx"
Aug 05 17:21:20.908572 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:20.908488    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e55398a-4e94-44ff-b939-a7872a34a275-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx\" (UID: \"5e55398a-4e94-44ff-b939-a7872a34a275\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx"
Aug 05 17:21:20.909140 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:20.909121    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e55398a-4e94-44ff-b939-a7872a34a275-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx\" (UID: \"5e55398a-4e94-44ff-b939-a7872a34a275\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx"
Aug 05 17:21:21.093652 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:21.093617    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx"
Aug 05 17:21:21.225653 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:21.225619    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx"]
Aug 05 17:21:21.228098 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:21:21.228065    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e55398a_4e94_44ff_b939_a7872a34a275.slice/crio-012433452ba69eecb5991b9fcdb34c55fb47e73b61cdff5dbef705370abd8917 WatchSource:0}: Error finding container 012433452ba69eecb5991b9fcdb34c55fb47e73b61cdff5dbef705370abd8917: Status 404 returned error can't find the container with id 012433452ba69eecb5991b9fcdb34c55fb47e73b61cdff5dbef705370abd8917
Aug 05 17:21:21.605943 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:21.605912    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx" event={"ID":"5e55398a-4e94-44ff-b939-a7872a34a275","Type":"ContainerStarted","Data":"51b0306c1311a7d76191b48a11e1499f0f842a6fa77b70525179b71a72f2fc52"}
Aug 05 17:21:21.606077 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:21.605967    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx" event={"ID":"5e55398a-4e94-44ff-b939-a7872a34a275","Type":"ContainerStarted","Data":"012433452ba69eecb5991b9fcdb34c55fb47e73b61cdff5dbef705370abd8917"}
Aug 05 17:21:21.623555 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:21.623513    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx" podStartSLOduration=1.623498476 podStartE2EDuration="1.623498476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:21:21.621668591 +0000 UTC m=+2536.071214889" watchObservedRunningTime="2026-08-05 17:21:21.623498476 +0000 UTC m=+2536.073044807"
Aug 05 17:21:22.612541 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:22.612508    2575 generic.go:356] "Generic (PLEG): container finished" podID="5e55398a-4e94-44ff-b939-a7872a34a275" containerID="51b0306c1311a7d76191b48a11e1499f0f842a6fa77b70525179b71a72f2fc52" exitCode=0
Aug 05 17:21:22.612953 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:22.612594    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx" event={"ID":"5e55398a-4e94-44ff-b939-a7872a34a275","Type":"ContainerDied","Data":"51b0306c1311a7d76191b48a11e1499f0f842a6fa77b70525179b71a72f2fc52"}
Aug 05 17:21:23.189868 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:23.189832    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:21:23.748921 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:23.748897    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx"
Aug 05 17:21:23.835359 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:23.835329    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e55398a-4e94-44ff-b939-a7872a34a275-maas-api-service-ca\") pod \"5e55398a-4e94-44ff-b939-a7872a34a275\" (UID: \"5e55398a-4e94-44ff-b939-a7872a34a275\") "
Aug 05 17:21:23.835727 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:23.835706    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e55398a-4e94-44ff-b939-a7872a34a275-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5e55398a-4e94-44ff-b939-a7872a34a275" (UID: "5e55398a-4e94-44ff-b939-a7872a34a275"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:23.936772 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:23.936741    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e55398a-4e94-44ff-b939-a7872a34a275-maas-api-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:21:24.622825 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:24.622791    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx"
Aug 05 17:21:24.623004 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:24.622833    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx" event={"ID":"5e55398a-4e94-44ff-b939-a7872a34a275","Type":"ContainerDied","Data":"012433452ba69eecb5991b9fcdb34c55fb47e73b61cdff5dbef705370abd8917"}
Aug 05 17:21:24.623004 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:24.622885    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="012433452ba69eecb5991b9fcdb34c55fb47e73b61cdff5dbef705370abd8917"
Aug 05 17:21:25.061691 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.061663    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"]
Aug 05 17:21:25.062105 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.061866    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5" podUID="38adc30a-9faa-41b5-8e3f-3507ff8e704d" containerName="maas-api" containerID="cri-o://47f353ce0263bfeb8b8892bbbd95222340917a454bff96023242988315b3756c" gracePeriod=30
Aug 05 17:21:25.110135 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.110102    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:25.230412 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.230373    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:25.315024 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.314969    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:21:25.332588 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.332562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:25.350403 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.350379    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38adc30a-9faa-41b5-8e3f-3507ff8e704d-openshift-service-ca\") pod \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\" (UID: \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\") "
Aug 05 17:21:25.350616 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.350510    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38adc30a-9faa-41b5-8e3f-3507ff8e704d-maas-api-tls\") pod \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\" (UID: \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\") "
Aug 05 17:21:25.350616 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.350596    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb86n\" (UniqueName: \"kubernetes.io/projected/38adc30a-9faa-41b5-8e3f-3507ff8e704d-kube-api-access-rb86n\") pod \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\" (UID: \"38adc30a-9faa-41b5-8e3f-3507ff8e704d\") "
Aug 05 17:21:25.350777 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.350750    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38adc30a-9faa-41b5-8e3f-3507ff8e704d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38adc30a-9faa-41b5-8e3f-3507ff8e704d" (UID: "38adc30a-9faa-41b5-8e3f-3507ff8e704d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:25.351108 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.351084    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38adc30a-9faa-41b5-8e3f-3507ff8e704d-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:21:25.352700 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.352672    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38adc30a-9faa-41b5-8e3f-3507ff8e704d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38adc30a-9faa-41b5-8e3f-3507ff8e704d" (UID: "38adc30a-9faa-41b5-8e3f-3507ff8e704d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:21:25.352795 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.352723    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38adc30a-9faa-41b5-8e3f-3507ff8e704d-kube-api-access-rb86n" (OuterVolumeSpecName: "kube-api-access-rb86n") pod "38adc30a-9faa-41b5-8e3f-3507ff8e704d" (UID: "38adc30a-9faa-41b5-8e3f-3507ff8e704d"). InnerVolumeSpecName "kube-api-access-rb86n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:25.405276 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.405236    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx"]
Aug 05 17:21:25.415112 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.415067    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c15c3d-v9plx"]
Aug 05 17:21:25.433914 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.433875    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:25.451726 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.451701    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38adc30a-9faa-41b5-8e3f-3507ff8e704d-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:21:25.451726 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.451722    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb86n\" (UniqueName: \"kubernetes.io/projected/38adc30a-9faa-41b5-8e3f-3507ff8e704d-kube-api-access-rb86n\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:21:25.629084 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.628996    2575 generic.go:356] "Generic (PLEG): container finished" podID="38adc30a-9faa-41b5-8e3f-3507ff8e704d" containerID="47f353ce0263bfeb8b8892bbbd95222340917a454bff96023242988315b3756c" exitCode=0
Aug 05 17:21:25.629084 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.629043    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"
Aug 05 17:21:25.629286 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.629089    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5" event={"ID":"38adc30a-9faa-41b5-8e3f-3507ff8e704d","Type":"ContainerDied","Data":"47f353ce0263bfeb8b8892bbbd95222340917a454bff96023242988315b3756c"}
Aug 05 17:21:25.629286 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.629141    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5" event={"ID":"38adc30a-9faa-41b5-8e3f-3507ff8e704d","Type":"ContainerDied","Data":"6b18d72258790607e0e53c9a903b514a56eafbdeeefcc20c1ce7d19cdccb6fc3"}
Aug 05 17:21:25.629286 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.629165    2575 scope.go:117] "RemoveContainer" containerID="47f353ce0263bfeb8b8892bbbd95222340917a454bff96023242988315b3756c"
Aug 05 17:21:25.638619 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.638605    2575 scope.go:117] "RemoveContainer" containerID="47f353ce0263bfeb8b8892bbbd95222340917a454bff96023242988315b3756c"
Aug 05 17:21:25.638900 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:21:25.638883    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47f353ce0263bfeb8b8892bbbd95222340917a454bff96023242988315b3756c\": container with ID starting with 47f353ce0263bfeb8b8892bbbd95222340917a454bff96023242988315b3756c not found: ID does not exist" containerID="47f353ce0263bfeb8b8892bbbd95222340917a454bff96023242988315b3756c"
Aug 05 17:21:25.638946 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.638910    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47f353ce0263bfeb8b8892bbbd95222340917a454bff96023242988315b3756c"} err="failed to get container status \"47f353ce0263bfeb8b8892bbbd95222340917a454bff96023242988315b3756c\": rpc error: code = NotFound desc = could not find container \"47f353ce0263bfeb8b8892bbbd95222340917a454bff96023242988315b3756c\": container with ID starting with 47f353ce0263bfeb8b8892bbbd95222340917a454bff96023242988315b3756c not found: ID does not exist"
Aug 05 17:21:25.654080 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.654057    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"]
Aug 05 17:21:25.656598 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.656577    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c15c3d-67ffb9bd4c-db9l5"]
Aug 05 17:21:25.860390 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:25.860360    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:26.013773 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:26.013743    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38adc30a-9faa-41b5-8e3f-3507ff8e704d" path="/var/lib/kubelet/pods/38adc30a-9faa-41b5-8e3f-3507ff8e704d/volumes"
Aug 05 17:21:26.014152 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:26.014136    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e55398a-4e94-44ff-b939-a7872a34a275" path="/var/lib/kubelet/pods/5e55398a-4e94-44ff-b939-a7872a34a275/volumes"
Aug 05 17:21:30.419057 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:30.419013    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:21:30.893071 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:30.892977    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:37.719256 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:37.719223    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:38.010039 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.009932    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:38.265319 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.265223    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:38.392423 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.392391    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk"]
Aug 05 17:21:38.392736 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.392724    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38adc30a-9faa-41b5-8e3f-3507ff8e704d" containerName="maas-api"
Aug 05 17:21:38.392736 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.392737    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="38adc30a-9faa-41b5-8e3f-3507ff8e704d" containerName="maas-api"
Aug 05 17:21:38.392846 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.392751    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e55398a-4e94-44ff-b939-a7872a34a275" containerName="revoke-keys"
Aug 05 17:21:38.392846 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.392758    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e55398a-4e94-44ff-b939-a7872a34a275" containerName="revoke-keys"
Aug 05 17:21:38.392846 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.392841    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="38adc30a-9faa-41b5-8e3f-3507ff8e704d" containerName="maas-api"
Aug 05 17:21:38.392955 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.392848    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e55398a-4e94-44ff-b939-a7872a34a275" containerName="revoke-keys"
Aug 05 17:21:38.397183 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.397168    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk"
Aug 05 17:21:38.400116 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.400097    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:21:38.405662 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.405635    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk"]
Aug 05 17:21:38.463652 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.463620    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba5e178c-3cf1-477f-91ea-9efa35369993-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk\" (UID: \"ba5e178c-3cf1-477f-91ea-9efa35369993\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk"
Aug 05 17:21:38.564794 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.564711    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba5e178c-3cf1-477f-91ea-9efa35369993-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk\" (UID: \"ba5e178c-3cf1-477f-91ea-9efa35369993\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk"
Aug 05 17:21:38.565326 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.565307    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba5e178c-3cf1-477f-91ea-9efa35369993-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk\" (UID: \"ba5e178c-3cf1-477f-91ea-9efa35369993\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk"
Aug 05 17:21:38.708067 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.708036    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk"
Aug 05 17:21:38.844309 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:38.844280    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk"]
Aug 05 17:21:38.846389 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:21:38.846359    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5e178c_3cf1_477f_91ea_9efa35369993.slice/crio-3b0bd9656f212d295af7f33f9ce21adb73bad69b49f08942a6bca22fe5cf61e7 WatchSource:0}: Error finding container 3b0bd9656f212d295af7f33f9ce21adb73bad69b49f08942a6bca22fe5cf61e7: Status 404 returned error can't find the container with id 3b0bd9656f212d295af7f33f9ce21adb73bad69b49f08942a6bca22fe5cf61e7
Aug 05 17:21:39.701066 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:39.701034    2575 generic.go:356] "Generic (PLEG): container finished" podID="ba5e178c-3cf1-477f-91ea-9efa35369993" containerID="b021d4a6e0a9b9cf2a2e791f73b89609f602eed1ecdd515f3f30192fdf997b8a" exitCode=0
Aug 05 17:21:39.701218 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:39.701071    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk" event={"ID":"ba5e178c-3cf1-477f-91ea-9efa35369993","Type":"ContainerDied","Data":"b021d4a6e0a9b9cf2a2e791f73b89609f602eed1ecdd515f3f30192fdf997b8a"}
Aug 05 17:21:39.701218 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:39.701106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk" event={"ID":"ba5e178c-3cf1-477f-91ea-9efa35369993","Type":"ContainerStarted","Data":"3b0bd9656f212d295af7f33f9ce21adb73bad69b49f08942a6bca22fe5cf61e7"}
Aug 05 17:21:40.840859 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:40.840836    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk"
Aug 05 17:21:40.987797 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:40.987716    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba5e178c-3cf1-477f-91ea-9efa35369993-maas-api-service-ca\") pod \"ba5e178c-3cf1-477f-91ea-9efa35369993\" (UID: \"ba5e178c-3cf1-477f-91ea-9efa35369993\") "
Aug 05 17:21:40.988104 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:40.988079    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba5e178c-3cf1-477f-91ea-9efa35369993-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ba5e178c-3cf1-477f-91ea-9efa35369993" (UID: "ba5e178c-3cf1-477f-91ea-9efa35369993"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:41.088896 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:41.088852    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba5e178c-3cf1-477f-91ea-9efa35369993-maas-api-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:21:41.712443 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:41.712417    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk"
Aug 05 17:21:41.712619 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:41.712416    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk" event={"ID":"ba5e178c-3cf1-477f-91ea-9efa35369993","Type":"ContainerDied","Data":"3b0bd9656f212d295af7f33f9ce21adb73bad69b49f08942a6bca22fe5cf61e7"}
Aug 05 17:21:41.712619 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:41.712541    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b0bd9656f212d295af7f33f9ce21adb73bad69b49f08942a6bca22fe5cf61e7"
Aug 05 17:21:49.007972 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.007933    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"]
Aug 05 17:21:49.008427 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.008193    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2" podUID="019f25e6-9255-4c43-a639-423e83762689" containerName="maas-api" containerID="cri-o://589067d6a2e16e281f4dcbdb5f8d5006b6e0809783a0d93cca901730de951064" gracePeriod=30
Aug 05 17:21:49.034466 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.034438    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:49.062883 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.062858    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"]
Aug 05 17:21:49.063113 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.063088    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t" podUID="12392d24-9d2d-4afd-9b46-99cb7d38a839" containerName="payload-processing" containerID="cri-o://03bec71df76981af03e847e21d7b17fc965703af64a236f9a95e0dce6d9fd962" gracePeriod=30
Aug 05 17:21:49.117234 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.117204    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:49.159995 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.159965    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2" podUID="019f25e6-9255-4c43-a639-423e83762689" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.42:8443/health\": dial tcp 10.134.0.42:8443: connect: connection refused"
Aug 05 17:21:49.217747 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.217711    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:49.238451 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.238371    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk"]
Aug 05 17:21:49.240972 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.240948    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-161ce7-xtvlk"]
Aug 05 17:21:49.294611 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.294575    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:49.305066 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.305048    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:21:49.338852 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.338829    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"
Aug 05 17:21:49.463511 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.463478    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/019f25e6-9255-4c43-a639-423e83762689-openshift-service-ca\") pod \"019f25e6-9255-4c43-a639-423e83762689\" (UID: \"019f25e6-9255-4c43-a639-423e83762689\") "
Aug 05 17:21:49.463700 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.463568    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/019f25e6-9255-4c43-a639-423e83762689-maas-api-tls\") pod \"019f25e6-9255-4c43-a639-423e83762689\" (UID: \"019f25e6-9255-4c43-a639-423e83762689\") "
Aug 05 17:21:49.463700 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.463621    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpz7l\" (UniqueName: \"kubernetes.io/projected/12392d24-9d2d-4afd-9b46-99cb7d38a839-kube-api-access-jpz7l\") pod \"12392d24-9d2d-4afd-9b46-99cb7d38a839\" (UID: \"12392d24-9d2d-4afd-9b46-99cb7d38a839\") "
Aug 05 17:21:49.463854 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.463705    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2tkm\" (UniqueName: \"kubernetes.io/projected/019f25e6-9255-4c43-a639-423e83762689-kube-api-access-d2tkm\") pod \"019f25e6-9255-4c43-a639-423e83762689\" (UID: \"019f25e6-9255-4c43-a639-423e83762689\") "
Aug 05 17:21:49.463854 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.463753    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12392d24-9d2d-4afd-9b46-99cb7d38a839-plugins-config-volume\") pod \"12392d24-9d2d-4afd-9b46-99cb7d38a839\" (UID: \"12392d24-9d2d-4afd-9b46-99cb7d38a839\") "
Aug 05 17:21:49.463963 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.463906    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/019f25e6-9255-4c43-a639-423e83762689-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "019f25e6-9255-4c43-a639-423e83762689" (UID: "019f25e6-9255-4c43-a639-423e83762689"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:49.464159 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.464120    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/019f25e6-9255-4c43-a639-423e83762689-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:21:49.464289 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.464258    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12392d24-9d2d-4afd-9b46-99cb7d38a839-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "12392d24-9d2d-4afd-9b46-99cb7d38a839" (UID: "12392d24-9d2d-4afd-9b46-99cb7d38a839"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:49.466073 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.466051    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12392d24-9d2d-4afd-9b46-99cb7d38a839-kube-api-access-jpz7l" (OuterVolumeSpecName: "kube-api-access-jpz7l") pod "12392d24-9d2d-4afd-9b46-99cb7d38a839" (UID: "12392d24-9d2d-4afd-9b46-99cb7d38a839"). InnerVolumeSpecName "kube-api-access-jpz7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:49.466199 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.466179    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/019f25e6-9255-4c43-a639-423e83762689-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "019f25e6-9255-4c43-a639-423e83762689" (UID: "019f25e6-9255-4c43-a639-423e83762689"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:21:49.466255 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.466193    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/019f25e6-9255-4c43-a639-423e83762689-kube-api-access-d2tkm" (OuterVolumeSpecName: "kube-api-access-d2tkm") pod "019f25e6-9255-4c43-a639-423e83762689" (UID: "019f25e6-9255-4c43-a639-423e83762689"). InnerVolumeSpecName "kube-api-access-d2tkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:49.565462 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.565388    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2tkm\" (UniqueName: \"kubernetes.io/projected/019f25e6-9255-4c43-a639-423e83762689-kube-api-access-d2tkm\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:21:49.565462 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.565413    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12392d24-9d2d-4afd-9b46-99cb7d38a839-plugins-config-volume\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:21:49.565462 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.565423    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/019f25e6-9255-4c43-a639-423e83762689-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:21:49.565462 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.565432    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpz7l\" (UniqueName: \"kubernetes.io/projected/12392d24-9d2d-4afd-9b46-99cb7d38a839-kube-api-access-jpz7l\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:21:49.642638 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.642608    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:49.752375 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.752349    2575 generic.go:356] "Generic (PLEG): container finished" podID="019f25e6-9255-4c43-a639-423e83762689" containerID="589067d6a2e16e281f4dcbdb5f8d5006b6e0809783a0d93cca901730de951064" exitCode=0
Aug 05 17:21:49.752562 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.752390    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"
Aug 05 17:21:49.752562 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.752431    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2" event={"ID":"019f25e6-9255-4c43-a639-423e83762689","Type":"ContainerDied","Data":"589067d6a2e16e281f4dcbdb5f8d5006b6e0809783a0d93cca901730de951064"}
Aug 05 17:21:49.752562 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.752487    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2" event={"ID":"019f25e6-9255-4c43-a639-423e83762689","Type":"ContainerDied","Data":"2873e9148a8a9e7a768749e66a057439cb5eedbf40814b23f4b62b2161421271"}
Aug 05 17:21:49.752562 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.752520    2575 scope.go:117] "RemoveContainer" containerID="589067d6a2e16e281f4dcbdb5f8d5006b6e0809783a0d93cca901730de951064"
Aug 05 17:21:49.753978 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.753931    2575 generic.go:356] "Generic (PLEG): container finished" podID="12392d24-9d2d-4afd-9b46-99cb7d38a839" containerID="03bec71df76981af03e847e21d7b17fc965703af64a236f9a95e0dce6d9fd962" exitCode=0
Aug 05 17:21:49.754065 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.753979    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"
Aug 05 17:21:49.754065 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.753982    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t" event={"ID":"12392d24-9d2d-4afd-9b46-99cb7d38a839","Type":"ContainerDied","Data":"03bec71df76981af03e847e21d7b17fc965703af64a236f9a95e0dce6d9fd962"}
Aug 05 17:21:49.754065 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.754022    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t" event={"ID":"12392d24-9d2d-4afd-9b46-99cb7d38a839","Type":"ContainerDied","Data":"98340fd595f3e07a4170f96b52afb911c1f8e8846a68d74df1fa320dedc688d6"}
Aug 05 17:21:49.761404 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.761387    2575 scope.go:117] "RemoveContainer" containerID="589067d6a2e16e281f4dcbdb5f8d5006b6e0809783a0d93cca901730de951064"
Aug 05 17:21:49.761663 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:21:49.761646    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"589067d6a2e16e281f4dcbdb5f8d5006b6e0809783a0d93cca901730de951064\": container with ID starting with 589067d6a2e16e281f4dcbdb5f8d5006b6e0809783a0d93cca901730de951064 not found: ID does not exist" containerID="589067d6a2e16e281f4dcbdb5f8d5006b6e0809783a0d93cca901730de951064"
Aug 05 17:21:49.761726 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.761670    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589067d6a2e16e281f4dcbdb5f8d5006b6e0809783a0d93cca901730de951064"} err="failed to get container status \"589067d6a2e16e281f4dcbdb5f8d5006b6e0809783a0d93cca901730de951064\": rpc error: code = NotFound desc = could not find container \"589067d6a2e16e281f4dcbdb5f8d5006b6e0809783a0d93cca901730de951064\": container with ID starting with 589067d6a2e16e281f4dcbdb5f8d5006b6e0809783a0d93cca901730de951064 not found: ID does not exist"
Aug 05 17:21:49.761726 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.761686    2575 scope.go:117] "RemoveContainer" containerID="03bec71df76981af03e847e21d7b17fc965703af64a236f9a95e0dce6d9fd962"
Aug 05 17:21:49.769491 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.769474    2575 scope.go:117] "RemoveContainer" containerID="03bec71df76981af03e847e21d7b17fc965703af64a236f9a95e0dce6d9fd962"
Aug 05 17:21:49.769735 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:21:49.769715    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03bec71df76981af03e847e21d7b17fc965703af64a236f9a95e0dce6d9fd962\": container with ID starting with 03bec71df76981af03e847e21d7b17fc965703af64a236f9a95e0dce6d9fd962 not found: ID does not exist" containerID="03bec71df76981af03e847e21d7b17fc965703af64a236f9a95e0dce6d9fd962"
Aug 05 17:21:49.769800 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.769744    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03bec71df76981af03e847e21d7b17fc965703af64a236f9a95e0dce6d9fd962"} err="failed to get container status \"03bec71df76981af03e847e21d7b17fc965703af64a236f9a95e0dce6d9fd962\": rpc error: code = NotFound desc = could not find container \"03bec71df76981af03e847e21d7b17fc965703af64a236f9a95e0dce6d9fd962\": container with ID starting with 03bec71df76981af03e847e21d7b17fc965703af64a236f9a95e0dce6d9fd962 not found: ID does not exist"
Aug 05 17:21:49.779676 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.779654    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"]
Aug 05 17:21:49.783299 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.783279    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-161ce7-766465d5c6-99cg2"]
Aug 05 17:21:49.794475 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.794455    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"]
Aug 05 17:21:49.799954 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:49.799933    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-161ce7-5d5598dc86-vbw9t"]
Aug 05 17:21:50.014761 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:50.014730    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="019f25e6-9255-4c43-a639-423e83762689" path="/var/lib/kubelet/pods/019f25e6-9255-4c43-a639-423e83762689/volumes"
Aug 05 17:21:50.015145 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:50.015098    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12392d24-9d2d-4afd-9b46-99cb7d38a839" path="/var/lib/kubelet/pods/12392d24-9d2d-4afd-9b46-99cb7d38a839/volumes"
Aug 05 17:21:50.015376 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:50.015364    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba5e178c-3cf1-477f-91ea-9efa35369993" path="/var/lib/kubelet/pods/ba5e178c-3cf1-477f-91ea-9efa35369993/volumes"
Aug 05 17:21:51.301245 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:51.301214    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:21:56.306820 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:56.306768    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:56.424599 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:56.424564    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:56.630923 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:56.630828    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:56.825077 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:56.825036    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:57.210170 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:57.210131    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:57.559304 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:57.559213    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:57.651927 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:21:57.651895    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:01.055398 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:01.055357    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:01.159191 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:01.159151    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:02.176586 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.176550    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"]
Aug 05 17:22:02.177084 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.177067    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="019f25e6-9255-4c43-a639-423e83762689" containerName="maas-api"
Aug 05 17:22:02.177150 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.177087    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="019f25e6-9255-4c43-a639-423e83762689" containerName="maas-api"
Aug 05 17:22:02.177150 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.177109    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba5e178c-3cf1-477f-91ea-9efa35369993" containerName="revoke-keys"
Aug 05 17:22:02.177150 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.177118    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba5e178c-3cf1-477f-91ea-9efa35369993" containerName="revoke-keys"
Aug 05 17:22:02.177306 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.177151    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12392d24-9d2d-4afd-9b46-99cb7d38a839" containerName="payload-processing"
Aug 05 17:22:02.177306 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.177161    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="12392d24-9d2d-4afd-9b46-99cb7d38a839" containerName="payload-processing"
Aug 05 17:22:02.177306 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.177249    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="12392d24-9d2d-4afd-9b46-99cb7d38a839" containerName="payload-processing"
Aug 05 17:22:02.177306 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.177261    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="019f25e6-9255-4c43-a639-423e83762689" containerName="maas-api"
Aug 05 17:22:02.177306 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.177273    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba5e178c-3cf1-477f-91ea-9efa35369993" containerName="revoke-keys"
Aug 05 17:22:02.182199 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.182179    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:22:02.185521 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.185500    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-5e257e-serving-cert\""
Aug 05 17:22:02.185713 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.185531    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:22:02.186169 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.186145    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 17:22:02.186260 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.186183    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nplzm\""
Aug 05 17:22:02.196103 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.196079    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"]
Aug 05 17:22:02.219875 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.219844    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:02.280965 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.280940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf5eb0a-d79b-407f-a0b9-30ef668fd846-maas-api-tls\") pod \"maas-api-e2e-api-a-5e257e-86c6745694-cjv6c\" (UID: \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:22:02.281097 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.280984    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gk7g\" (UniqueName: \"kubernetes.io/projected/adf5eb0a-d79b-407f-a0b9-30ef668fd846-kube-api-access-2gk7g\") pod \"maas-api-e2e-api-a-5e257e-86c6745694-cjv6c\" (UID: \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:22:02.281097 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.281073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf5eb0a-d79b-407f-a0b9-30ef668fd846-openshift-service-ca\") pod \"maas-api-e2e-api-a-5e257e-86c6745694-cjv6c\" (UID: \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:22:02.381601 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.381570    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gk7g\" (UniqueName: \"kubernetes.io/projected/adf5eb0a-d79b-407f-a0b9-30ef668fd846-kube-api-access-2gk7g\") pod \"maas-api-e2e-api-a-5e257e-86c6745694-cjv6c\" (UID: \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:22:02.381733 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.381623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf5eb0a-d79b-407f-a0b9-30ef668fd846-openshift-service-ca\") pod \"maas-api-e2e-api-a-5e257e-86c6745694-cjv6c\" (UID: \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:22:02.381733 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.381681    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf5eb0a-d79b-407f-a0b9-30ef668fd846-maas-api-tls\") pod \"maas-api-e2e-api-a-5e257e-86c6745694-cjv6c\" (UID: \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:22:02.381840 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:22:02.381797    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-serving-cert: secret "maas-api-e2e-api-a-5e257e-serving-cert" not found
Aug 05 17:22:02.381907 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:22:02.381895    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf5eb0a-d79b-407f-a0b9-30ef668fd846-maas-api-tls podName:adf5eb0a-d79b-407f-a0b9-30ef668fd846 nodeName:}" failed. No retries permitted until 2026-08-05 17:22:02.881873185 +0000 UTC m=+2577.331419461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/adf5eb0a-d79b-407f-a0b9-30ef668fd846-maas-api-tls") pod "maas-api-e2e-api-a-5e257e-86c6745694-cjv6c" (UID: "adf5eb0a-d79b-407f-a0b9-30ef668fd846") : secret "maas-api-e2e-api-a-5e257e-serving-cert" not found
Aug 05 17:22:02.382403 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.382383    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf5eb0a-d79b-407f-a0b9-30ef668fd846-openshift-service-ca\") pod \"maas-api-e2e-api-a-5e257e-86c6745694-cjv6c\" (UID: \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:22:02.408067 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.408036    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gk7g\" (UniqueName: \"kubernetes.io/projected/adf5eb0a-d79b-407f-a0b9-30ef668fd846-kube-api-access-2gk7g\") pod \"maas-api-e2e-api-a-5e257e-86c6745694-cjv6c\" (UID: \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:22:02.503705 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.503622    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:02.885931 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.885848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf5eb0a-d79b-407f-a0b9-30ef668fd846-maas-api-tls\") pod \"maas-api-e2e-api-a-5e257e-86c6745694-cjv6c\" (UID: \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:22:02.888368 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:02.888330    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf5eb0a-d79b-407f-a0b9-30ef668fd846-maas-api-tls\") pod \"maas-api-e2e-api-a-5e257e-86c6745694-cjv6c\" (UID: \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:22:03.092410 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.092372    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:22:03.243787 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.243756    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"]
Aug 05 17:22:03.247896 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:22:03.247827    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf5eb0a_d79b_407f_a0b9_30ef668fd846.slice/crio-b5c5dcecfdc70f3f9f46b298d9c36512dd6f99e95ba9560d3a1803e62c9a0aca WatchSource:0}: Error finding container b5c5dcecfdc70f3f9f46b298d9c36512dd6f99e95ba9560d3a1803e62c9a0aca: Status 404 returned error can't find the container with id b5c5dcecfdc70f3f9f46b298d9c36512dd6f99e95ba9560d3a1803e62c9a0aca
Aug 05 17:22:03.248156 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.248120    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:03.249364 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.249344    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:22:03.345566 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.345535    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:03.448058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.448028    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"]
Aug 05 17:22:03.452496 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.452481    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"
Aug 05 17:22:03.455369 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.455344    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-5e257e-dockercfg-6qvvz\""
Aug 05 17:22:03.455487 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.455348    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-5e257e\""
Aug 05 17:22:03.465570 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.465547    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"]
Aug 05 17:22:03.490744 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.490717    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3db06ce-20d6-49a3-be01-76fc3edd27e5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v\" (UID: \"e3db06ce-20d6-49a3-be01-76fc3edd27e5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"
Aug 05 17:22:03.490906 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.490859    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhr4p\" (UniqueName: \"kubernetes.io/projected/e3db06ce-20d6-49a3-be01-76fc3edd27e5-kube-api-access-bhr4p\") pod \"payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v\" (UID: \"e3db06ce-20d6-49a3-be01-76fc3edd27e5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"
Aug 05 17:22:03.504487 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.504460    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"]
Aug 05 17:22:03.507907 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.507889    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"
Aug 05 17:22:03.522422 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.522401    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"]
Aug 05 17:22:03.591684 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.591650    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhr4p\" (UniqueName: \"kubernetes.io/projected/e3db06ce-20d6-49a3-be01-76fc3edd27e5-kube-api-access-bhr4p\") pod \"payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v\" (UID: \"e3db06ce-20d6-49a3-be01-76fc3edd27e5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"
Aug 05 17:22:03.591857 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.591700    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3db06ce-20d6-49a3-be01-76fc3edd27e5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v\" (UID: \"e3db06ce-20d6-49a3-be01-76fc3edd27e5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"
Aug 05 17:22:03.591857 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.591726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xwlk\" (UniqueName: \"kubernetes.io/projected/736cd3c8-ddc6-42d0-9921-8d404ee3b126-kube-api-access-9xwlk\") pod \"payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2\" (UID: \"736cd3c8-ddc6-42d0-9921-8d404ee3b126\") " pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"
Aug 05 17:22:03.591857 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.591761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/736cd3c8-ddc6-42d0-9921-8d404ee3b126-plugins-config-volume\") pod \"payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2\" (UID: \"736cd3c8-ddc6-42d0-9921-8d404ee3b126\") " pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"
Aug 05 17:22:03.592434 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.592417    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3db06ce-20d6-49a3-be01-76fc3edd27e5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v\" (UID: \"e3db06ce-20d6-49a3-be01-76fc3edd27e5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"
Aug 05 17:22:03.601194 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.601166    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhr4p\" (UniqueName: \"kubernetes.io/projected/e3db06ce-20d6-49a3-be01-76fc3edd27e5-kube-api-access-bhr4p\") pod \"payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v\" (UID: \"e3db06ce-20d6-49a3-be01-76fc3edd27e5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"
Aug 05 17:22:03.692599 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.692566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xwlk\" (UniqueName: \"kubernetes.io/projected/736cd3c8-ddc6-42d0-9921-8d404ee3b126-kube-api-access-9xwlk\") pod \"payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2\" (UID: \"736cd3c8-ddc6-42d0-9921-8d404ee3b126\") " pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"
Aug 05 17:22:03.692737 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.692615    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/736cd3c8-ddc6-42d0-9921-8d404ee3b126-plugins-config-volume\") pod \"payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2\" (UID: \"736cd3c8-ddc6-42d0-9921-8d404ee3b126\") " pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"
Aug 05 17:22:03.693242 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.693225    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/736cd3c8-ddc6-42d0-9921-8d404ee3b126-plugins-config-volume\") pod \"payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2\" (UID: \"736cd3c8-ddc6-42d0-9921-8d404ee3b126\") " pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"
Aug 05 17:22:03.704212 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.704151    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xwlk\" (UniqueName: \"kubernetes.io/projected/736cd3c8-ddc6-42d0-9921-8d404ee3b126-kube-api-access-9xwlk\") pod \"payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2\" (UID: \"736cd3c8-ddc6-42d0-9921-8d404ee3b126\") " pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"
Aug 05 17:22:03.763228 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.763205    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"
Aug 05 17:22:03.818758 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.818729    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"
Aug 05 17:22:03.827456 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.827429    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c" event={"ID":"adf5eb0a-d79b-407f-a0b9-30ef668fd846","Type":"ContainerStarted","Data":"b5c5dcecfdc70f3f9f46b298d9c36512dd6f99e95ba9560d3a1803e62c9a0aca"}
Aug 05 17:22:03.907325 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.907297    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"]
Aug 05 17:22:03.910527 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:22:03.910496    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3db06ce_20d6_49a3_be01_76fc3edd27e5.slice/crio-36574d9565c5337320a17df678528a9878b260cc0e8f4685f85ed63fa39bacbd WatchSource:0}: Error finding container 36574d9565c5337320a17df678528a9878b260cc0e8f4685f85ed63fa39bacbd: Status 404 returned error can't find the container with id 36574d9565c5337320a17df678528a9878b260cc0e8f4685f85ed63fa39bacbd
Aug 05 17:22:03.970032 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:03.970009    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"]
Aug 05 17:22:03.971532 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:22:03.971506    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736cd3c8_ddc6_42d0_9921_8d404ee3b126.slice/crio-bc254ff0f7d65ad5d94ea29618c1cdae894cfeee0be55edc3534c3214e55ceb5 WatchSource:0}: Error finding container bc254ff0f7d65ad5d94ea29618c1cdae894cfeee0be55edc3534c3214e55ceb5: Status 404 returned error can't find the container with id bc254ff0f7d65ad5d94ea29618c1cdae894cfeee0be55edc3534c3214e55ceb5
Aug 05 17:22:04.834152 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:04.834119    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2" event={"ID":"736cd3c8-ddc6-42d0-9921-8d404ee3b126","Type":"ContainerStarted","Data":"1e36fb8cd6511c7b17e410ad5d2d3114d11cda80e8581a45f0357fa030817342"}
Aug 05 17:22:04.834681 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:04.834177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2" event={"ID":"736cd3c8-ddc6-42d0-9921-8d404ee3b126","Type":"ContainerStarted","Data":"bc254ff0f7d65ad5d94ea29618c1cdae894cfeee0be55edc3534c3214e55ceb5"}
Aug 05 17:22:04.834681 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:04.834204    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"
Aug 05 17:22:04.835787 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:04.835759    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v" event={"ID":"e3db06ce-20d6-49a3-be01-76fc3edd27e5","Type":"ContainerStarted","Data":"ffee6b2a0630868be2f10a89b1848889200dab27f6bab797fd51d6edef7e9ecb"}
Aug 05 17:22:04.835906 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:04.835841    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v" event={"ID":"e3db06ce-20d6-49a3-be01-76fc3edd27e5","Type":"ContainerStarted","Data":"36574d9565c5337320a17df678528a9878b260cc0e8f4685f85ed63fa39bacbd"}
Aug 05 17:22:04.835906 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:04.835875    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"
Aug 05 17:22:04.837299 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:04.837280    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c" event={"ID":"adf5eb0a-d79b-407f-a0b9-30ef668fd846","Type":"ContainerStarted","Data":"532830681a6c2bc199948a513ce687ff1d1b35b98d4ea9108b907ae7c155fa6a"}
Aug 05 17:22:04.837436 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:04.837422    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:22:04.866178 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:04.866139    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2" podStartSLOduration=1.866126007 podStartE2EDuration="1.866126007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:22:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:04.863999546 +0000 UTC m=+2579.313545847" watchObservedRunningTime="2026-08-05 17:22:04.866126007 +0000 UTC m=+2579.315672284"
Aug 05 17:22:04.883584 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:04.883541    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c" podStartSLOduration=2.273076974 podStartE2EDuration="2.883528882s" totalImagesPullingTime="610.451908ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:04.882019739 +0000 UTC m=+2579.331566040" watchObservedRunningTime="2026-08-05 17:22:04.883528882 +0000 UTC m=+2579.333075184"
Aug 05 17:22:04.900505 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:04.900464    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v" podStartSLOduration=1.90045135 podStartE2EDuration="1.90045135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:22:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:04.898688356 +0000 UTC m=+2579.348234670" watchObservedRunningTime="2026-08-05 17:22:04.90045135 +0000 UTC m=+2579.349997698"
Aug 05 17:22:05.896452 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:05.896414    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:22:10.849037 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:10.849008    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:22:15.845707 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:15.845669    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"
Aug 05 17:22:15.846222 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:15.845745    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"
Aug 05 17:22:26.093538 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:26.093500    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:26.687212 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:26.687179    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:27.083118 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:27.083030    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:27.566750 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:27.566710    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:30.136372 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:30.136279    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:30.237109 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:30.237072    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:30.826169 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:30.826139    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:30.953259 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:30.953215    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:31.271140 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.271105    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"]
Aug 05 17:22:31.274860 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.274833    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:22:31.277300 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.277283    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-2db124-serving-cert\""
Aug 05 17:22:31.294595 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.294569    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"]
Aug 05 17:22:31.330039 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.330009    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:31.437382 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.437349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hpj6\" (UniqueName: \"kubernetes.io/projected/493c8596-3d51-4d5d-936b-f3bc913ef6c1-kube-api-access-4hpj6\") pod \"maas-api-e2e-api-b-2db124-944444fd7-cvvgz\" (UID: \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:22:31.437559 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.437391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/493c8596-3d51-4d5d-936b-f3bc913ef6c1-maas-api-tls\") pod \"maas-api-e2e-api-b-2db124-944444fd7-cvvgz\" (UID: \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:22:31.437559 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.437419    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/493c8596-3d51-4d5d-936b-f3bc913ef6c1-openshift-service-ca\") pod \"maas-api-e2e-api-b-2db124-944444fd7-cvvgz\" (UID: \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:22:31.500036 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.500003    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:31.539022 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.538928    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hpj6\" (UniqueName: \"kubernetes.io/projected/493c8596-3d51-4d5d-936b-f3bc913ef6c1-kube-api-access-4hpj6\") pod \"maas-api-e2e-api-b-2db124-944444fd7-cvvgz\" (UID: \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:22:31.539022 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.538989    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/493c8596-3d51-4d5d-936b-f3bc913ef6c1-maas-api-tls\") pod \"maas-api-e2e-api-b-2db124-944444fd7-cvvgz\" (UID: \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:22:31.539022 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.539018    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/493c8596-3d51-4d5d-936b-f3bc913ef6c1-openshift-service-ca\") pod \"maas-api-e2e-api-b-2db124-944444fd7-cvvgz\" (UID: \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:22:31.539718 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.539697    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/493c8596-3d51-4d5d-936b-f3bc913ef6c1-openshift-service-ca\") pod \"maas-api-e2e-api-b-2db124-944444fd7-cvvgz\" (UID: \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:22:31.541583 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.541560    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/493c8596-3d51-4d5d-936b-f3bc913ef6c1-maas-api-tls\") pod \"maas-api-e2e-api-b-2db124-944444fd7-cvvgz\" (UID: \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:22:31.552622 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.552601    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hpj6\" (UniqueName: \"kubernetes.io/projected/493c8596-3d51-4d5d-936b-f3bc913ef6c1-kube-api-access-4hpj6\") pod \"maas-api-e2e-api-b-2db124-944444fd7-cvvgz\" (UID: \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:22:31.584603 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.584573    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:22:31.927298 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.927273    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"]
Aug 05 17:22:31.928613 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:22:31.928590    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493c8596_3d51_4d5d_936b_f3bc913ef6c1.slice/crio-9a4e00e935e30f6f202642b45e1df199e0e8dffa6a1b2f1de1b87e4814095896 WatchSource:0}: Error finding container 9a4e00e935e30f6f202642b45e1df199e0e8dffa6a1b2f1de1b87e4814095896: Status 404 returned error can't find the container with id 9a4e00e935e30f6f202642b45e1df199e0e8dffa6a1b2f1de1b87e4814095896
Aug 05 17:22:31.971173 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:31.971147    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz" event={"ID":"493c8596-3d51-4d5d-936b-f3bc913ef6c1","Type":"ContainerStarted","Data":"9a4e00e935e30f6f202642b45e1df199e0e8dffa6a1b2f1de1b87e4814095896"}
Aug 05 17:22:32.464641 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.464603    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:32.599414 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.599365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:32.723623 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.723546    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"]
Aug 05 17:22:32.726992 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.726973    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"
Aug 05 17:22:32.729993 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.729972    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-2db124\""
Aug 05 17:22:32.746942 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.746920    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"]
Aug 05 17:22:32.851605 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.851579    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbddb\" (UniqueName: \"kubernetes.io/projected/8b819e1a-c343-4646-b13d-7001f23e6fde-kube-api-access-hbddb\") pod \"payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl\" (UID: \"8b819e1a-c343-4646-b13d-7001f23e6fde\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"
Aug 05 17:22:32.851744 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.851654    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b819e1a-c343-4646-b13d-7001f23e6fde-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl\" (UID: \"8b819e1a-c343-4646-b13d-7001f23e6fde\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"
Aug 05 17:22:32.952568 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.952526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b819e1a-c343-4646-b13d-7001f23e6fde-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl\" (UID: \"8b819e1a-c343-4646-b13d-7001f23e6fde\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"
Aug 05 17:22:32.952763 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.952623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbddb\" (UniqueName: \"kubernetes.io/projected/8b819e1a-c343-4646-b13d-7001f23e6fde-kube-api-access-hbddb\") pod \"payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl\" (UID: \"8b819e1a-c343-4646-b13d-7001f23e6fde\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"
Aug 05 17:22:32.953258 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.953239    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b819e1a-c343-4646-b13d-7001f23e6fde-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl\" (UID: \"8b819e1a-c343-4646-b13d-7001f23e6fde\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"
Aug 05 17:22:32.963635 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.963613    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbddb\" (UniqueName: \"kubernetes.io/projected/8b819e1a-c343-4646-b13d-7001f23e6fde-kube-api-access-hbddb\") pod \"payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl\" (UID: \"8b819e1a-c343-4646-b13d-7001f23e6fde\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"
Aug 05 17:22:32.977401 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.977321    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz" event={"ID":"493c8596-3d51-4d5d-936b-f3bc913ef6c1","Type":"ContainerStarted","Data":"cd8418f0118e2a3af9b2da73f2a1cc13634ba19ab6aea8652d490b44c0cfc5e3"}
Aug 05 17:22:32.977515 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.977454    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:22:32.989561 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.989533    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"]
Aug 05 17:22:32.993283 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.993267    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"
Aug 05 17:22:32.997143 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:32.997127    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-2db124-dockercfg-h2nvh\""
Aug 05 17:22:33.015766 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.015725    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz" podStartSLOduration=1.411640094 podStartE2EDuration="2.01571277s" totalImagesPullingTime="604.072676ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:33.012547495 +0000 UTC m=+2607.462093795" watchObservedRunningTime="2026-08-05 17:22:33.01571277 +0000 UTC m=+2607.465259069"
Aug 05 17:22:33.015904 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.015875    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"]
Aug 05 17:22:33.036802 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.036777    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"
Aug 05 17:22:33.155406 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.155372    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfxvp\" (UniqueName: \"kubernetes.io/projected/598b3971-acf9-4a11-a595-35bda4973d34-kube-api-access-rfxvp\") pod \"payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq\" (UID: \"598b3971-acf9-4a11-a595-35bda4973d34\") " pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"
Aug 05 17:22:33.155585 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.155503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/598b3971-acf9-4a11-a595-35bda4973d34-plugins-config-volume\") pod \"payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq\" (UID: \"598b3971-acf9-4a11-a595-35bda4973d34\") " pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"
Aug 05 17:22:33.176604 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.176507    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"]
Aug 05 17:22:33.179305 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:22:33.179280    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b819e1a_c343_4646_b13d_7001f23e6fde.slice/crio-3e679824f12b7156c95788cc5d35711ec5ace9904bc27511a43b1fdfddf53c6f WatchSource:0}: Error finding container 3e679824f12b7156c95788cc5d35711ec5ace9904bc27511a43b1fdfddf53c6f: Status 404 returned error can't find the container with id 3e679824f12b7156c95788cc5d35711ec5ace9904bc27511a43b1fdfddf53c6f
Aug 05 17:22:33.256256 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.256231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfxvp\" (UniqueName: \"kubernetes.io/projected/598b3971-acf9-4a11-a595-35bda4973d34-kube-api-access-rfxvp\") pod \"payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq\" (UID: \"598b3971-acf9-4a11-a595-35bda4973d34\") " pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"
Aug 05 17:22:33.256369 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.256322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/598b3971-acf9-4a11-a595-35bda4973d34-plugins-config-volume\") pod \"payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq\" (UID: \"598b3971-acf9-4a11-a595-35bda4973d34\") " pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"
Aug 05 17:22:33.256932 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.256916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/598b3971-acf9-4a11-a595-35bda4973d34-plugins-config-volume\") pod \"payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq\" (UID: \"598b3971-acf9-4a11-a595-35bda4973d34\") " pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"
Aug 05 17:22:33.267492 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.267472    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfxvp\" (UniqueName: \"kubernetes.io/projected/598b3971-acf9-4a11-a595-35bda4973d34-kube-api-access-rfxvp\") pod \"payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq\" (UID: \"598b3971-acf9-4a11-a595-35bda4973d34\") " pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"
Aug 05 17:22:33.303481 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.303463    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"
Aug 05 17:22:33.442047 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.442026    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"]
Aug 05 17:22:33.443990 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:22:33.443965    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod598b3971_acf9_4a11_a595_35bda4973d34.slice/crio-06c7d5d5411a624103a08b279e552f1cb86e2e29bb5c0bed79823340e8d8bcf2 WatchSource:0}: Error finding container 06c7d5d5411a624103a08b279e552f1cb86e2e29bb5c0bed79823340e8d8bcf2: Status 404 returned error can't find the container with id 06c7d5d5411a624103a08b279e552f1cb86e2e29bb5c0bed79823340e8d8bcf2
Aug 05 17:22:33.984417 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.984381    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl" event={"ID":"8b819e1a-c343-4646-b13d-7001f23e6fde","Type":"ContainerStarted","Data":"bfb11d7fb604a6650b261ae5018bbd45f2be629b21d2683a6419333fd91bc7c4"}
Aug 05 17:22:33.984887 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.984433    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl" event={"ID":"8b819e1a-c343-4646-b13d-7001f23e6fde","Type":"ContainerStarted","Data":"3e679824f12b7156c95788cc5d35711ec5ace9904bc27511a43b1fdfddf53c6f"}
Aug 05 17:22:33.984887 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.984482    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"
Aug 05 17:22:33.985968 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.985943    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq" event={"ID":"598b3971-acf9-4a11-a595-35bda4973d34","Type":"ContainerStarted","Data":"592b045f08a7a75691da56436ba2eafcfe014b2c4740dd6b42515eccfaada2c3"}
Aug 05 17:22:33.986110 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.985983    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq" event={"ID":"598b3971-acf9-4a11-a595-35bda4973d34","Type":"ContainerStarted","Data":"06c7d5d5411a624103a08b279e552f1cb86e2e29bb5c0bed79823340e8d8bcf2"}
Aug 05 17:22:33.986110 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:33.986020    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"
Aug 05 17:22:34.011494 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:34.011439    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl" podStartSLOduration=2.011421687 podStartE2EDuration="2.011421687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:34.008964199 +0000 UTC m=+2608.458510497" watchObservedRunningTime="2026-08-05 17:22:34.011421687 +0000 UTC m=+2608.460967989"
Aug 05 17:22:34.036817 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:34.036761    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq" podStartSLOduration=2.036743519 podStartE2EDuration="2.036743519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:34.035317015 +0000 UTC m=+2608.484863314" watchObservedRunningTime="2026-08-05 17:22:34.036743519 +0000 UTC m=+2608.486289820"
Aug 05 17:22:35.323979 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:35.323946    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:22:38.991427 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:38.991399    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:22:44.993771 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:44.993728    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"
Aug 05 17:22:44.994239 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:22:44.993845    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"
Aug 05 17:23:00.326044 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:00.326001    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:06.286901 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:06.286863    2575 scope.go:117] "RemoveContainer" containerID="d21615d3cb9abaffc93543e7418a925ba5cb69b96f91a227cfd8730c1de47586"
Aug 05 17:23:18.974490 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:18.974463    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"]
Aug 05 17:23:18.974897 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:18.974678    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c" podUID="adf5eb0a-d79b-407f-a0b9-30ef668fd846" containerName="maas-api" containerID="cri-o://532830681a6c2bc199948a513ce687ff1d1b35b98d4ea9108b907ae7c155fa6a" gracePeriod=30
Aug 05 17:23:19.016794 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.016762    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:19.038944 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.038920    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"]
Aug 05 17:23:19.039142 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.039120    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2" podUID="736cd3c8-ddc6-42d0-9921-8d404ee3b126" containerName="payload-processing" containerID="cri-o://1e36fb8cd6511c7b17e410ad5d2d3114d11cda80e8581a45f0357fa030817342" gracePeriod=30
Aug 05 17:23:19.050426 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.050400    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"]
Aug 05 17:23:19.050597 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.050576    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v" podUID="e3db06ce-20d6-49a3-be01-76fc3edd27e5" containerName="payload-pre-processing" containerID="cri-o://ffee6b2a0630868be2f10a89b1848889200dab27f6bab797fd51d6edef7e9ecb" gracePeriod=30
Aug 05 17:23:19.114486 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.114453    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:19.209661 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.209476    2575 generic.go:356] "Generic (PLEG): container finished" podID="adf5eb0a-d79b-407f-a0b9-30ef668fd846" containerID="532830681a6c2bc199948a513ce687ff1d1b35b98d4ea9108b907ae7c155fa6a" exitCode=0
Aug 05 17:23:19.209661 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.209548    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c" event={"ID":"adf5eb0a-d79b-407f-a0b9-30ef668fd846","Type":"ContainerDied","Data":"532830681a6c2bc199948a513ce687ff1d1b35b98d4ea9108b907ae7c155fa6a"}
Aug 05 17:23:19.212117 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.211556    2575 generic.go:356] "Generic (PLEG): container finished" podID="736cd3c8-ddc6-42d0-9921-8d404ee3b126" containerID="1e36fb8cd6511c7b17e410ad5d2d3114d11cda80e8581a45f0357fa030817342" exitCode=0
Aug 05 17:23:19.212117 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.211644    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2" event={"ID":"736cd3c8-ddc6-42d0-9921-8d404ee3b126","Type":"ContainerDied","Data":"1e36fb8cd6511c7b17e410ad5d2d3114d11cda80e8581a45f0357fa030817342"}
Aug 05 17:23:19.213579 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.213556    2575 generic.go:356] "Generic (PLEG): container finished" podID="e3db06ce-20d6-49a3-be01-76fc3edd27e5" containerID="ffee6b2a0630868be2f10a89b1848889200dab27f6bab797fd51d6edef7e9ecb" exitCode=0
Aug 05 17:23:19.213652 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.213594    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v" event={"ID":"e3db06ce-20d6-49a3-be01-76fc3edd27e5","Type":"ContainerDied","Data":"ffee6b2a0630868be2f10a89b1848889200dab27f6bab797fd51d6edef7e9ecb"}
Aug 05 17:23:19.242625 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.242557    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:19.316903 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.316872    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:23:19.328372 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.328348    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"
Aug 05 17:23:19.332394 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.332362    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:19.336994 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.336976    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"
Aug 05 17:23:19.472325 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.472293    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gk7g\" (UniqueName: \"kubernetes.io/projected/adf5eb0a-d79b-407f-a0b9-30ef668fd846-kube-api-access-2gk7g\") pod \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\" (UID: \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\") "
Aug 05 17:23:19.472325 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.472321    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xwlk\" (UniqueName: \"kubernetes.io/projected/736cd3c8-ddc6-42d0-9921-8d404ee3b126-kube-api-access-9xwlk\") pod \"736cd3c8-ddc6-42d0-9921-8d404ee3b126\" (UID: \"736cd3c8-ddc6-42d0-9921-8d404ee3b126\") "
Aug 05 17:23:19.472566 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.472361    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf5eb0a-d79b-407f-a0b9-30ef668fd846-maas-api-tls\") pod \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\" (UID: \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\") "
Aug 05 17:23:19.472566 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.472385    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf5eb0a-d79b-407f-a0b9-30ef668fd846-openshift-service-ca\") pod \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\" (UID: \"adf5eb0a-d79b-407f-a0b9-30ef668fd846\") "
Aug 05 17:23:19.472566 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.472439    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3db06ce-20d6-49a3-be01-76fc3edd27e5-plugins-config-volume\") pod \"e3db06ce-20d6-49a3-be01-76fc3edd27e5\" (UID: \"e3db06ce-20d6-49a3-be01-76fc3edd27e5\") "
Aug 05 17:23:19.472566 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.472457    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhr4p\" (UniqueName: \"kubernetes.io/projected/e3db06ce-20d6-49a3-be01-76fc3edd27e5-kube-api-access-bhr4p\") pod \"e3db06ce-20d6-49a3-be01-76fc3edd27e5\" (UID: \"e3db06ce-20d6-49a3-be01-76fc3edd27e5\") "
Aug 05 17:23:19.472778 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.472679    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/736cd3c8-ddc6-42d0-9921-8d404ee3b126-plugins-config-volume\") pod \"736cd3c8-ddc6-42d0-9921-8d404ee3b126\" (UID: \"736cd3c8-ddc6-42d0-9921-8d404ee3b126\") "
Aug 05 17:23:19.472875 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.472848    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf5eb0a-d79b-407f-a0b9-30ef668fd846-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "adf5eb0a-d79b-407f-a0b9-30ef668fd846" (UID: "adf5eb0a-d79b-407f-a0b9-30ef668fd846"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:23:19.473149 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.473124    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf5eb0a-d79b-407f-a0b9-30ef668fd846-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:19.473149 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.473119    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3db06ce-20d6-49a3-be01-76fc3edd27e5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e3db06ce-20d6-49a3-be01-76fc3edd27e5" (UID: "e3db06ce-20d6-49a3-be01-76fc3edd27e5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:23:19.473337 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.473148    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736cd3c8-ddc6-42d0-9921-8d404ee3b126-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "736cd3c8-ddc6-42d0-9921-8d404ee3b126" (UID: "736cd3c8-ddc6-42d0-9921-8d404ee3b126"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:23:19.474620 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.474595    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3db06ce-20d6-49a3-be01-76fc3edd27e5-kube-api-access-bhr4p" (OuterVolumeSpecName: "kube-api-access-bhr4p") pod "e3db06ce-20d6-49a3-be01-76fc3edd27e5" (UID: "e3db06ce-20d6-49a3-be01-76fc3edd27e5"). InnerVolumeSpecName "kube-api-access-bhr4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:23:19.474716 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.474631    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/736cd3c8-ddc6-42d0-9921-8d404ee3b126-kube-api-access-9xwlk" (OuterVolumeSpecName: "kube-api-access-9xwlk") pod "736cd3c8-ddc6-42d0-9921-8d404ee3b126" (UID: "736cd3c8-ddc6-42d0-9921-8d404ee3b126"). InnerVolumeSpecName "kube-api-access-9xwlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:23:19.474853 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.474830    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf5eb0a-d79b-407f-a0b9-30ef668fd846-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "adf5eb0a-d79b-407f-a0b9-30ef668fd846" (UID: "adf5eb0a-d79b-407f-a0b9-30ef668fd846"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:23:19.474946 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.474908    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf5eb0a-d79b-407f-a0b9-30ef668fd846-kube-api-access-2gk7g" (OuterVolumeSpecName: "kube-api-access-2gk7g") pod "adf5eb0a-d79b-407f-a0b9-30ef668fd846" (UID: "adf5eb0a-d79b-407f-a0b9-30ef668fd846"). InnerVolumeSpecName "kube-api-access-2gk7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:23:19.574299 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.574205    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf5eb0a-d79b-407f-a0b9-30ef668fd846-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:19.574299 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.574236    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3db06ce-20d6-49a3-be01-76fc3edd27e5-plugins-config-volume\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:19.574299 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.574248    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhr4p\" (UniqueName: \"kubernetes.io/projected/e3db06ce-20d6-49a3-be01-76fc3edd27e5-kube-api-access-bhr4p\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:19.574299 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.574262    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/736cd3c8-ddc6-42d0-9921-8d404ee3b126-plugins-config-volume\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:19.574299 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.574275    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gk7g\" (UniqueName: \"kubernetes.io/projected/adf5eb0a-d79b-407f-a0b9-30ef668fd846-kube-api-access-2gk7g\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:19.574299 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.574287    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xwlk\" (UniqueName: \"kubernetes.io/projected/736cd3c8-ddc6-42d0-9921-8d404ee3b126-kube-api-access-9xwlk\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:19.668929 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:19.668884    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:20.220287 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.220258    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"
Aug 05 17:23:20.220709 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.220259    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c" event={"ID":"adf5eb0a-d79b-407f-a0b9-30ef668fd846","Type":"ContainerDied","Data":"b5c5dcecfdc70f3f9f46b298d9c36512dd6f99e95ba9560d3a1803e62c9a0aca"}
Aug 05 17:23:20.220709 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.220406    2575 scope.go:117] "RemoveContainer" containerID="532830681a6c2bc199948a513ce687ff1d1b35b98d4ea9108b907ae7c155fa6a"
Aug 05 17:23:20.221830 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.221785    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"
Aug 05 17:23:20.221915 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.221844    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2" event={"ID":"736cd3c8-ddc6-42d0-9921-8d404ee3b126","Type":"ContainerDied","Data":"bc254ff0f7d65ad5d94ea29618c1cdae894cfeee0be55edc3534c3214e55ceb5"}
Aug 05 17:23:20.223456 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.223439    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"
Aug 05 17:23:20.223594 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.223436    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v" event={"ID":"e3db06ce-20d6-49a3-be01-76fc3edd27e5","Type":"ContainerDied","Data":"36574d9565c5337320a17df678528a9878b260cc0e8f4685f85ed63fa39bacbd"}
Aug 05 17:23:20.230205 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.230184    2575 scope.go:117] "RemoveContainer" containerID="1e36fb8cd6511c7b17e410ad5d2d3114d11cda80e8581a45f0357fa030817342"
Aug 05 17:23:20.237537 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.237522    2575 scope.go:117] "RemoveContainer" containerID="ffee6b2a0630868be2f10a89b1848889200dab27f6bab797fd51d6edef7e9ecb"
Aug 05 17:23:20.248837 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.248801    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"]
Aug 05 17:23:20.254473 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.254450    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5e257e-86c6745694-cjv6c"]
Aug 05 17:23:20.280032 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.280006    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"]
Aug 05 17:23:20.284116 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.284098    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5e257e-596bf86966-9wwb2"]
Aug 05 17:23:20.309515 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.309490    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"]
Aug 05 17:23:20.325630 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:20.325609    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5e257e-59759486fb-2q29v"]
Aug 05 17:23:21.506344 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:21.506312    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:23:22.013604 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:22.013562    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="736cd3c8-ddc6-42d0-9921-8d404ee3b126" path="/var/lib/kubelet/pods/736cd3c8-ddc6-42d0-9921-8d404ee3b126/volumes"
Aug 05 17:23:22.014083 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:22.014062    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adf5eb0a-d79b-407f-a0b9-30ef668fd846" path="/var/lib/kubelet/pods/adf5eb0a-d79b-407f-a0b9-30ef668fd846/volumes"
Aug 05 17:23:22.014461 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:22.014442    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3db06ce-20d6-49a3-be01-76fc3edd27e5" path="/var/lib/kubelet/pods/e3db06ce-20d6-49a3-be01-76fc3edd27e5/volumes"
Aug 05 17:23:25.926567 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:25.926528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:25.990543 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:25.990511    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:26.224906 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.224820    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:26.448024 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.447982    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:26.566411 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.566340    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x"]
Aug 05 17:23:26.566721 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.566708    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf5eb0a-d79b-407f-a0b9-30ef668fd846" containerName="maas-api"
Aug 05 17:23:26.566765 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.566724    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf5eb0a-d79b-407f-a0b9-30ef668fd846" containerName="maas-api"
Aug 05 17:23:26.566765 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.566735    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3db06ce-20d6-49a3-be01-76fc3edd27e5" containerName="payload-pre-processing"
Aug 05 17:23:26.566765 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.566741    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3db06ce-20d6-49a3-be01-76fc3edd27e5" containerName="payload-pre-processing"
Aug 05 17:23:26.566765 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.566750    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="736cd3c8-ddc6-42d0-9921-8d404ee3b126" containerName="payload-processing"
Aug 05 17:23:26.566765 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.566755    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="736cd3c8-ddc6-42d0-9921-8d404ee3b126" containerName="payload-processing"
Aug 05 17:23:26.566944 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.566843    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf5eb0a-d79b-407f-a0b9-30ef668fd846" containerName="maas-api"
Aug 05 17:23:26.566944 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.566857    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3db06ce-20d6-49a3-be01-76fc3edd27e5" containerName="payload-pre-processing"
Aug 05 17:23:26.566944 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.566867    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="736cd3c8-ddc6-42d0-9921-8d404ee3b126" containerName="payload-processing"
Aug 05 17:23:26.571289 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.571269    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x"
Aug 05 17:23:26.573474 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.573458    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:23:26.579057 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.579036    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x"]
Aug 05 17:23:26.635233 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.635203    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da3ace36-7860-4bc7-a32e-853bf29a9d4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2db124-hwh8x\" (UID: \"da3ace36-7860-4bc7-a32e-853bf29a9d4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x"
Aug 05 17:23:26.735993 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.735967    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da3ace36-7860-4bc7-a32e-853bf29a9d4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2db124-hwh8x\" (UID: \"da3ace36-7860-4bc7-a32e-853bf29a9d4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x"
Aug 05 17:23:26.736547 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.736530    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da3ace36-7860-4bc7-a32e-853bf29a9d4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-2db124-hwh8x\" (UID: \"da3ace36-7860-4bc7-a32e-853bf29a9d4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x"
Aug 05 17:23:26.882980 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:26.882888    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x"
Aug 05 17:23:27.030941 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:27.030912    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x"]
Aug 05 17:23:27.033585 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:23:27.033554    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3ace36_7860_4bc7_a32e_853bf29a9d4d.slice/crio-f7b966ea97e17c98db61d1f2ccc912fd5a6f35705590511470825cc111f07cff WatchSource:0}: Error finding container f7b966ea97e17c98db61d1f2ccc912fd5a6f35705590511470825cc111f07cff: Status 404 returned error can't find the container with id f7b966ea97e17c98db61d1f2ccc912fd5a6f35705590511470825cc111f07cff
Aug 05 17:23:27.264042 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:27.264012    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x" event={"ID":"da3ace36-7860-4bc7-a32e-853bf29a9d4d","Type":"ContainerStarted","Data":"f7b966ea97e17c98db61d1f2ccc912fd5a6f35705590511470825cc111f07cff"}
Aug 05 17:23:28.270065 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:28.270035    2575 generic.go:356] "Generic (PLEG): container finished" podID="da3ace36-7860-4bc7-a32e-853bf29a9d4d" containerID="73c5f0d88cf1330cca5acd501998dd69e265c1d6184f7e6727812d6d01ae7b5a" exitCode=0
Aug 05 17:23:28.270449 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:28.270081    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x" event={"ID":"da3ace36-7860-4bc7-a32e-853bf29a9d4d","Type":"ContainerDied","Data":"73c5f0d88cf1330cca5acd501998dd69e265c1d6184f7e6727812d6d01ae7b5a"}
Aug 05 17:23:29.406646 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:29.406620    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x"
Aug 05 17:23:29.454898 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:29.454869    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da3ace36-7860-4bc7-a32e-853bf29a9d4d-maas-api-service-ca\") pod \"da3ace36-7860-4bc7-a32e-853bf29a9d4d\" (UID: \"da3ace36-7860-4bc7-a32e-853bf29a9d4d\") "
Aug 05 17:23:29.455182 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:29.455162    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da3ace36-7860-4bc7-a32e-853bf29a9d4d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "da3ace36-7860-4bc7-a32e-853bf29a9d4d" (UID: "da3ace36-7860-4bc7-a32e-853bf29a9d4d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:23:29.556593 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:29.556508    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da3ace36-7860-4bc7-a32e-853bf29a9d4d-maas-api-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:30.280706 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:30.280612    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x"
Aug 05 17:23:30.280706 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:30.280645    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x" event={"ID":"da3ace36-7860-4bc7-a32e-853bf29a9d4d","Type":"ContainerDied","Data":"f7b966ea97e17c98db61d1f2ccc912fd5a6f35705590511470825cc111f07cff"}
Aug 05 17:23:30.280706 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:30.280700    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7b966ea97e17c98db61d1f2ccc912fd5a6f35705590511470825cc111f07cff"
Aug 05 17:23:42.096348 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.096305    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"]
Aug 05 17:23:42.096899 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.096528    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz" podUID="493c8596-3d51-4d5d-936b-f3bc913ef6c1" containerName="maas-api" containerID="cri-o://cd8418f0118e2a3af9b2da73f2a1cc13634ba19ab6aea8652d490b44c0cfc5e3" gracePeriod=30
Aug 05 17:23:42.115985 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.115955    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:42.146670 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.146644    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"]
Aug 05 17:23:42.146874 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.146851    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq" podUID="598b3971-acf9-4a11-a595-35bda4973d34" containerName="payload-processing" containerID="cri-o://592b045f08a7a75691da56436ba2eafcfe014b2c4740dd6b42515eccfaada2c3" gracePeriod=30
Aug 05 17:23:42.155994 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.155947    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"]
Aug 05 17:23:42.156426 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.156323    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl" podUID="8b819e1a-c343-4646-b13d-7001f23e6fde" containerName="payload-pre-processing" containerID="cri-o://bfb11d7fb604a6650b261ae5018bbd45f2be629b21d2683a6419333fd91bc7c4" gracePeriod=30
Aug 05 17:23:42.216509 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.216482    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:42.302411 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.302357    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x"]
Aug 05 17:23:42.305570 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.305543    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2db124-hwh8x"]
Aug 05 17:23:42.310249 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.310193    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:42.343268 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.343215    2575 generic.go:356] "Generic (PLEG): container finished" podID="493c8596-3d51-4d5d-936b-f3bc913ef6c1" containerID="cd8418f0118e2a3af9b2da73f2a1cc13634ba19ab6aea8652d490b44c0cfc5e3" exitCode=0
Aug 05 17:23:42.343651 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.343341    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz" event={"ID":"493c8596-3d51-4d5d-936b-f3bc913ef6c1","Type":"ContainerDied","Data":"cd8418f0118e2a3af9b2da73f2a1cc13634ba19ab6aea8652d490b44c0cfc5e3"}
Aug 05 17:23:42.345267 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.345240    2575 generic.go:356] "Generic (PLEG): container finished" podID="8b819e1a-c343-4646-b13d-7001f23e6fde" containerID="bfb11d7fb604a6650b261ae5018bbd45f2be629b21d2683a6419333fd91bc7c4" exitCode=0
Aug 05 17:23:42.345374 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.345311    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl" event={"ID":"8b819e1a-c343-4646-b13d-7001f23e6fde","Type":"ContainerDied","Data":"bfb11d7fb604a6650b261ae5018bbd45f2be629b21d2683a6419333fd91bc7c4"}
Aug 05 17:23:42.347078 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.347014    2575 generic.go:356] "Generic (PLEG): container finished" podID="598b3971-acf9-4a11-a595-35bda4973d34" containerID="592b045f08a7a75691da56436ba2eafcfe014b2c4740dd6b42515eccfaada2c3" exitCode=0
Aug 05 17:23:42.347078 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.347053    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq" event={"ID":"598b3971-acf9-4a11-a595-35bda4973d34","Type":"ContainerDied","Data":"592b045f08a7a75691da56436ba2eafcfe014b2c4740dd6b42515eccfaada2c3"}
Aug 05 17:23:42.376633 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.376597    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:42.409880 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.409856    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"
Aug 05 17:23:42.448008 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.447978    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"
Aug 05 17:23:42.456422 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.456402    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:23:42.471596 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.471571    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfxvp\" (UniqueName: \"kubernetes.io/projected/598b3971-acf9-4a11-a595-35bda4973d34-kube-api-access-rfxvp\") pod \"598b3971-acf9-4a11-a595-35bda4973d34\" (UID: \"598b3971-acf9-4a11-a595-35bda4973d34\") "
Aug 05 17:23:42.471725 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.471698    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/598b3971-acf9-4a11-a595-35bda4973d34-plugins-config-volume\") pod \"598b3971-acf9-4a11-a595-35bda4973d34\" (UID: \"598b3971-acf9-4a11-a595-35bda4973d34\") "
Aug 05 17:23:42.472093 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.472068    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/598b3971-acf9-4a11-a595-35bda4973d34-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "598b3971-acf9-4a11-a595-35bda4973d34" (UID: "598b3971-acf9-4a11-a595-35bda4973d34"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:23:42.474024 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.474000    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/598b3971-acf9-4a11-a595-35bda4973d34-kube-api-access-rfxvp" (OuterVolumeSpecName: "kube-api-access-rfxvp") pod "598b3971-acf9-4a11-a595-35bda4973d34" (UID: "598b3971-acf9-4a11-a595-35bda4973d34"). InnerVolumeSpecName "kube-api-access-rfxvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:23:42.572511 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.572482    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/493c8596-3d51-4d5d-936b-f3bc913ef6c1-openshift-service-ca\") pod \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\" (UID: \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\") "
Aug 05 17:23:42.572511 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.572516    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbddb\" (UniqueName: \"kubernetes.io/projected/8b819e1a-c343-4646-b13d-7001f23e6fde-kube-api-access-hbddb\") pod \"8b819e1a-c343-4646-b13d-7001f23e6fde\" (UID: \"8b819e1a-c343-4646-b13d-7001f23e6fde\") "
Aug 05 17:23:42.572723 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.572557    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/493c8596-3d51-4d5d-936b-f3bc913ef6c1-maas-api-tls\") pod \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\" (UID: \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\") "
Aug 05 17:23:42.572723 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.572582    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hpj6\" (UniqueName: \"kubernetes.io/projected/493c8596-3d51-4d5d-936b-f3bc913ef6c1-kube-api-access-4hpj6\") pod \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\" (UID: \"493c8596-3d51-4d5d-936b-f3bc913ef6c1\") "
Aug 05 17:23:42.572723 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.572682    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b819e1a-c343-4646-b13d-7001f23e6fde-plugins-config-volume\") pod \"8b819e1a-c343-4646-b13d-7001f23e6fde\" (UID: \"8b819e1a-c343-4646-b13d-7001f23e6fde\") "
Aug 05 17:23:42.572934 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.572904    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/493c8596-3d51-4d5d-936b-f3bc913ef6c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "493c8596-3d51-4d5d-936b-f3bc913ef6c1" (UID: "493c8596-3d51-4d5d-936b-f3bc913ef6c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:23:42.573151 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.573123    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfxvp\" (UniqueName: \"kubernetes.io/projected/598b3971-acf9-4a11-a595-35bda4973d34-kube-api-access-rfxvp\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:42.573258 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.573158    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/598b3971-acf9-4a11-a595-35bda4973d34-plugins-config-volume\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:42.573258 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.573173    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/493c8596-3d51-4d5d-936b-f3bc913ef6c1-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:42.573258 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.573123    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b819e1a-c343-4646-b13d-7001f23e6fde-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8b819e1a-c343-4646-b13d-7001f23e6fde" (UID: "8b819e1a-c343-4646-b13d-7001f23e6fde"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:23:42.574740 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.574717    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493c8596-3d51-4d5d-936b-f3bc913ef6c1-kube-api-access-4hpj6" (OuterVolumeSpecName: "kube-api-access-4hpj6") pod "493c8596-3d51-4d5d-936b-f3bc913ef6c1" (UID: "493c8596-3d51-4d5d-936b-f3bc913ef6c1"). InnerVolumeSpecName "kube-api-access-4hpj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:23:42.574875 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.574767    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493c8596-3d51-4d5d-936b-f3bc913ef6c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "493c8596-3d51-4d5d-936b-f3bc913ef6c1" (UID: "493c8596-3d51-4d5d-936b-f3bc913ef6c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:23:42.574875 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.574764    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b819e1a-c343-4646-b13d-7001f23e6fde-kube-api-access-hbddb" (OuterVolumeSpecName: "kube-api-access-hbddb") pod "8b819e1a-c343-4646-b13d-7001f23e6fde" (UID: "8b819e1a-c343-4646-b13d-7001f23e6fde"). InnerVolumeSpecName "kube-api-access-hbddb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:23:42.674422 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.674393    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/493c8596-3d51-4d5d-936b-f3bc913ef6c1-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:42.674422 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.674423    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hpj6\" (UniqueName: \"kubernetes.io/projected/493c8596-3d51-4d5d-936b-f3bc913ef6c1-kube-api-access-4hpj6\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:42.674613 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.674433    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b819e1a-c343-4646-b13d-7001f23e6fde-plugins-config-volume\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:42.674613 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.674442    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbddb\" (UniqueName: \"kubernetes.io/projected/8b819e1a-c343-4646-b13d-7001f23e6fde-kube-api-access-hbddb\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:23:42.771981 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:42.771944    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:43.352693 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.352669    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"
Aug 05 17:23:43.353166 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.352714    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq" event={"ID":"598b3971-acf9-4a11-a595-35bda4973d34","Type":"ContainerDied","Data":"06c7d5d5411a624103a08b279e552f1cb86e2e29bb5c0bed79823340e8d8bcf2"}
Aug 05 17:23:43.353166 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.352776    2575 scope.go:117] "RemoveContainer" containerID="592b045f08a7a75691da56436ba2eafcfe014b2c4740dd6b42515eccfaada2c3"
Aug 05 17:23:43.354083 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.354065    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"
Aug 05 17:23:43.354146 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.354085    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz" event={"ID":"493c8596-3d51-4d5d-936b-f3bc913ef6c1","Type":"ContainerDied","Data":"9a4e00e935e30f6f202642b45e1df199e0e8dffa6a1b2f1de1b87e4814095896"}
Aug 05 17:23:43.355556 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.355533    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"
Aug 05 17:23:43.355660 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.355529    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl" event={"ID":"8b819e1a-c343-4646-b13d-7001f23e6fde","Type":"ContainerDied","Data":"3e679824f12b7156c95788cc5d35711ec5ace9904bc27511a43b1fdfddf53c6f"}
Aug 05 17:23:43.362675 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.362577    2575 scope.go:117] "RemoveContainer" containerID="cd8418f0118e2a3af9b2da73f2a1cc13634ba19ab6aea8652d490b44c0cfc5e3"
Aug 05 17:23:43.370883 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.370866    2575 scope.go:117] "RemoveContainer" containerID="bfb11d7fb604a6650b261ae5018bbd45f2be629b21d2683a6419333fd91bc7c4"
Aug 05 17:23:43.380091 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.380071    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"]
Aug 05 17:23:43.382848 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.382827    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-2db124-7f8b669b8-44jdq"]
Aug 05 17:23:43.396844 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.396820    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"]
Aug 05 17:23:43.405764 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.405742    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-2db124-6564c9f4b8-gggkl"]
Aug 05 17:23:43.416685 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.416667    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"]
Aug 05 17:23:43.422041 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:43.422022    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2db124-944444fd7-cvvgz"]
Aug 05 17:23:44.013782 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:44.013743    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="493c8596-3d51-4d5d-936b-f3bc913ef6c1" path="/var/lib/kubelet/pods/493c8596-3d51-4d5d-936b-f3bc913ef6c1/volumes"
Aug 05 17:23:44.014181 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:44.014160    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="598b3971-acf9-4a11-a595-35bda4973d34" path="/var/lib/kubelet/pods/598b3971-acf9-4a11-a595-35bda4973d34/volumes"
Aug 05 17:23:44.014533 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:44.014514    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b819e1a-c343-4646-b13d-7001f23e6fde" path="/var/lib/kubelet/pods/8b819e1a-c343-4646-b13d-7001f23e6fde/volumes"
Aug 05 17:23:44.014867 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:44.014851    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da3ace36-7860-4bc7-a32e-853bf29a9d4d" path="/var/lib/kubelet/pods/da3ace36-7860-4bc7-a32e-853bf29a9d4d/volumes"
Aug 05 17:23:44.281336 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:44.281259    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:23:48.928330 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:48.928294    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:48.989950 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:48.989909    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:49.248155 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:49.248059    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:49.484650 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:49.484609    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:49.844094 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:49.844059    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:50.201684 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:50.201646    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:50.612708 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:50.612620    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:53.571566 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:53.571526    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:53.667051 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:53.667017    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:54.703402 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.703367    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"]
Aug 05 17:23:54.703764 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.703714    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493c8596-3d51-4d5d-936b-f3bc913ef6c1" containerName="maas-api"
Aug 05 17:23:54.703764 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.703731    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="493c8596-3d51-4d5d-936b-f3bc913ef6c1" containerName="maas-api"
Aug 05 17:23:54.703764 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.703740    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da3ace36-7860-4bc7-a32e-853bf29a9d4d" containerName="revoke-keys"
Aug 05 17:23:54.703764 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.703745    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="da3ace36-7860-4bc7-a32e-853bf29a9d4d" containerName="revoke-keys"
Aug 05 17:23:54.703764 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.703760    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b819e1a-c343-4646-b13d-7001f23e6fde" containerName="payload-pre-processing"
Aug 05 17:23:54.703764 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.703765    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b819e1a-c343-4646-b13d-7001f23e6fde" containerName="payload-pre-processing"
Aug 05 17:23:54.704029 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.703774    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="598b3971-acf9-4a11-a595-35bda4973d34" containerName="payload-processing"
Aug 05 17:23:54.704029 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.703779    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="598b3971-acf9-4a11-a595-35bda4973d34" containerName="payload-processing"
Aug 05 17:23:54.704029 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.703858    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="493c8596-3d51-4d5d-936b-f3bc913ef6c1" containerName="maas-api"
Aug 05 17:23:54.704029 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.703871    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="598b3971-acf9-4a11-a595-35bda4973d34" containerName="payload-processing"
Aug 05 17:23:54.704029 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.703879    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b819e1a-c343-4646-b13d-7001f23e6fde" containerName="payload-pre-processing"
Aug 05 17:23:54.704029 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.703885    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="da3ace36-7860-4bc7-a32e-853bf29a9d4d" containerName="revoke-keys"
Aug 05 17:23:54.707167 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.707151    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:23:54.711918 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.710586    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-a1e09f-serving-cert\""
Aug 05 17:23:54.711918 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.710800    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nplzm\""
Aug 05 17:23:54.711918 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.711332    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 17:23:54.717724 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.717705    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:23:54.730788 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.730763    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"]
Aug 05 17:23:54.762176 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.762152    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:54.789505 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.789472    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6lx6\" (UniqueName: \"kubernetes.io/projected/6f8ce195-061b-4dc8-a0bd-58e400400047-kube-api-access-z6lx6\") pod \"maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4\" (UID: \"6f8ce195-061b-4dc8-a0bd-58e400400047\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:23:54.789696 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.789679    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8ce195-061b-4dc8-a0bd-58e400400047-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4\" (UID: \"6f8ce195-061b-4dc8-a0bd-58e400400047\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:23:54.789770 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.789734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8ce195-061b-4dc8-a0bd-58e400400047-maas-api-tls\") pod \"maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4\" (UID: \"6f8ce195-061b-4dc8-a0bd-58e400400047\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:23:54.891058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.891034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6lx6\" (UniqueName: \"kubernetes.io/projected/6f8ce195-061b-4dc8-a0bd-58e400400047-kube-api-access-z6lx6\") pod \"maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4\" (UID: \"6f8ce195-061b-4dc8-a0bd-58e400400047\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:23:54.891182 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.891090    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8ce195-061b-4dc8-a0bd-58e400400047-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4\" (UID: \"6f8ce195-061b-4dc8-a0bd-58e400400047\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:23:54.891182 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.891113    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8ce195-061b-4dc8-a0bd-58e400400047-maas-api-tls\") pod \"maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4\" (UID: \"6f8ce195-061b-4dc8-a0bd-58e400400047\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:23:54.891300 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:23:54.891278    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-serving-cert: secret "maas-api-e2e-shared-a-a1e09f-serving-cert" not found
Aug 05 17:23:54.891354 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:23:54.891348    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8ce195-061b-4dc8-a0bd-58e400400047-maas-api-tls podName:6f8ce195-061b-4dc8-a0bd-58e400400047 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:55.391328761 +0000 UTC m=+2689.840875050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6f8ce195-061b-4dc8-a0bd-58e400400047-maas-api-tls") pod "maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4" (UID: "6f8ce195-061b-4dc8-a0bd-58e400400047") : secret "maas-api-e2e-shared-a-a1e09f-serving-cert" not found
Aug 05 17:23:54.891675 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.891658    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8ce195-061b-4dc8-a0bd-58e400400047-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4\" (UID: \"6f8ce195-061b-4dc8-a0bd-58e400400047\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:23:54.908430 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:54.908409    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6lx6\" (UniqueName: \"kubernetes.io/projected/6f8ce195-061b-4dc8-a0bd-58e400400047-kube-api-access-z6lx6\") pod \"maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4\" (UID: \"6f8ce195-061b-4dc8-a0bd-58e400400047\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:23:55.223146 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.223111    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:55.395863 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.395802    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8ce195-061b-4dc8-a0bd-58e400400047-maas-api-tls\") pod \"maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4\" (UID: \"6f8ce195-061b-4dc8-a0bd-58e400400047\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:23:55.398232 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.398211    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8ce195-061b-4dc8-a0bd-58e400400047-maas-api-tls\") pod \"maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4\" (UID: \"6f8ce195-061b-4dc8-a0bd-58e400400047\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:23:55.548943 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.548860    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:55.622642 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.622609    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:23:55.643578 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.643547    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:55.748322 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.748292    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"]
Aug 05 17:23:55.752919 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.752896    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"
Aug 05 17:23:55.756464 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.756440    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"]
Aug 05 17:23:55.756589 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.756474    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-a1e09f\""
Aug 05 17:23:55.756819 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.756786    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-a1e09f-dockercfg-45zpw\""
Aug 05 17:23:55.759135 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:23:55.759111    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8ce195_061b_4dc8_a0bd_58e400400047.slice/crio-d0c9d0ac6561ac396ae7d0b75a8b8bd8c03040b0973b86fddae6c5cbda3a30cb WatchSource:0}: Error finding container d0c9d0ac6561ac396ae7d0b75a8b8bd8c03040b0973b86fddae6c5cbda3a30cb: Status 404 returned error can't find the container with id d0c9d0ac6561ac396ae7d0b75a8b8bd8c03040b0973b86fddae6c5cbda3a30cb
Aug 05 17:23:55.766292 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.766053    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"]
Aug 05 17:23:55.832041 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.831971    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"]
Aug 05 17:23:55.835546 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.835530    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"
Aug 05 17:23:55.849380 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.849361    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"]
Aug 05 17:23:55.900704 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.900673    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v224\" (UniqueName: \"kubernetes.io/projected/f5476629-b9fe-41e2-85d6-040c4d86ddca-kube-api-access-4v224\") pod \"payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd\" (UID: \"f5476629-b9fe-41e2-85d6-040c4d86ddca\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"
Aug 05 17:23:55.900861 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:55.900720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5476629-b9fe-41e2-85d6-040c4d86ddca-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd\" (UID: \"f5476629-b9fe-41e2-85d6-040c4d86ddca\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"
Aug 05 17:23:56.001505 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.001463    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nl8l\" (UniqueName: \"kubernetes.io/projected/bf6d32d1-adfe-4fde-9655-f58139588bb1-kube-api-access-2nl8l\") pod \"payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx\" (UID: \"bf6d32d1-adfe-4fde-9655-f58139588bb1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"
Aug 05 17:23:56.001672 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.001519    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5476629-b9fe-41e2-85d6-040c4d86ddca-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd\" (UID: \"f5476629-b9fe-41e2-85d6-040c4d86ddca\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"
Aug 05 17:23:56.001672 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.001649    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf6d32d1-adfe-4fde-9655-f58139588bb1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx\" (UID: \"bf6d32d1-adfe-4fde-9655-f58139588bb1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"
Aug 05 17:23:56.001793 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.001771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v224\" (UniqueName: \"kubernetes.io/projected/f5476629-b9fe-41e2-85d6-040c4d86ddca-kube-api-access-4v224\") pod \"payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd\" (UID: \"f5476629-b9fe-41e2-85d6-040c4d86ddca\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"
Aug 05 17:23:56.002225 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.002208    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5476629-b9fe-41e2-85d6-040c4d86ddca-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd\" (UID: \"f5476629-b9fe-41e2-85d6-040c4d86ddca\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"
Aug 05 17:23:56.010485 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.010464    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v224\" (UniqueName: \"kubernetes.io/projected/f5476629-b9fe-41e2-85d6-040c4d86ddca-kube-api-access-4v224\") pod \"payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd\" (UID: \"f5476629-b9fe-41e2-85d6-040c4d86ddca\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"
Aug 05 17:23:56.074934 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.074906    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"
Aug 05 17:23:56.103258 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.103230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf6d32d1-adfe-4fde-9655-f58139588bb1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx\" (UID: \"bf6d32d1-adfe-4fde-9655-f58139588bb1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"
Aug 05 17:23:56.103381 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.103320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nl8l\" (UniqueName: \"kubernetes.io/projected/bf6d32d1-adfe-4fde-9655-f58139588bb1-kube-api-access-2nl8l\") pod \"payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx\" (UID: \"bf6d32d1-adfe-4fde-9655-f58139588bb1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"
Aug 05 17:23:56.103935 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.103917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf6d32d1-adfe-4fde-9655-f58139588bb1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx\" (UID: \"bf6d32d1-adfe-4fde-9655-f58139588bb1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"
Aug 05 17:23:56.113209 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.113183    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nl8l\" (UniqueName: \"kubernetes.io/projected/bf6d32d1-adfe-4fde-9655-f58139588bb1-kube-api-access-2nl8l\") pod \"payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx\" (UID: \"bf6d32d1-adfe-4fde-9655-f58139588bb1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"
Aug 05 17:23:56.146363 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.146333    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"
Aug 05 17:23:56.221985 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.221958    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"]
Aug 05 17:23:56.223723 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:23:56.223688    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5476629_b9fe_41e2_85d6_040c4d86ddca.slice/crio-548182034e7af7ae345661f2a49409adafabe67d8b94f6f793f2abf53b313614 WatchSource:0}: Error finding container 548182034e7af7ae345661f2a49409adafabe67d8b94f6f793f2abf53b313614: Status 404 returned error can't find the container with id 548182034e7af7ae345661f2a49409adafabe67d8b94f6f793f2abf53b313614
Aug 05 17:23:56.288684 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.288656    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"]
Aug 05 17:23:56.290677 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:23:56.290655    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6d32d1_adfe_4fde_9655_f58139588bb1.slice/crio-ac9e3253c2402dce71b6bc2766dbd0df492a3037ee32dff85e7058b4a5939091 WatchSource:0}: Error finding container ac9e3253c2402dce71b6bc2766dbd0df492a3037ee32dff85e7058b4a5939091: Status 404 returned error can't find the container with id ac9e3253c2402dce71b6bc2766dbd0df492a3037ee32dff85e7058b4a5939091
Aug 05 17:23:56.420233 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.420207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx" event={"ID":"bf6d32d1-adfe-4fde-9655-f58139588bb1","Type":"ContainerStarted","Data":"91d004976aa78c995cdf352d80831b40331c98aa9ca5997e5a3fdb3c5d3663b7"}
Aug 05 17:23:56.420358 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.420254    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx" event={"ID":"bf6d32d1-adfe-4fde-9655-f58139588bb1","Type":"ContainerStarted","Data":"ac9e3253c2402dce71b6bc2766dbd0df492a3037ee32dff85e7058b4a5939091"}
Aug 05 17:23:56.420435 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.420388    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"
Aug 05 17:23:56.421723 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.421697    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd" event={"ID":"f5476629-b9fe-41e2-85d6-040c4d86ddca","Type":"ContainerStarted","Data":"3f84f1c7f2300bd5564e6e8fcf00d6c275a4120085e3a0a7b695a3694bc59e0f"}
Aug 05 17:23:56.421857 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.421744    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd" event={"ID":"f5476629-b9fe-41e2-85d6-040c4d86ddca","Type":"ContainerStarted","Data":"548182034e7af7ae345661f2a49409adafabe67d8b94f6f793f2abf53b313614"}
Aug 05 17:23:56.421857 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.421777    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"
Aug 05 17:23:56.423246 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.423222    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4" event={"ID":"6f8ce195-061b-4dc8-a0bd-58e400400047","Type":"ContainerStarted","Data":"d0c9d0ac6561ac396ae7d0b75a8b8bd8c03040b0973b86fddae6c5cbda3a30cb"}
Aug 05 17:23:56.440118 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.439946    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx" podStartSLOduration=1.439927888 podStartE2EDuration="1.439927888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:56.438634869 +0000 UTC m=+2690.888181168" watchObservedRunningTime="2026-08-05 17:23:56.439927888 +0000 UTC m=+2690.889474169"
Aug 05 17:23:56.465518 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:56.465471    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd" podStartSLOduration=1.4654554260000001 podStartE2EDuration="1.465455426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:56.463496724 +0000 UTC m=+2690.913043022" watchObservedRunningTime="2026-08-05 17:23:56.465455426 +0000 UTC m=+2690.915001724"
Aug 05 17:23:57.431381 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:57.431338    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4" event={"ID":"6f8ce195-061b-4dc8-a0bd-58e400400047","Type":"ContainerStarted","Data":"79e24829edec8b3a4b5b580b4d2bc236397b693e4273a430dca10d2040039877"}
Aug 05 17:23:57.431886 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:57.431602    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:23:57.450214 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:57.450171    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4" podStartSLOduration=2.832704099 podStartE2EDuration="3.450156626s" totalImagesPullingTime="617.452527ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:57.44894971 +0000 UTC m=+2691.898496010" watchObservedRunningTime="2026-08-05 17:23:57.450156626 +0000 UTC m=+2691.899702924"
Aug 05 17:23:57.600154 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:23:57.600114    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:24:03.442183 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:03.442113    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:24:06.155681 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:06.155652    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:24:06.160542 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:06.160519    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:24:07.433629 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:07.433603    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"
Aug 05 17:24:07.434091 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:07.433746    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"
Aug 05 17:24:23.679659 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:23.679621    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:24.046406 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:24.046319    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:24.326634 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:24.326552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:24.487126 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:24.487092    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:27.821993 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:27.821956    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:27.914982 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:27.914949    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:28.893046 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:28.893016    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"]
Aug 05 17:24:28.896707 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:28.896688    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:24:28.899152 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:28.899131    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-a81ee3-serving-cert\""
Aug 05 17:24:28.908240 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:28.908218    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"]
Aug 05 17:24:28.938201 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:28.938167    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:28.995038 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:28.995006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/863022e1-0c17-49ab-b75c-314de1be84fa-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684\" (UID: \"863022e1-0c17-49ab-b75c-314de1be84fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:24:28.995195 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:28.995059    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/863022e1-0c17-49ab-b75c-314de1be84fa-maas-api-tls\") pod \"maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684\" (UID: \"863022e1-0c17-49ab-b75c-314de1be84fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:24:28.995195 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:28.995151    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqtn5\" (UniqueName: \"kubernetes.io/projected/863022e1-0c17-49ab-b75c-314de1be84fa-kube-api-access-fqtn5\") pod \"maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684\" (UID: \"863022e1-0c17-49ab-b75c-314de1be84fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:24:29.096472 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.096433    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqtn5\" (UniqueName: \"kubernetes.io/projected/863022e1-0c17-49ab-b75c-314de1be84fa-kube-api-access-fqtn5\") pod \"maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684\" (UID: \"863022e1-0c17-49ab-b75c-314de1be84fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:24:29.096656 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.096498    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/863022e1-0c17-49ab-b75c-314de1be84fa-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684\" (UID: \"863022e1-0c17-49ab-b75c-314de1be84fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:24:29.096656 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.096547    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/863022e1-0c17-49ab-b75c-314de1be84fa-maas-api-tls\") pod \"maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684\" (UID: \"863022e1-0c17-49ab-b75c-314de1be84fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:24:29.096755 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:24:29.096662    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-serving-cert: secret "maas-api-e2e-shared-b-a81ee3-serving-cert" not found
Aug 05 17:24:29.096755 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:24:29.096723    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863022e1-0c17-49ab-b75c-314de1be84fa-maas-api-tls podName:863022e1-0c17-49ab-b75c-314de1be84fa nodeName:}" failed. No retries permitted until 2026-08-05 17:24:29.596707402 +0000 UTC m=+2724.046253679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/863022e1-0c17-49ab-b75c-314de1be84fa-maas-api-tls") pod "maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684" (UID: "863022e1-0c17-49ab-b75c-314de1be84fa") : secret "maas-api-e2e-shared-b-a81ee3-serving-cert" not found
Aug 05 17:24:29.097155 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.097134    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/863022e1-0c17-49ab-b75c-314de1be84fa-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684\" (UID: \"863022e1-0c17-49ab-b75c-314de1be84fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:24:29.107822 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.107791    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqtn5\" (UniqueName: \"kubernetes.io/projected/863022e1-0c17-49ab-b75c-314de1be84fa-kube-api-access-fqtn5\") pod \"maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684\" (UID: \"863022e1-0c17-49ab-b75c-314de1be84fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:24:29.218349 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.218314    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:29.484298 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.484208    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:29.582667 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.582629    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:29.601745 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.601708    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/863022e1-0c17-49ab-b75c-314de1be84fa-maas-api-tls\") pod \"maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684\" (UID: \"863022e1-0c17-49ab-b75c-314de1be84fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:24:29.604215 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.604193    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/863022e1-0c17-49ab-b75c-314de1be84fa-maas-api-tls\") pod \"maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684\" (UID: \"863022e1-0c17-49ab-b75c-314de1be84fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:24:29.685681 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.685655    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"]
Aug 05 17:24:29.689125 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.689110    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"
Aug 05 17:24:29.691667 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.691644    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-a81ee3\""
Aug 05 17:24:29.691791 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.691675    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-a81ee3-dockercfg-4zgww\""
Aug 05 17:24:29.701106 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.701084    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"]
Aug 05 17:24:29.766123 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.766059    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"]
Aug 05 17:24:29.769564 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.769538    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"
Aug 05 17:24:29.781715 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.781692    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"]
Aug 05 17:24:29.804282 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.804254    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9c49b36-d36c-4057-845e-2466c5dd6849-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth\" (UID: \"c9c49b36-d36c-4057-845e-2466c5dd6849\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"
Aug 05 17:24:29.804398 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.804338    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snnn4\" (UniqueName: \"kubernetes.io/projected/c9c49b36-d36c-4057-845e-2466c5dd6849-kube-api-access-snnn4\") pod \"payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth\" (UID: \"c9c49b36-d36c-4057-845e-2466c5dd6849\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"
Aug 05 17:24:29.806996 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.806963    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:24:29.905553 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.905516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9c49b36-d36c-4057-845e-2466c5dd6849-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth\" (UID: \"c9c49b36-d36c-4057-845e-2466c5dd6849\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"
Aug 05 17:24:29.905970 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.905574    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l9pw\" (UniqueName: \"kubernetes.io/projected/eb67f6c9-1e8a-41e5-a135-40a2d5319932-kube-api-access-4l9pw\") pod \"payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh\" (UID: \"eb67f6c9-1e8a-41e5-a135-40a2d5319932\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"
Aug 05 17:24:29.905970 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.905623    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb67f6c9-1e8a-41e5-a135-40a2d5319932-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh\" (UID: \"eb67f6c9-1e8a-41e5-a135-40a2d5319932\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"
Aug 05 17:24:29.905970 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.905722    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snnn4\" (UniqueName: \"kubernetes.io/projected/c9c49b36-d36c-4057-845e-2466c5dd6849-kube-api-access-snnn4\") pod \"payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth\" (UID: \"c9c49b36-d36c-4057-845e-2466c5dd6849\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"
Aug 05 17:24:29.906529 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.906507    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9c49b36-d36c-4057-845e-2466c5dd6849-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth\" (UID: \"c9c49b36-d36c-4057-845e-2466c5dd6849\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"
Aug 05 17:24:29.915258 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.915233    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snnn4\" (UniqueName: \"kubernetes.io/projected/c9c49b36-d36c-4057-845e-2466c5dd6849-kube-api-access-snnn4\") pod \"payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth\" (UID: \"c9c49b36-d36c-4057-845e-2466c5dd6849\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"
Aug 05 17:24:29.939428 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:29.939405    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"]
Aug 05 17:24:29.941951 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:24:29.941926    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863022e1_0c17_49ab_b75c_314de1be84fa.slice/crio-c7d54dbf33ffca79a8934fbc4e82c7a4376602e404577289fcc71f85a629f51a WatchSource:0}: Error finding container c7d54dbf33ffca79a8934fbc4e82c7a4376602e404577289fcc71f85a629f51a: Status 404 returned error can't find the container with id c7d54dbf33ffca79a8934fbc4e82c7a4376602e404577289fcc71f85a629f51a
Aug 05 17:24:30.000274 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.000246    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"
Aug 05 17:24:30.006913 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.006883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l9pw\" (UniqueName: \"kubernetes.io/projected/eb67f6c9-1e8a-41e5-a135-40a2d5319932-kube-api-access-4l9pw\") pod \"payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh\" (UID: \"eb67f6c9-1e8a-41e5-a135-40a2d5319932\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"
Aug 05 17:24:30.007029 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.006928    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb67f6c9-1e8a-41e5-a135-40a2d5319932-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh\" (UID: \"eb67f6c9-1e8a-41e5-a135-40a2d5319932\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"
Aug 05 17:24:30.007654 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.007634    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb67f6c9-1e8a-41e5-a135-40a2d5319932-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh\" (UID: \"eb67f6c9-1e8a-41e5-a135-40a2d5319932\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"
Aug 05 17:24:30.015299 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.015272    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l9pw\" (UniqueName: \"kubernetes.io/projected/eb67f6c9-1e8a-41e5-a135-40a2d5319932-kube-api-access-4l9pw\") pod \"payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh\" (UID: \"eb67f6c9-1e8a-41e5-a135-40a2d5319932\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"
Aug 05 17:24:30.080893 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.080862    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"
Aug 05 17:24:30.141603 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.141578    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"]
Aug 05 17:24:30.143446 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:24:30.143418    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c49b36_d36c_4057_845e_2466c5dd6849.slice/crio-b4548240cba8242d681c497a582455dc3968ee2ef81ff027d6b527a2a2b239f6 WatchSource:0}: Error finding container b4548240cba8242d681c497a582455dc3968ee2ef81ff027d6b527a2a2b239f6: Status 404 returned error can't find the container with id b4548240cba8242d681c497a582455dc3968ee2ef81ff027d6b527a2a2b239f6
Aug 05 17:24:30.236854 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.236829    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"]
Aug 05 17:24:30.238959 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:24:30.238933    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb67f6c9_1e8a_41e5_a135_40a2d5319932.slice/crio-29caea4c6b5a7400fc5a8a7972e6c3d4a72f3bd0d6b743d8504e763f6669a2c7 WatchSource:0}: Error finding container 29caea4c6b5a7400fc5a8a7972e6c3d4a72f3bd0d6b743d8504e763f6669a2c7: Status 404 returned error can't find the container with id 29caea4c6b5a7400fc5a8a7972e6c3d4a72f3bd0d6b743d8504e763f6669a2c7
Aug 05 17:24:30.602241 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.602200    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684" event={"ID":"863022e1-0c17-49ab-b75c-314de1be84fa","Type":"ContainerStarted","Data":"34da5ca11e6c49b5a6ba903370ef0ddf4e5638e4c26bd10de1c8197628a6c844"}
Aug 05 17:24:30.602426 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.602265    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:24:30.602426 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.602289    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684" event={"ID":"863022e1-0c17-49ab-b75c-314de1be84fa","Type":"ContainerStarted","Data":"c7d54dbf33ffca79a8934fbc4e82c7a4376602e404577289fcc71f85a629f51a"}
Aug 05 17:24:30.603755 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.603723    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh" event={"ID":"eb67f6c9-1e8a-41e5-a135-40a2d5319932","Type":"ContainerStarted","Data":"adda2c744e31dd1605e338e80c9b78ac105f07695351b3f04ce4faa80f1fb674"}
Aug 05 17:24:30.603922 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.603783    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"
Aug 05 17:24:30.603922 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.603820    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh" event={"ID":"eb67f6c9-1e8a-41e5-a135-40a2d5319932","Type":"ContainerStarted","Data":"29caea4c6b5a7400fc5a8a7972e6c3d4a72f3bd0d6b743d8504e763f6669a2c7"}
Aug 05 17:24:30.605104 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.605074    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth" event={"ID":"c9c49b36-d36c-4057-845e-2466c5dd6849","Type":"ContainerStarted","Data":"c9c731d5f42651f72fce35e41dfcd655763f9f348fc4bbd31c7db7cf2e3ae06e"}
Aug 05 17:24:30.605242 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.605119    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth" event={"ID":"c9c49b36-d36c-4057-845e-2466c5dd6849","Type":"ContainerStarted","Data":"b4548240cba8242d681c497a582455dc3968ee2ef81ff027d6b527a2a2b239f6"}
Aug 05 17:24:30.605242 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.605153    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"
Aug 05 17:24:30.622487 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.622404    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684" podStartSLOduration=2.209222772 podStartE2EDuration="2.622390633s" totalImagesPullingTime="413.167861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:30.621261661 +0000 UTC m=+2725.070807959" watchObservedRunningTime="2026-08-05 17:24:30.622390633 +0000 UTC m=+2725.071936933"
Aug 05 17:24:30.650406 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.650360    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth" podStartSLOduration=1.650347451 podStartE2EDuration="1.650347451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:30.649151631 +0000 UTC m=+2725.098697932" watchObservedRunningTime="2026-08-05 17:24:30.650347451 +0000 UTC m=+2725.099893750"
Aug 05 17:24:30.674432 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:30.674382    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh" podStartSLOduration=1.674362828 podStartE2EDuration="1.674362828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:30.673033393 +0000 UTC m=+2725.122579713" watchObservedRunningTime="2026-08-05 17:24:30.674362828 +0000 UTC m=+2725.123909132"
Aug 05 17:24:31.604852 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:31.604817    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:24:36.616613 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:36.616587    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:24:41.612974 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:41.612940    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"
Aug 05 17:24:41.613415 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:41.613210    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"
Aug 05 17:24:52.801836 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:24:52.801782    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:06.249471 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:25:06.249433    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:13.954147 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:25:13.954108    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:14.055824 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:25:14.055769    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:34.544064 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:25:34.544020    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:37.307555 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:25:37.307524    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:26:05.124481 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:26:05.124446    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:26:07.826980 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:26:07.826949    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:26:22.843798 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:26:22.843757    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:26:29.292551 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:26:29.292519    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:26:44.993491 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:26:44.993455    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:26:55.304613 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:26:55.304581    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:27:11.410357 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:27:11.410284    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:27:26.919198 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:27:26.916544    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:27:37.918007 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:27:37.917973    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:27:52.895203 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:27:52.895168    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:28:02.179006 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:28:02.178969    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:06.356250 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:28:06.356211    2575 scope.go:117] "RemoveContainer" containerID="51b0306c1311a7d76191b48a11e1499f0f842a6fa77b70525179b71a72f2fc52"
Aug 05 17:28:06.364748 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:28:06.364730    2575 scope.go:117] "RemoveContainer" containerID="b021d4a6e0a9b9cf2a2e791f73b89609f602eed1ecdd515f3f30192fdf997b8a"
Aug 05 17:28:06.600912 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:28:06.600880    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:28:17.309218 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:28:17.309185    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:28:32.799950 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:28:32.799920    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:28:48.487886 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:28:48.487850    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:28:58.896166 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:28:58.896126    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:29:06.186881 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:29:06.186853    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:29:06.192395 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:29:06.192374    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:29:13.782204 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:29:13.782165    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:14.725156 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:29:14.725125    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:29:30.187910 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:29:30.187875    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:29:39.782892 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:29:39.782848    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:39.849687 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:29:39.849648    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:29:40.713730 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:29:40.713694    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:29:56.701794 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:29:56.701760    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:30:00.149607 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:00.149518    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a81ee3-29765850-msppz"]
Aug 05 17:30:00.155392 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:00.155369    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765850-s74vp"]
Aug 05 17:30:00.155519 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:00.155480    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a81ee3-29765850-msppz"
Aug 05 17:30:00.158109 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:00.158083    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:30:00.158630 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:00.158616    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765850-s74vp"
Aug 05 17:30:00.166296 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:00.166277    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a81ee3-29765850-msppz"
Aug 05 17:30:00.172492 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:00.172474    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765850-s74vp"
Aug 05 17:30:00.186101 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:00.186061    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a81ee3-29765850-msppz"]
Aug 05 17:30:00.191141 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:00.191119    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765850-s74vp"]
Aug 05 17:30:00.329705 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:00.328761    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a81ee3-29765850-msppz"]
Aug 05 17:30:00.352463 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:00.352439    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765850-s74vp"]
Aug 05 17:30:00.354458 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:30:00.354431    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1379f4ae_58f0_486a_aa4d_b0353ac8eae7.slice/crio-24dd4dfa49e9ed7b6423cd367930d4e750bb3f0d62cb24930c56b759f794b650 WatchSource:0}: Error finding container 24dd4dfa49e9ed7b6423cd367930d4e750bb3f0d62cb24930c56b759f794b650: Status 404 returned error can't find the container with id 24dd4dfa49e9ed7b6423cd367930d4e750bb3f0d62cb24930c56b759f794b650
Aug 05 17:30:01.224952 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:01.224919    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765850-s74vp" event={"ID":"1379f4ae-58f0-486a-aa4d-b0353ac8eae7","Type":"ContainerStarted","Data":"f0a516a49953d50627088df0d7890336a7a84b75fe4108025157a6d377a2708a"}
Aug 05 17:30:01.225505 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:01.224987    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765850-s74vp" event={"ID":"1379f4ae-58f0-486a-aa4d-b0353ac8eae7","Type":"ContainerStarted","Data":"24dd4dfa49e9ed7b6423cd367930d4e750bb3f0d62cb24930c56b759f794b650"}
Aug 05 17:30:01.226783 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:01.226745    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a81ee3-29765850-msppz" event={"ID":"b82cf3ef-6350-485c-80a4-7e052355fd8e","Type":"ContainerStarted","Data":"f5332d2f795f540c2b47cc986f367dba9eb518f8b5a59bc64054d638d690eff7"}
Aug 05 17:30:01.226954 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:01.226821    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a81ee3-29765850-msppz" event={"ID":"b82cf3ef-6350-485c-80a4-7e052355fd8e","Type":"ContainerStarted","Data":"aa0cec1ccd3b71fbbd0a0ef55c35fab13000f50e4116307461ce6b960d5ec1f5"}
Aug 05 17:30:01.245234 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:01.245176    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765850-s74vp" podStartSLOduration=1.245156535 podStartE2EDuration="1.245156535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:30:01.243430656 +0000 UTC m=+3055.692976955" watchObservedRunningTime="2026-08-05 17:30:01.245156535 +0000 UTC m=+3055.694702835"
Aug 05 17:30:01.262942 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:01.262892    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a81ee3-29765850-msppz" podStartSLOduration=1.262876656 podStartE2EDuration="1.262876656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:30:01.260840472 +0000 UTC m=+3055.710386772" watchObservedRunningTime="2026-08-05 17:30:01.262876656 +0000 UTC m=+3055.712422956"
Aug 05 17:30:02.233454 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:02.233416    2575 generic.go:356] "Generic (PLEG): container finished" podID="1379f4ae-58f0-486a-aa4d-b0353ac8eae7" containerID="f0a516a49953d50627088df0d7890336a7a84b75fe4108025157a6d377a2708a" exitCode=0
Aug 05 17:30:02.233891 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:02.233499    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765850-s74vp" event={"ID":"1379f4ae-58f0-486a-aa4d-b0353ac8eae7","Type":"ContainerDied","Data":"f0a516a49953d50627088df0d7890336a7a84b75fe4108025157a6d377a2708a"}
Aug 05 17:30:02.234891 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:02.234867    2575 generic.go:356] "Generic (PLEG): container finished" podID="b82cf3ef-6350-485c-80a4-7e052355fd8e" containerID="f5332d2f795f540c2b47cc986f367dba9eb518f8b5a59bc64054d638d690eff7" exitCode=0
Aug 05 17:30:02.235017 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:02.234947    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a81ee3-29765850-msppz" event={"ID":"b82cf3ef-6350-485c-80a4-7e052355fd8e","Type":"ContainerDied","Data":"f5332d2f795f540c2b47cc986f367dba9eb518f8b5a59bc64054d638d690eff7"}
Aug 05 17:30:03.377698 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:03.377670    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765850-s74vp"
Aug 05 17:30:03.416464 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:03.416441    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a81ee3-29765850-msppz"
Aug 05 17:30:04.245785 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:04.245757    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765850-s74vp"
Aug 05 17:30:04.246006 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:04.245758    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765850-s74vp" event={"ID":"1379f4ae-58f0-486a-aa4d-b0353ac8eae7","Type":"ContainerDied","Data":"24dd4dfa49e9ed7b6423cd367930d4e750bb3f0d62cb24930c56b759f794b650"}
Aug 05 17:30:04.246006 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:04.245866    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24dd4dfa49e9ed7b6423cd367930d4e750bb3f0d62cb24930c56b759f794b650"
Aug 05 17:30:04.247055 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:04.247039    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a81ee3-29765850-msppz"
Aug 05 17:30:04.247157 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:04.247088    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a81ee3-29765850-msppz" event={"ID":"b82cf3ef-6350-485c-80a4-7e052355fd8e","Type":"ContainerDied","Data":"aa0cec1ccd3b71fbbd0a0ef55c35fab13000f50e4116307461ce6b960d5ec1f5"}
Aug 05 17:30:04.247157 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:04.247124    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa0cec1ccd3b71fbbd0a0ef55c35fab13000f50e4116307461ce6b960d5ec1f5"
Aug 05 17:30:06.398621 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:06.398594    2575 scope.go:117] "RemoveContainer" containerID="73c5f0d88cf1330cca5acd501998dd69e265c1d6184f7e6727812d6d01ae7b5a"
Aug 05 17:30:12.018306 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:12.018279    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:30:16.530252 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:16.530210    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:17.373554 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:17.373521    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:22.129766 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:22.129730    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:30:31.708564 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:31.708527    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:34.213322 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:34.213295    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:30:54.334441 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:54.334402    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:57.098797 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:30:57.098760    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:31:45.104072 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:31:45.104033    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:31:57.809999 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:31:57.809961    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:32:09.126147 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:32:09.126114    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:32:13.570024 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:32:13.569983    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:14.554872 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:32:14.554833    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:21.606760 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:32:21.606717    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:21.704331 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:32:21.704295    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:32:28.112469 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:32:28.112424    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:32:47.592570 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:32:47.592533    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:51.470600 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:32:51.470560    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:54.095735 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:32:54.095698    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:33:31.703519 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:33:31.703481    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:33:44.896582 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:33:44.896546    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:33:56.205954 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:33:56.205919    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:34:01.417156 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:01.417123    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:02.215964 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:02.215927    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:04.798531 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:04.798490    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:34:06.224835 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:06.221281    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:34:06.230746 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:06.230706    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:34:22.685354 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:22.685315    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:23.843288 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:23.843207    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:25.060040 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:25.060002    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:25.154038 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:25.154009    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:26.250394 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.250354    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"]
Aug 05 17:34:26.250941 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.250922    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1379f4ae-58f0-486a-aa4d-b0353ac8eae7" containerName="cleanup"
Aug 05 17:34:26.250941 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.250942    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1379f4ae-58f0-486a-aa4d-b0353ac8eae7" containerName="cleanup"
Aug 05 17:34:26.251085 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.250969    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82cf3ef-6350-485c-80a4-7e052355fd8e" containerName="cleanup"
Aug 05 17:34:26.251085 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.250977    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82cf3ef-6350-485c-80a4-7e052355fd8e" containerName="cleanup"
Aug 05 17:34:26.251085 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.251074    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b82cf3ef-6350-485c-80a4-7e052355fd8e" containerName="cleanup"
Aug 05 17:34:26.251239 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.251090    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1379f4ae-58f0-486a-aa4d-b0353ac8eae7" containerName="cleanup"
Aug 05 17:34:26.254420 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.254400    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:34:26.257467 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.257449    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-09e18b-serving-cert\""
Aug 05 17:34:26.313821 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.313781    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:26.314709 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.314688    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"]
Aug 05 17:34:26.417100 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.417072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ead56184-118b-4322-9a21-1796c1478caa-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt\" (UID: \"ead56184-118b-4322-9a21-1796c1478caa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:34:26.417271 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.417194    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lh6g\" (UniqueName: \"kubernetes.io/projected/ead56184-118b-4322-9a21-1796c1478caa-kube-api-access-9lh6g\") pod \"maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt\" (UID: \"ead56184-118b-4322-9a21-1796c1478caa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:34:26.417271 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.417250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ead56184-118b-4322-9a21-1796c1478caa-maas-api-tls\") pod \"maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt\" (UID: \"ead56184-118b-4322-9a21-1796c1478caa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:34:26.518468 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.518322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ead56184-118b-4322-9a21-1796c1478caa-maas-api-tls\") pod \"maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt\" (UID: \"ead56184-118b-4322-9a21-1796c1478caa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:34:26.518468 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.518428    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ead56184-118b-4322-9a21-1796c1478caa-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt\" (UID: \"ead56184-118b-4322-9a21-1796c1478caa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:34:26.518729 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.518605    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lh6g\" (UniqueName: \"kubernetes.io/projected/ead56184-118b-4322-9a21-1796c1478caa-kube-api-access-9lh6g\") pod \"maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt\" (UID: \"ead56184-118b-4322-9a21-1796c1478caa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:34:26.519537 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.519510    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ead56184-118b-4322-9a21-1796c1478caa-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt\" (UID: \"ead56184-118b-4322-9a21-1796c1478caa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:34:26.521062 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.521046    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ead56184-118b-4322-9a21-1796c1478caa-maas-api-tls\") pod \"maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt\" (UID: \"ead56184-118b-4322-9a21-1796c1478caa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:34:26.527073 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.527050    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lh6g\" (UniqueName: \"kubernetes.io/projected/ead56184-118b-4322-9a21-1796c1478caa-kube-api-access-9lh6g\") pod \"maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt\" (UID: \"ead56184-118b-4322-9a21-1796c1478caa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:34:26.564717 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.564691    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:34:26.568569 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.568544    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:26.712516 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.712483    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"]
Aug 05 17:34:26.715484 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:34:26.715453    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead56184_118b_4322_9a21_1796c1478caa.slice/crio-85cda35363bae82c2de315e05e7e9cde18c99995885d827dea999d89a0b87b5c WatchSource:0}: Error finding container 85cda35363bae82c2de315e05e7e9cde18c99995885d827dea999d89a0b87b5c: Status 404 returned error can't find the container with id 85cda35363bae82c2de315e05e7e9cde18c99995885d827dea999d89a0b87b5c
Aug 05 17:34:26.716820 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.716789    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:34:26.950267 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:26.950231    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:27.060138 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.060085    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:27.070417 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.070385    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"]
Aug 05 17:34:27.075283 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.075266    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"
Aug 05 17:34:27.077802 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.077778    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-09e18b\""
Aug 05 17:34:27.089015 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.088993    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"]
Aug 05 17:34:27.225741 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.225664    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f847s\" (UniqueName: \"kubernetes.io/projected/42f3f566-7a7c-4406-90cb-169dda08c516-kube-api-access-f847s\") pod \"payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw\" (UID: \"42f3f566-7a7c-4406-90cb-169dda08c516\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"
Aug 05 17:34:27.225908 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.225737    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42f3f566-7a7c-4406-90cb-169dda08c516-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw\" (UID: \"42f3f566-7a7c-4406-90cb-169dda08c516\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"
Aug 05 17:34:27.327086 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.327047    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f847s\" (UniqueName: \"kubernetes.io/projected/42f3f566-7a7c-4406-90cb-169dda08c516-kube-api-access-f847s\") pod \"payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw\" (UID: \"42f3f566-7a7c-4406-90cb-169dda08c516\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"
Aug 05 17:34:27.327086 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.327093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42f3f566-7a7c-4406-90cb-169dda08c516-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw\" (UID: \"42f3f566-7a7c-4406-90cb-169dda08c516\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"
Aug 05 17:34:27.327845 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.327826    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42f3f566-7a7c-4406-90cb-169dda08c516-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw\" (UID: \"42f3f566-7a7c-4406-90cb-169dda08c516\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"
Aug 05 17:34:27.347551 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.347520    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f847s\" (UniqueName: \"kubernetes.io/projected/42f3f566-7a7c-4406-90cb-169dda08c516-kube-api-access-f847s\") pod \"payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw\" (UID: \"42f3f566-7a7c-4406-90cb-169dda08c516\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"
Aug 05 17:34:27.386059 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.386030    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"
Aug 05 17:34:27.507972 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.507885    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt" event={"ID":"ead56184-118b-4322-9a21-1796c1478caa","Type":"ContainerStarted","Data":"a7ae371f71ba4f3d9d22866e5786197292d838edeb1411e43076ff8c895b98c3"}
Aug 05 17:34:27.507972 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.507935    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt" event={"ID":"ead56184-118b-4322-9a21-1796c1478caa","Type":"ContainerStarted","Data":"85cda35363bae82c2de315e05e7e9cde18c99995885d827dea999d89a0b87b5c"}
Aug 05 17:34:27.508150 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.508065    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:34:27.545023 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.544971    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt" podStartSLOduration=1.15373799 podStartE2EDuration="1.544951709s" totalImagesPullingTime="391.213719ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:27.539656293 +0000 UTC m=+3321.989202593" watchObservedRunningTime="2026-08-05 17:34:27.544951709 +0000 UTC m=+3321.994498011"
Aug 05 17:34:27.738248 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:27.738225    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"]
Aug 05 17:34:27.740302 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:34:27.740274    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f3f566_7a7c_4406_90cb_169dda08c516.slice/crio-35efbc04ac0d0a5c60438151fd251d5f3cc7688887d36dffa7415ff8c6b220fc WatchSource:0}: Error finding container 35efbc04ac0d0a5c60438151fd251d5f3cc7688887d36dffa7415ff8c6b220fc: Status 404 returned error can't find the container with id 35efbc04ac0d0a5c60438151fd251d5f3cc7688887d36dffa7415ff8c6b220fc
Aug 05 17:34:28.514708 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:28.514674    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw" event={"ID":"42f3f566-7a7c-4406-90cb-169dda08c516","Type":"ContainerStarted","Data":"92d34467f84c106ff6e062c8f130785d150d1f77a5669ee1f04a375c6d10e1c9"}
Aug 05 17:34:28.515204 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:28.514738    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw" event={"ID":"42f3f566-7a7c-4406-90cb-169dda08c516","Type":"ContainerStarted","Data":"35efbc04ac0d0a5c60438151fd251d5f3cc7688887d36dffa7415ff8c6b220fc"}
Aug 05 17:34:28.515204 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:28.514931    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"
Aug 05 17:34:28.533614 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:28.533567    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw" podStartSLOduration=1.5335508450000002 podStartE2EDuration="1.533550845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:28.531837 +0000 UTC m=+3322.981383294" watchObservedRunningTime="2026-08-05 17:34:28.533550845 +0000 UTC m=+3322.983097143"
Aug 05 17:34:29.704142 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:29.704102    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:34:33.520275 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:33.520244    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:34:39.521687 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:39.521659    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"
Aug 05 17:34:49.939550 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:49.939514    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:50.582997 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:50.582963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:50.926749 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:50.926714    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:51.025530 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:51.025493    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:58.642476 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:58.642445    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:58.736859 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:58.736819    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:59.755167 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:59.755135    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"]
Aug 05 17:34:59.758872 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:59.758856    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:34:59.762052 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:59.762029    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-40374d-serving-cert\""
Aug 05 17:34:59.775046 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:59.775020    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"]
Aug 05 17:34:59.791525 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:59.791496    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:59.826793 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:59.826762    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzwpd\" (UniqueName: \"kubernetes.io/projected/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-kube-api-access-pzwpd\") pod \"maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff\" (UID: \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:34:59.826953 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:59.826801    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff\" (UID: \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:34:59.826953 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:59.826842    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-maas-api-tls\") pod \"maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff\" (UID: \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:34:59.928266 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:59.928234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzwpd\" (UniqueName: \"kubernetes.io/projected/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-kube-api-access-pzwpd\") pod \"maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff\" (UID: \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:34:59.928440 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:59.928282    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff\" (UID: \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:34:59.928440 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:59.928320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-maas-api-tls\") pod \"maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff\" (UID: \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:34:59.928997 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:59.928969    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff\" (UID: \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:34:59.930767 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:59.930745    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-maas-api-tls\") pod \"maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff\" (UID: \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:34:59.943035 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:34:59.943010    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzwpd\" (UniqueName: \"kubernetes.io/projected/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-kube-api-access-pzwpd\") pod \"maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff\" (UID: \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:35:00.056547 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:00.056472    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:00.069295 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:00.069271    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:35:00.210260 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:00.210235    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"]
Aug 05 17:35:00.212316 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:35:00.212280    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ba74793_bd46_4f96_a13c_bd7fd7fe0498.slice/crio-15d3df9d84303d9ab9e18de5e2ac24ee769c35c7e986d4c93cdb357e45ff7368 WatchSource:0}: Error finding container 15d3df9d84303d9ab9e18de5e2ac24ee769c35c7e986d4c93cdb357e45ff7368: Status 404 returned error can't find the container with id 15d3df9d84303d9ab9e18de5e2ac24ee769c35c7e986d4c93cdb357e45ff7368
Aug 05 17:35:00.432069 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:00.432033    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:00.527244 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:00.527204    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:00.681118 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:00.681087    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff" event={"ID":"2ba74793-bd46-4f96-a13c-bd7fd7fe0498","Type":"ContainerStarted","Data":"15d3df9d84303d9ab9e18de5e2ac24ee769c35c7e986d4c93cdb357e45ff7368"}
Aug 05 17:35:01.687674 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:01.687643    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff" event={"ID":"2ba74793-bd46-4f96-a13c-bd7fd7fe0498","Type":"ContainerStarted","Data":"298c395b3d40c3eb2caa5c35fa0667a904b82203f78f91a3b7601ad8ffc5faaf"}
Aug 05 17:35:01.688099 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:01.687747    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:35:01.710491 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:01.710445    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff" podStartSLOduration=2.2139170950000002 podStartE2EDuration="2.710430986s" totalImagesPullingTime="496.513891ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:35:01.709122606 +0000 UTC m=+3356.158668906" watchObservedRunningTime="2026-08-05 17:35:01.710430986 +0000 UTC m=+3356.159977284"
Aug 05 17:35:03.010577 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:03.010545    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:35:05.047565 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:05.047521    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:05.113245 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:05.113211    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:07.699121 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:07.699091    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:35:21.184172 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:21.184132    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:23.595052 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:23.595016    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:41.253181 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:41.253147    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:44.000291 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:35:44.000256    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:36:09.390741 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:09.390663    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:36:20.301473 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:20.301436    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw_42f3f566-7a7c-4406-90cb-169dda08c516/payload-processing/0.log"
Aug 05 17:36:20.807839 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:20.807777    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:21.136870 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:21.136767    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:21.501726 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:21.501695    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:23.657395 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:23.657347    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:23.751229 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:23.751189    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:24.751043 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:24.751005    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"]
Aug 05 17:36:24.755022 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:24.754996    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:24.757400 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:24.757379    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-9d56f4-serving-cert\""
Aug 05 17:36:24.765153 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:24.765127    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"]
Aug 05 17:36:24.795235 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:24.795203    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:24.940934 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:24.940906    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n\" (UID: \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:24.941100 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:24.940968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n\" (UID: \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:24.941100 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:24.941026    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsxmr\" (UniqueName: \"kubernetes.io/projected/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-kube-api-access-tsxmr\") pod \"maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n\" (UID: \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:25.015621 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.015535    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:25.041579 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.041551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsxmr\" (UniqueName: \"kubernetes.io/projected/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-kube-api-access-tsxmr\") pod \"maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n\" (UID: \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:25.041725 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.041614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n\" (UID: \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:25.041725 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.041666    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n\" (UID: \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:25.042379 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.042356    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n\" (UID: \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:25.044172 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.044140    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n\" (UID: \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:25.053179 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.053157    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsxmr\" (UniqueName: \"kubernetes.io/projected/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-kube-api-access-tsxmr\") pod \"maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n\" (UID: \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:25.068874 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.068847    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:25.205960 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.205797    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"]
Aug 05 17:36:25.208564 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:36:25.208539    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc47d12_10a0_489e_8fdf_f0b4c4cb81d0.slice/crio-ea8d2cdee36919a96d330ef5163d75192843a9c86841e1837468807653015ea5 WatchSource:0}: Error finding container ea8d2cdee36919a96d330ef5163d75192843a9c86841e1837468807653015ea5: Status 404 returned error can't find the container with id ea8d2cdee36919a96d330ef5163d75192843a9c86841e1837468807653015ea5
Aug 05 17:36:25.426848 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.426768    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:25.530186 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.530151    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:25.530840 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.530820    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"]
Aug 05 17:36:25.535570 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.535551    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"
Aug 05 17:36:25.539039 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.539023    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-9d56f4\""
Aug 05 17:36:25.547005 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.546984    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"]
Aug 05 17:36:25.567139 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.567112    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"]
Aug 05 17:36:25.571283 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.571265    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"
Aug 05 17:36:25.573829 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.573784    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-9d56f4-dockercfg-w4wxs\""
Aug 05 17:36:25.581218 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.581198    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"]
Aug 05 17:36:25.647712 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.647674    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md9hp\" (UniqueName: \"kubernetes.io/projected/059878f1-9b24-4dc9-9cb9-a2a60101de11-kube-api-access-md9hp\") pod \"payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr\" (UID: \"059878f1-9b24-4dc9-9cb9-a2a60101de11\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"
Aug 05 17:36:25.647939 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.647881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/059878f1-9b24-4dc9-9cb9-a2a60101de11-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr\" (UID: \"059878f1-9b24-4dc9-9cb9-a2a60101de11\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"
Aug 05 17:36:25.748855 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.748829    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/059878f1-9b24-4dc9-9cb9-a2a60101de11-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr\" (UID: \"059878f1-9b24-4dc9-9cb9-a2a60101de11\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"
Aug 05 17:36:25.748971 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.748879    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0380ff85-6d9e-42d6-9244-f75033f0a9d1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g\" (UID: \"0380ff85-6d9e-42d6-9244-f75033f0a9d1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"
Aug 05 17:36:25.748971 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.748950    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zw76\" (UniqueName: \"kubernetes.io/projected/0380ff85-6d9e-42d6-9244-f75033f0a9d1-kube-api-access-5zw76\") pod \"payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g\" (UID: \"0380ff85-6d9e-42d6-9244-f75033f0a9d1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"
Aug 05 17:36:25.749090 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.749001    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md9hp\" (UniqueName: \"kubernetes.io/projected/059878f1-9b24-4dc9-9cb9-a2a60101de11-kube-api-access-md9hp\") pod \"payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr\" (UID: \"059878f1-9b24-4dc9-9cb9-a2a60101de11\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"
Aug 05 17:36:25.749619 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.749601    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/059878f1-9b24-4dc9-9cb9-a2a60101de11-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr\" (UID: \"059878f1-9b24-4dc9-9cb9-a2a60101de11\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"
Aug 05 17:36:25.757034 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.757011    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md9hp\" (UniqueName: \"kubernetes.io/projected/059878f1-9b24-4dc9-9cb9-a2a60101de11-kube-api-access-md9hp\") pod \"payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr\" (UID: \"059878f1-9b24-4dc9-9cb9-a2a60101de11\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"
Aug 05 17:36:25.847121 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.847089    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"
Aug 05 17:36:25.849541 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.849514    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0380ff85-6d9e-42d6-9244-f75033f0a9d1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g\" (UID: \"0380ff85-6d9e-42d6-9244-f75033f0a9d1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"
Aug 05 17:36:25.849669 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.849557    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zw76\" (UniqueName: \"kubernetes.io/projected/0380ff85-6d9e-42d6-9244-f75033f0a9d1-kube-api-access-5zw76\") pod \"payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g\" (UID: \"0380ff85-6d9e-42d6-9244-f75033f0a9d1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"
Aug 05 17:36:25.850416 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.850390    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0380ff85-6d9e-42d6-9244-f75033f0a9d1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g\" (UID: \"0380ff85-6d9e-42d6-9244-f75033f0a9d1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"
Aug 05 17:36:25.857499 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.857476    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zw76\" (UniqueName: \"kubernetes.io/projected/0380ff85-6d9e-42d6-9244-f75033f0a9d1-kube-api-access-5zw76\") pod \"payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g\" (UID: \"0380ff85-6d9e-42d6-9244-f75033f0a9d1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"
Aug 05 17:36:25.883548 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.883517    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"
Aug 05 17:36:25.996549 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:25.996522    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"]
Aug 05 17:36:25.999534 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:36:25.999503    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod059878f1_9b24_4dc9_9cb9_a2a60101de11.slice/crio-0a28a77806a7b922f857a19ec303846f978a7c88f460933a0e149908e8549904 WatchSource:0}: Error finding container 0a28a77806a7b922f857a19ec303846f978a7c88f460933a0e149908e8549904: Status 404 returned error can't find the container with id 0a28a77806a7b922f857a19ec303846f978a7c88f460933a0e149908e8549904
Aug 05 17:36:26.046659 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:26.046630    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"]
Aug 05 17:36:26.047580 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:36:26.047536    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0380ff85_6d9e_42d6_9244_f75033f0a9d1.slice/crio-c96e472836d35527a1f5a5a765d2f307ddfc9c44381d36e60fa2537b9be0cec7 WatchSource:0}: Error finding container c96e472836d35527a1f5a5a765d2f307ddfc9c44381d36e60fa2537b9be0cec7: Status 404 returned error can't find the container with id c96e472836d35527a1f5a5a765d2f307ddfc9c44381d36e60fa2537b9be0cec7
Aug 05 17:36:26.115513 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:26.115486    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g" event={"ID":"0380ff85-6d9e-42d6-9244-f75033f0a9d1","Type":"ContainerStarted","Data":"c96e472836d35527a1f5a5a765d2f307ddfc9c44381d36e60fa2537b9be0cec7"}
Aug 05 17:36:26.117068 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:26.117041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr" event={"ID":"059878f1-9b24-4dc9-9cb9-a2a60101de11","Type":"ContainerStarted","Data":"5ef13127d97a10ac93ada12c0bf75bfe5f1925da8ec47afabe57131e1843c61f"}
Aug 05 17:36:26.117191 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:26.117098    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"
Aug 05 17:36:26.117191 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:26.117127    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr" event={"ID":"059878f1-9b24-4dc9-9cb9-a2a60101de11","Type":"ContainerStarted","Data":"0a28a77806a7b922f857a19ec303846f978a7c88f460933a0e149908e8549904"}
Aug 05 17:36:26.118527 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:26.118508    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n" event={"ID":"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0","Type":"ContainerStarted","Data":"5bb82e76c6f020379bfd42e89da5a0626eb9f5e543f73c21aefa6594e07e522b"}
Aug 05 17:36:26.118614 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:26.118543    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n" event={"ID":"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0","Type":"ContainerStarted","Data":"ea8d2cdee36919a96d330ef5163d75192843a9c86841e1837468807653015ea5"}
Aug 05 17:36:26.118681 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:26.118650    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:26.155682 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:26.155636    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr" podStartSLOduration=1.155622297 podStartE2EDuration="1.155622297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:36:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:36:26.13550125 +0000 UTC m=+3440.585047549" watchObservedRunningTime="2026-08-05 17:36:26.155622297 +0000 UTC m=+3440.605168596"
Aug 05 17:36:26.156245 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:26.156215    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n" podStartSLOduration=1.680844037 podStartE2EDuration="2.156206318s" totalImagesPullingTime="475.362281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:36:26.155053849 +0000 UTC m=+3440.604600171" watchObservedRunningTime="2026-08-05 17:36:26.156206318 +0000 UTC m=+3440.605752632"
Aug 05 17:36:27.125289 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:27.125250    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g" event={"ID":"0380ff85-6d9e-42d6-9244-f75033f0a9d1","Type":"ContainerStarted","Data":"4ac5c1282d7bea4ca29bfd488e819943b8eba45bfddd5a8c60a8037d2329d028"}
Aug 05 17:36:27.125735 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:27.125588    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"
Aug 05 17:36:27.144230 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:27.144184    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g" podStartSLOduration=2.144169324 podStartE2EDuration="2.144169324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:36:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:36:27.142897565 +0000 UTC m=+3441.592443865" watchObservedRunningTime="2026-08-05 17:36:27.144169324 +0000 UTC m=+3441.593715622"
Aug 05 17:36:29.691688 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:29.691649    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:36:32.130588 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:32.130557    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:37.127476 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:37.127446    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"
Aug 05 17:36:38.132295 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:38.132268    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"
Aug 05 17:36:48.647215 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:48.647170    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:49.276969 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:49.276932    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s"]
Aug 05 17:36:49.282061 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:49.282041    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s"
Aug 05 17:36:49.284249 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:49.284232    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:36:49.290459 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:49.290426    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s"]
Aug 05 17:36:49.363606 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:49.363573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd1857c-f169-4fb1-b48b-c990dbe82454-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s\" (UID: \"0bd1857c-f169-4fb1-b48b-c990dbe82454\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s"
Aug 05 17:36:49.464725 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:49.464695    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd1857c-f169-4fb1-b48b-c990dbe82454-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s\" (UID: \"0bd1857c-f169-4fb1-b48b-c990dbe82454\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s"
Aug 05 17:36:49.465293 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:49.465274    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd1857c-f169-4fb1-b48b-c990dbe82454-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s\" (UID: \"0bd1857c-f169-4fb1-b48b-c990dbe82454\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s"
Aug 05 17:36:49.593901 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:49.593833    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s"
Aug 05 17:36:49.932740 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:49.932712    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s"]
Aug 05 17:36:49.935987 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:36:49.935962    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd1857c_f169_4fb1_b48b_c990dbe82454.slice/crio-56473171499c5d94ccfa45978f4848716e2d3a523df5ecbc3b367cd47fdf0194 WatchSource:0}: Error finding container 56473171499c5d94ccfa45978f4848716e2d3a523df5ecbc3b367cd47fdf0194: Status 404 returned error can't find the container with id 56473171499c5d94ccfa45978f4848716e2d3a523df5ecbc3b367cd47fdf0194
Aug 05 17:36:50.247433 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:50.247400    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s" event={"ID":"0bd1857c-f169-4fb1-b48b-c990dbe82454","Type":"ContainerStarted","Data":"5115e37af88a3637af5cd43743d7c28a8b3996a898cfc4e84cbec6164fb9dad3"}
Aug 05 17:36:50.247552 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:50.247465    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s" event={"ID":"0bd1857c-f169-4fb1-b48b-c990dbe82454","Type":"ContainerStarted","Data":"56473171499c5d94ccfa45978f4848716e2d3a523df5ecbc3b367cd47fdf0194"}
Aug 05 17:36:50.263659 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:50.263613    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s" podStartSLOduration=1.263599537 podStartE2EDuration="1.263599537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:36:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:36:50.262978672 +0000 UTC m=+3464.712524977" watchObservedRunningTime="2026-08-05 17:36:50.263599537 +0000 UTC m=+3464.713145813"
Aug 05 17:36:51.254334 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:51.254294    2575 generic.go:356] "Generic (PLEG): container finished" podID="0bd1857c-f169-4fb1-b48b-c990dbe82454" containerID="5115e37af88a3637af5cd43743d7c28a8b3996a898cfc4e84cbec6164fb9dad3" exitCode=0
Aug 05 17:36:51.254856 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:51.254382    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s" event={"ID":"0bd1857c-f169-4fb1-b48b-c990dbe82454","Type":"ContainerDied","Data":"5115e37af88a3637af5cd43743d7c28a8b3996a898cfc4e84cbec6164fb9dad3"}
Aug 05 17:36:52.392510 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:52.392489    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s"
Aug 05 17:36:52.494081 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:52.494050    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd1857c-f169-4fb1-b48b-c990dbe82454-maas-api-service-ca\") pod \"0bd1857c-f169-4fb1-b48b-c990dbe82454\" (UID: \"0bd1857c-f169-4fb1-b48b-c990dbe82454\") "
Aug 05 17:36:52.494384 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:52.494362    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bd1857c-f169-4fb1-b48b-c990dbe82454-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0bd1857c-f169-4fb1-b48b-c990dbe82454" (UID: "0bd1857c-f169-4fb1-b48b-c990dbe82454"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:36:52.595489 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:52.595420    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd1857c-f169-4fb1-b48b-c990dbe82454-maas-api-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:36:53.265358 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:53.265327    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s"
Aug 05 17:36:53.265544 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:53.265363    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s" event={"ID":"0bd1857c-f169-4fb1-b48b-c990dbe82454","Type":"ContainerDied","Data":"56473171499c5d94ccfa45978f4848716e2d3a523df5ecbc3b367cd47fdf0194"}
Aug 05 17:36:53.265544 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:53.265413    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56473171499c5d94ccfa45978f4848716e2d3a523df5ecbc3b367cd47fdf0194"
Aug 05 17:36:55.228717 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.228659    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"]
Aug 05 17:36:55.229228 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.228963    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n" podUID="cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0" containerName="maas-api" containerID="cri-o://5bb82e76c6f020379bfd42e89da5a0626eb9f5e543f73c21aefa6594e07e522b" gracePeriod=30
Aug 05 17:36:55.262726 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.262694    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:55.301661 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.301629    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"]
Aug 05 17:36:55.301909 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.301880    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g" podUID="0380ff85-6d9e-42d6-9244-f75033f0a9d1" containerName="payload-processing" containerID="cri-o://4ac5c1282d7bea4ca29bfd488e819943b8eba45bfddd5a8c60a8037d2329d028" gracePeriod=30
Aug 05 17:36:55.310332 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.310304    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"]
Aug 05 17:36:55.310547 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.310520    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr" podUID="059878f1-9b24-4dc9-9cb9-a2a60101de11" containerName="payload-pre-processing" containerID="cri-o://5ef13127d97a10ac93ada12c0bf75bfe5f1925da8ec47afabe57131e1843c61f" gracePeriod=30
Aug 05 17:36:55.353189 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.353160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:55.454429 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.454368    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:55.463893 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.463860    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s"]
Aug 05 17:36:55.467251 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.467223    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9d56f4-cqw4s"]
Aug 05 17:36:55.564994 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.564957    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:55.571635 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.571607    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:55.612007 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.611981    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"
Aug 05 17:36:55.624944 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.624921    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"
Aug 05 17:36:55.725220 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.725188    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zw76\" (UniqueName: \"kubernetes.io/projected/0380ff85-6d9e-42d6-9244-f75033f0a9d1-kube-api-access-5zw76\") pod \"0380ff85-6d9e-42d6-9244-f75033f0a9d1\" (UID: \"0380ff85-6d9e-42d6-9244-f75033f0a9d1\") "
Aug 05 17:36:55.725394 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.725231    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-maas-api-tls\") pod \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\" (UID: \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\") "
Aug 05 17:36:55.725394 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.725249    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0380ff85-6d9e-42d6-9244-f75033f0a9d1-plugins-config-volume\") pod \"0380ff85-6d9e-42d6-9244-f75033f0a9d1\" (UID: \"0380ff85-6d9e-42d6-9244-f75033f0a9d1\") "
Aug 05 17:36:55.725394 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.725300    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-openshift-service-ca\") pod \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\" (UID: \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\") "
Aug 05 17:36:55.725394 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.725365    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md9hp\" (UniqueName: \"kubernetes.io/projected/059878f1-9b24-4dc9-9cb9-a2a60101de11-kube-api-access-md9hp\") pod \"059878f1-9b24-4dc9-9cb9-a2a60101de11\" (UID: \"059878f1-9b24-4dc9-9cb9-a2a60101de11\") "
Aug 05 17:36:55.725394 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.725393    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/059878f1-9b24-4dc9-9cb9-a2a60101de11-plugins-config-volume\") pod \"059878f1-9b24-4dc9-9cb9-a2a60101de11\" (UID: \"059878f1-9b24-4dc9-9cb9-a2a60101de11\") "
Aug 05 17:36:55.725692 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.725444    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsxmr\" (UniqueName: \"kubernetes.io/projected/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-kube-api-access-tsxmr\") pod \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\" (UID: \"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0\") "
Aug 05 17:36:55.725750 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.725727    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0" (UID: "cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:36:55.725830 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.725758    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0380ff85-6d9e-42d6-9244-f75033f0a9d1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0380ff85-6d9e-42d6-9244-f75033f0a9d1" (UID: "0380ff85-6d9e-42d6-9244-f75033f0a9d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:36:55.725914 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.725885    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/059878f1-9b24-4dc9-9cb9-a2a60101de11-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "059878f1-9b24-4dc9-9cb9-a2a60101de11" (UID: "059878f1-9b24-4dc9-9cb9-a2a60101de11"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:36:55.725975 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.725897    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0380ff85-6d9e-42d6-9244-f75033f0a9d1-plugins-config-volume\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:36:55.725975 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.725947    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:36:55.727590 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.727567    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0380ff85-6d9e-42d6-9244-f75033f0a9d1-kube-api-access-5zw76" (OuterVolumeSpecName: "kube-api-access-5zw76") pod "0380ff85-6d9e-42d6-9244-f75033f0a9d1" (UID: "0380ff85-6d9e-42d6-9244-f75033f0a9d1"). InnerVolumeSpecName "kube-api-access-5zw76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:36:55.727677 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.727601    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-kube-api-access-tsxmr" (OuterVolumeSpecName: "kube-api-access-tsxmr") pod "cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0" (UID: "cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0"). InnerVolumeSpecName "kube-api-access-tsxmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:36:55.727910 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.727889    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0" (UID: "cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:36:55.727910 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.727901    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/059878f1-9b24-4dc9-9cb9-a2a60101de11-kube-api-access-md9hp" (OuterVolumeSpecName: "kube-api-access-md9hp") pod "059878f1-9b24-4dc9-9cb9-a2a60101de11" (UID: "059878f1-9b24-4dc9-9cb9-a2a60101de11"). InnerVolumeSpecName "kube-api-access-md9hp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:36:55.815763 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.815682    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:55.826898 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.826878    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zw76\" (UniqueName: \"kubernetes.io/projected/0380ff85-6d9e-42d6-9244-f75033f0a9d1-kube-api-access-5zw76\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:36:55.826898 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.826898    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:36:55.827007 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.826908    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md9hp\" (UniqueName: \"kubernetes.io/projected/059878f1-9b24-4dc9-9cb9-a2a60101de11-kube-api-access-md9hp\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:36:55.827007 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.826919    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/059878f1-9b24-4dc9-9cb9-a2a60101de11-plugins-config-volume\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:36:55.827007 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:55.826928    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsxmr\" (UniqueName: \"kubernetes.io/projected/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0-kube-api-access-tsxmr\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:36:56.014798 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.014767    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bd1857c-f169-4fb1-b48b-c990dbe82454" path="/var/lib/kubelet/pods/0bd1857c-f169-4fb1-b48b-c990dbe82454/volumes"
Aug 05 17:36:56.282443 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.282409    2575 generic.go:356] "Generic (PLEG): container finished" podID="0380ff85-6d9e-42d6-9244-f75033f0a9d1" containerID="4ac5c1282d7bea4ca29bfd488e819943b8eba45bfddd5a8c60a8037d2329d028" exitCode=0
Aug 05 17:36:56.282919 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.282461    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"
Aug 05 17:36:56.282919 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.282489    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g" event={"ID":"0380ff85-6d9e-42d6-9244-f75033f0a9d1","Type":"ContainerDied","Data":"4ac5c1282d7bea4ca29bfd488e819943b8eba45bfddd5a8c60a8037d2329d028"}
Aug 05 17:36:56.282919 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.282536    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g" event={"ID":"0380ff85-6d9e-42d6-9244-f75033f0a9d1","Type":"ContainerDied","Data":"c96e472836d35527a1f5a5a765d2f307ddfc9c44381d36e60fa2537b9be0cec7"}
Aug 05 17:36:56.282919 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.282558    2575 scope.go:117] "RemoveContainer" containerID="4ac5c1282d7bea4ca29bfd488e819943b8eba45bfddd5a8c60a8037d2329d028"
Aug 05 17:36:56.283913 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.283893    2575 generic.go:356] "Generic (PLEG): container finished" podID="059878f1-9b24-4dc9-9cb9-a2a60101de11" containerID="5ef13127d97a10ac93ada12c0bf75bfe5f1925da8ec47afabe57131e1843c61f" exitCode=0
Aug 05 17:36:56.284028 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.283937    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"
Aug 05 17:36:56.284028 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.283986    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr" event={"ID":"059878f1-9b24-4dc9-9cb9-a2a60101de11","Type":"ContainerDied","Data":"5ef13127d97a10ac93ada12c0bf75bfe5f1925da8ec47afabe57131e1843c61f"}
Aug 05 17:36:56.284028 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.284021    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr" event={"ID":"059878f1-9b24-4dc9-9cb9-a2a60101de11","Type":"ContainerDied","Data":"0a28a77806a7b922f857a19ec303846f978a7c88f460933a0e149908e8549904"}
Aug 05 17:36:56.285668 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.285643    2575 generic.go:356] "Generic (PLEG): container finished" podID="cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0" containerID="5bb82e76c6f020379bfd42e89da5a0626eb9f5e543f73c21aefa6594e07e522b" exitCode=0
Aug 05 17:36:56.285768 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.285695    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"
Aug 05 17:36:56.285768 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.285704    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n" event={"ID":"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0","Type":"ContainerDied","Data":"5bb82e76c6f020379bfd42e89da5a0626eb9f5e543f73c21aefa6594e07e522b"}
Aug 05 17:36:56.285768 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.285746    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n" event={"ID":"cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0","Type":"ContainerDied","Data":"ea8d2cdee36919a96d330ef5163d75192843a9c86841e1837468807653015ea5"}
Aug 05 17:36:56.292691 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.292677    2575 scope.go:117] "RemoveContainer" containerID="4ac5c1282d7bea4ca29bfd488e819943b8eba45bfddd5a8c60a8037d2329d028"
Aug 05 17:36:56.292950 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:36:56.292932    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ac5c1282d7bea4ca29bfd488e819943b8eba45bfddd5a8c60a8037d2329d028\": container with ID starting with 4ac5c1282d7bea4ca29bfd488e819943b8eba45bfddd5a8c60a8037d2329d028 not found: ID does not exist" containerID="4ac5c1282d7bea4ca29bfd488e819943b8eba45bfddd5a8c60a8037d2329d028"
Aug 05 17:36:56.293008 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.292957    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ac5c1282d7bea4ca29bfd488e819943b8eba45bfddd5a8c60a8037d2329d028"} err="failed to get container status \"4ac5c1282d7bea4ca29bfd488e819943b8eba45bfddd5a8c60a8037d2329d028\": rpc error: code = NotFound desc = could not find container \"4ac5c1282d7bea4ca29bfd488e819943b8eba45bfddd5a8c60a8037d2329d028\": container with ID starting with 4ac5c1282d7bea4ca29bfd488e819943b8eba45bfddd5a8c60a8037d2329d028 not found: ID does not exist"
Aug 05 17:36:56.293008 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.292972    2575 scope.go:117] "RemoveContainer" containerID="5ef13127d97a10ac93ada12c0bf75bfe5f1925da8ec47afabe57131e1843c61f"
Aug 05 17:36:56.300631 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.300614    2575 scope.go:117] "RemoveContainer" containerID="5ef13127d97a10ac93ada12c0bf75bfe5f1925da8ec47afabe57131e1843c61f"
Aug 05 17:36:56.300868 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:36:56.300850    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ef13127d97a10ac93ada12c0bf75bfe5f1925da8ec47afabe57131e1843c61f\": container with ID starting with 5ef13127d97a10ac93ada12c0bf75bfe5f1925da8ec47afabe57131e1843c61f not found: ID does not exist" containerID="5ef13127d97a10ac93ada12c0bf75bfe5f1925da8ec47afabe57131e1843c61f"
Aug 05 17:36:56.300925 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.300875    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef13127d97a10ac93ada12c0bf75bfe5f1925da8ec47afabe57131e1843c61f"} err="failed to get container status \"5ef13127d97a10ac93ada12c0bf75bfe5f1925da8ec47afabe57131e1843c61f\": rpc error: code = NotFound desc = could not find container \"5ef13127d97a10ac93ada12c0bf75bfe5f1925da8ec47afabe57131e1843c61f\": container with ID starting with 5ef13127d97a10ac93ada12c0bf75bfe5f1925da8ec47afabe57131e1843c61f not found: ID does not exist"
Aug 05 17:36:56.300925 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.300890    2575 scope.go:117] "RemoveContainer" containerID="5bb82e76c6f020379bfd42e89da5a0626eb9f5e543f73c21aefa6594e07e522b"
Aug 05 17:36:56.308715 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.308685    2575 scope.go:117] "RemoveContainer" containerID="5bb82e76c6f020379bfd42e89da5a0626eb9f5e543f73c21aefa6594e07e522b"
Aug 05 17:36:56.309165 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:36:56.309143    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bb82e76c6f020379bfd42e89da5a0626eb9f5e543f73c21aefa6594e07e522b\": container with ID starting with 5bb82e76c6f020379bfd42e89da5a0626eb9f5e543f73c21aefa6594e07e522b not found: ID does not exist" containerID="5bb82e76c6f020379bfd42e89da5a0626eb9f5e543f73c21aefa6594e07e522b"
Aug 05 17:36:56.309262 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.309171    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb82e76c6f020379bfd42e89da5a0626eb9f5e543f73c21aefa6594e07e522b"} err="failed to get container status \"5bb82e76c6f020379bfd42e89da5a0626eb9f5e543f73c21aefa6594e07e522b\": rpc error: code = NotFound desc = could not find container \"5bb82e76c6f020379bfd42e89da5a0626eb9f5e543f73c21aefa6594e07e522b\": container with ID starting with 5bb82e76c6f020379bfd42e89da5a0626eb9f5e543f73c21aefa6594e07e522b not found: ID does not exist"
Aug 05 17:36:56.310914 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.310895    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"]
Aug 05 17:36:56.315793 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.315768    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9d56f4-764476cdf6-c2kkr"]
Aug 05 17:36:56.327550 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.327530    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"]
Aug 05 17:36:56.336113 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.336090    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9d56f4-5dff88f484-hfc2g"]
Aug 05 17:36:56.344151 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.344131    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"]
Aug 05 17:36:56.348199 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:56.348181    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9d56f4-74b578cd89-ss55n"]
Aug 05 17:36:58.014149 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:58.014115    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0380ff85-6d9e-42d6-9244-f75033f0a9d1" path="/var/lib/kubelet/pods/0380ff85-6d9e-42d6-9244-f75033f0a9d1/volumes"
Aug 05 17:36:58.014514 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:58.014474    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="059878f1-9b24-4dc9-9cb9-a2a60101de11" path="/var/lib/kubelet/pods/059878f1-9b24-4dc9-9cb9-a2a60101de11/volumes"
Aug 05 17:36:58.014840 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:58.014802    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0" path="/var/lib/kubelet/pods/cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0/volumes"
Aug 05 17:36:58.798165 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:36:58.798124    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:37:02.283312 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:02.283281    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:37:02.366826 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:02.366762    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:37:02.508786 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:02.508752    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:37:05.759761 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.759727    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq"]
Aug 05 17:37:05.760168 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.760138    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="059878f1-9b24-4dc9-9cb9-a2a60101de11" containerName="payload-pre-processing"
Aug 05 17:37:05.760168 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.760150    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="059878f1-9b24-4dc9-9cb9-a2a60101de11" containerName="payload-pre-processing"
Aug 05 17:37:05.760168 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.760161    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bd1857c-f169-4fb1-b48b-c990dbe82454" containerName="revoke-keys"
Aug 05 17:37:05.760168 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.760167    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bd1857c-f169-4fb1-b48b-c990dbe82454" containerName="revoke-keys"
Aug 05 17:37:05.760320 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.760187    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0" containerName="maas-api"
Aug 05 17:37:05.760320 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.760193    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0" containerName="maas-api"
Aug 05 17:37:05.760320 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.760206    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0380ff85-6d9e-42d6-9244-f75033f0a9d1" containerName="payload-processing"
Aug 05 17:37:05.760320 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.760212    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0380ff85-6d9e-42d6-9244-f75033f0a9d1" containerName="payload-processing"
Aug 05 17:37:05.760320 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.760266    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="059878f1-9b24-4dc9-9cb9-a2a60101de11" containerName="payload-pre-processing"
Aug 05 17:37:05.760320 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.760275    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bd1857c-f169-4fb1-b48b-c990dbe82454" containerName="revoke-keys"
Aug 05 17:37:05.760320 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.760282    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfc47d12-10a0-489e-8fdf-f0b4c4cb81d0" containerName="maas-api"
Aug 05 17:37:05.760320 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.760287    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0380ff85-6d9e-42d6-9244-f75033f0a9d1" containerName="payload-processing"
Aug 05 17:37:05.765286 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.765258    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq"
Aug 05 17:37:05.767708 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.767684    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:37:05.774705 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.774678    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq"]
Aug 05 17:37:05.829152 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.829119    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4added1-61fb-4ca0-9b6f-07066ab566aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq\" (UID: \"e4added1-61fb-4ca0-9b6f-07066ab566aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq"
Aug 05 17:37:05.930302 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.930271    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4added1-61fb-4ca0-9b6f-07066ab566aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq\" (UID: \"e4added1-61fb-4ca0-9b6f-07066ab566aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq"
Aug 05 17:37:05.930862 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:05.930842    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4added1-61fb-4ca0-9b6f-07066ab566aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq\" (UID: \"e4added1-61fb-4ca0-9b6f-07066ab566aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq"
Aug 05 17:37:06.079038 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:06.078967    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:37:06.087005 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:06.086986    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq"
Aug 05 17:37:06.238671 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:06.238649    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq"]
Aug 05 17:37:06.240982 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:37:06.240957    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4added1_61fb_4ca0_9b6f_07066ab566aa.slice/crio-2cc39306bb1d15584eafd293349b1e53276fa6ca43e96cb676beda92f40507ac WatchSource:0}: Error finding container 2cc39306bb1d15584eafd293349b1e53276fa6ca43e96cb676beda92f40507ac: Status 404 returned error can't find the container with id 2cc39306bb1d15584eafd293349b1e53276fa6ca43e96cb676beda92f40507ac
Aug 05 17:37:06.345211 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:06.345132    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq" event={"ID":"e4added1-61fb-4ca0-9b6f-07066ab566aa","Type":"ContainerStarted","Data":"2cc39306bb1d15584eafd293349b1e53276fa6ca43e96cb676beda92f40507ac"}
Aug 05 17:37:07.352102 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:07.352017    2575 generic.go:356] "Generic (PLEG): container finished" podID="e4added1-61fb-4ca0-9b6f-07066ab566aa" containerID="fc65d9e94be5d4eca4ae20edd7e456969ae70f76ea80a8290a5aa462d3c9dbad" exitCode=0
Aug 05 17:37:07.352467 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:07.352101    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq" event={"ID":"e4added1-61fb-4ca0-9b6f-07066ab566aa","Type":"ContainerDied","Data":"fc65d9e94be5d4eca4ae20edd7e456969ae70f76ea80a8290a5aa462d3c9dbad"}
Aug 05 17:37:08.488049 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:08.488025    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq"
Aug 05 17:37:08.558680 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:08.558654    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4added1-61fb-4ca0-9b6f-07066ab566aa-maas-api-service-ca\") pod \"e4added1-61fb-4ca0-9b6f-07066ab566aa\" (UID: \"e4added1-61fb-4ca0-9b6f-07066ab566aa\") "
Aug 05 17:37:08.559034 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:08.559013    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4added1-61fb-4ca0-9b6f-07066ab566aa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e4added1-61fb-4ca0-9b6f-07066ab566aa" (UID: "e4added1-61fb-4ca0-9b6f-07066ab566aa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:37:08.659996 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:08.659971    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4added1-61fb-4ca0-9b6f-07066ab566aa-maas-api-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:37:09.363158 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:09.363126    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq"
Aug 05 17:37:09.363322 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:09.363158    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq" event={"ID":"e4added1-61fb-4ca0-9b6f-07066ab566aa","Type":"ContainerDied","Data":"2cc39306bb1d15584eafd293349b1e53276fa6ca43e96cb676beda92f40507ac"}
Aug 05 17:37:09.363322 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:09.363209    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cc39306bb1d15584eafd293349b1e53276fa6ca43e96cb676beda92f40507ac"
Aug 05 17:37:13.809911 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:13.809876    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:37:15.876290 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:15.876255    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"]
Aug 05 17:37:15.876765 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:15.876572    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt" podUID="ead56184-118b-4322-9a21-1796c1478caa" containerName="maas-api" containerID="cri-o://a7ae371f71ba4f3d9d22866e5786197292d838edeb1411e43076ff8c895b98c3" gracePeriod=30
Aug 05 17:37:15.900546 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:15.900514    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:37:15.928996 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:15.928515    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"]
Aug 05 17:37:15.928996 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:15.928731    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw" podUID="42f3f566-7a7c-4406-90cb-169dda08c516" containerName="payload-processing" containerID="cri-o://92d34467f84c106ff6e062c8f130785d150d1f77a5669ee1f04a375c6d10e1c9" gracePeriod=30
Aug 05 17:37:15.977801 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:15.977763    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:37:16.078491 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.078448    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:37:16.085755 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.085625    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq"]
Aug 05 17:37:16.088027 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.088004    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-09e18b-qdkkq"]
Aug 05 17:37:16.178636 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.178603    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:37:16.207733 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.207713    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:37:16.210988 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.210970    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"
Aug 05 17:37:16.326870 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.326846    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ead56184-118b-4322-9a21-1796c1478caa-maas-api-tls\") pod \"ead56184-118b-4322-9a21-1796c1478caa\" (UID: \"ead56184-118b-4322-9a21-1796c1478caa\") "
Aug 05 17:37:16.327026 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.326894    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ead56184-118b-4322-9a21-1796c1478caa-openshift-service-ca\") pod \"ead56184-118b-4322-9a21-1796c1478caa\" (UID: \"ead56184-118b-4322-9a21-1796c1478caa\") "
Aug 05 17:37:16.327026 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.326951    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42f3f566-7a7c-4406-90cb-169dda08c516-plugins-config-volume\") pod \"42f3f566-7a7c-4406-90cb-169dda08c516\" (UID: \"42f3f566-7a7c-4406-90cb-169dda08c516\") "
Aug 05 17:37:16.327135 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.327030    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f847s\" (UniqueName: \"kubernetes.io/projected/42f3f566-7a7c-4406-90cb-169dda08c516-kube-api-access-f847s\") pod \"42f3f566-7a7c-4406-90cb-169dda08c516\" (UID: \"42f3f566-7a7c-4406-90cb-169dda08c516\") "
Aug 05 17:37:16.327135 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.327069    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lh6g\" (UniqueName: \"kubernetes.io/projected/ead56184-118b-4322-9a21-1796c1478caa-kube-api-access-9lh6g\") pod \"ead56184-118b-4322-9a21-1796c1478caa\" (UID: \"ead56184-118b-4322-9a21-1796c1478caa\") "
Aug 05 17:37:16.327307 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.327284    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ead56184-118b-4322-9a21-1796c1478caa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ead56184-118b-4322-9a21-1796c1478caa" (UID: "ead56184-118b-4322-9a21-1796c1478caa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:37:16.327398 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.327374    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42f3f566-7a7c-4406-90cb-169dda08c516-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "42f3f566-7a7c-4406-90cb-169dda08c516" (UID: "42f3f566-7a7c-4406-90cb-169dda08c516"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:37:16.329049 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.329016    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ead56184-118b-4322-9a21-1796c1478caa-kube-api-access-9lh6g" (OuterVolumeSpecName: "kube-api-access-9lh6g") pod "ead56184-118b-4322-9a21-1796c1478caa" (UID: "ead56184-118b-4322-9a21-1796c1478caa"). InnerVolumeSpecName "kube-api-access-9lh6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:37:16.329049 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.329027    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42f3f566-7a7c-4406-90cb-169dda08c516-kube-api-access-f847s" (OuterVolumeSpecName: "kube-api-access-f847s") pod "42f3f566-7a7c-4406-90cb-169dda08c516" (UID: "42f3f566-7a7c-4406-90cb-169dda08c516"). InnerVolumeSpecName "kube-api-access-f847s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:37:16.329191 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.329075    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead56184-118b-4322-9a21-1796c1478caa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ead56184-118b-4322-9a21-1796c1478caa" (UID: "ead56184-118b-4322-9a21-1796c1478caa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:37:16.398993 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.398928    2575 generic.go:356] "Generic (PLEG): container finished" podID="ead56184-118b-4322-9a21-1796c1478caa" containerID="a7ae371f71ba4f3d9d22866e5786197292d838edeb1411e43076ff8c895b98c3" exitCode=0
Aug 05 17:37:16.398993 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.398980    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"
Aug 05 17:37:16.399143 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.399020    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt" event={"ID":"ead56184-118b-4322-9a21-1796c1478caa","Type":"ContainerDied","Data":"a7ae371f71ba4f3d9d22866e5786197292d838edeb1411e43076ff8c895b98c3"}
Aug 05 17:37:16.399143 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.399082    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt" event={"ID":"ead56184-118b-4322-9a21-1796c1478caa","Type":"ContainerDied","Data":"85cda35363bae82c2de315e05e7e9cde18c99995885d827dea999d89a0b87b5c"}
Aug 05 17:37:16.399143 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.399118    2575 scope.go:117] "RemoveContainer" containerID="a7ae371f71ba4f3d9d22866e5786197292d838edeb1411e43076ff8c895b98c3"
Aug 05 17:37:16.400497 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.400472    2575 generic.go:356] "Generic (PLEG): container finished" podID="42f3f566-7a7c-4406-90cb-169dda08c516" containerID="92d34467f84c106ff6e062c8f130785d150d1f77a5669ee1f04a375c6d10e1c9" exitCode=0
Aug 05 17:37:16.400587 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.400512    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"
Aug 05 17:37:16.400587 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.400548    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw" event={"ID":"42f3f566-7a7c-4406-90cb-169dda08c516","Type":"ContainerDied","Data":"92d34467f84c106ff6e062c8f130785d150d1f77a5669ee1f04a375c6d10e1c9"}
Aug 05 17:37:16.400705 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.400599    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw" event={"ID":"42f3f566-7a7c-4406-90cb-169dda08c516","Type":"ContainerDied","Data":"35efbc04ac0d0a5c60438151fd251d5f3cc7688887d36dffa7415ff8c6b220fc"}
Aug 05 17:37:16.408128 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.407994    2575 scope.go:117] "RemoveContainer" containerID="a7ae371f71ba4f3d9d22866e5786197292d838edeb1411e43076ff8c895b98c3"
Aug 05 17:37:16.408357 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:37:16.408258    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7ae371f71ba4f3d9d22866e5786197292d838edeb1411e43076ff8c895b98c3\": container with ID starting with a7ae371f71ba4f3d9d22866e5786197292d838edeb1411e43076ff8c895b98c3 not found: ID does not exist" containerID="a7ae371f71ba4f3d9d22866e5786197292d838edeb1411e43076ff8c895b98c3"
Aug 05 17:37:16.408357 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.408295    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7ae371f71ba4f3d9d22866e5786197292d838edeb1411e43076ff8c895b98c3"} err="failed to get container status \"a7ae371f71ba4f3d9d22866e5786197292d838edeb1411e43076ff8c895b98c3\": rpc error: code = NotFound desc = could not find container \"a7ae371f71ba4f3d9d22866e5786197292d838edeb1411e43076ff8c895b98c3\": container with ID starting with a7ae371f71ba4f3d9d22866e5786197292d838edeb1411e43076ff8c895b98c3 not found: ID does not exist"
Aug 05 17:37:16.408357 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.408318    2575 scope.go:117] "RemoveContainer" containerID="92d34467f84c106ff6e062c8f130785d150d1f77a5669ee1f04a375c6d10e1c9"
Aug 05 17:37:16.416774 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.416757    2575 scope.go:117] "RemoveContainer" containerID="92d34467f84c106ff6e062c8f130785d150d1f77a5669ee1f04a375c6d10e1c9"
Aug 05 17:37:16.417021 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:37:16.417004    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92d34467f84c106ff6e062c8f130785d150d1f77a5669ee1f04a375c6d10e1c9\": container with ID starting with 92d34467f84c106ff6e062c8f130785d150d1f77a5669ee1f04a375c6d10e1c9 not found: ID does not exist" containerID="92d34467f84c106ff6e062c8f130785d150d1f77a5669ee1f04a375c6d10e1c9"
Aug 05 17:37:16.417097 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.417026    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92d34467f84c106ff6e062c8f130785d150d1f77a5669ee1f04a375c6d10e1c9"} err="failed to get container status \"92d34467f84c106ff6e062c8f130785d150d1f77a5669ee1f04a375c6d10e1c9\": rpc error: code = NotFound desc = could not find container \"92d34467f84c106ff6e062c8f130785d150d1f77a5669ee1f04a375c6d10e1c9\": container with ID starting with 92d34467f84c106ff6e062c8f130785d150d1f77a5669ee1f04a375c6d10e1c9 not found: ID does not exist"
Aug 05 17:37:16.425347 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.425322    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"]
Aug 05 17:37:16.428442 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.428373    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f847s\" (UniqueName: \"kubernetes.io/projected/42f3f566-7a7c-4406-90cb-169dda08c516-kube-api-access-f847s\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:37:16.428578 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.428443    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lh6g\" (UniqueName: \"kubernetes.io/projected/ead56184-118b-4322-9a21-1796c1478caa-kube-api-access-9lh6g\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:37:16.428578 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.428459    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ead56184-118b-4322-9a21-1796c1478caa-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:37:16.428578 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.428495    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ead56184-118b-4322-9a21-1796c1478caa-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:37:16.428578 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.428509    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42f3f566-7a7c-4406-90cb-169dda08c516-plugins-config-volume\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:37:16.430816 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.430789    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-09e18b-68f6b96d7f-9kqqt"]
Aug 05 17:37:16.442852 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.442831    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"]
Aug 05 17:37:16.448982 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.448963    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-09e18b-6f5cf5f488-ll8jw"]
Aug 05 17:37:16.454362 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:16.454339    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:37:18.014119 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:18.014088    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42f3f566-7a7c-4406-90cb-169dda08c516" path="/var/lib/kubelet/pods/42f3f566-7a7c-4406-90cb-169dda08c516/volumes"
Aug 05 17:37:18.014526 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:18.014510    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4added1-61fb-4ca0-9b6f-07066ab566aa" path="/var/lib/kubelet/pods/e4added1-61fb-4ca0-9b6f-07066ab566aa/volumes"
Aug 05 17:37:18.014921 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:18.014908    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ead56184-118b-4322-9a21-1796c1478caa" path="/var/lib/kubelet/pods/ead56184-118b-4322-9a21-1796c1478caa/volumes"
Aug 05 17:37:19.992769 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:19.992738    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:37:21.534453 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:21.534413    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:37:58.537060 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:58.537024    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:37:58.964031 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:37:58.963990    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:04.809098 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:04.809065    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:10.838798 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:10.838757    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:10.939030 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:10.938995    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:11.150743 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.150656    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:11.366989 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.366953    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:11.480212 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.480181    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d"]
Aug 05 17:38:11.480612 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.480597    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42f3f566-7a7c-4406-90cb-169dda08c516" containerName="payload-processing"
Aug 05 17:38:11.480663 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.480616    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f3f566-7a7c-4406-90cb-169dda08c516" containerName="payload-processing"
Aug 05 17:38:11.480663 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.480631    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead56184-118b-4322-9a21-1796c1478caa" containerName="maas-api"
Aug 05 17:38:11.480663 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.480636    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead56184-118b-4322-9a21-1796c1478caa" containerName="maas-api"
Aug 05 17:38:11.480663 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.480643    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4added1-61fb-4ca0-9b6f-07066ab566aa" containerName="revoke-keys"
Aug 05 17:38:11.480663 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.480649    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4added1-61fb-4ca0-9b6f-07066ab566aa" containerName="revoke-keys"
Aug 05 17:38:11.480845 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.480725    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="42f3f566-7a7c-4406-90cb-169dda08c516" containerName="payload-processing"
Aug 05 17:38:11.480845 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.480734    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ead56184-118b-4322-9a21-1796c1478caa" containerName="maas-api"
Aug 05 17:38:11.480845 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.480740    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4added1-61fb-4ca0-9b6f-07066ab566aa" containerName="revoke-keys"
Aug 05 17:38:11.485137 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.485121    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d"
Aug 05 17:38:11.489064 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.489043    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:38:11.494956 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.494928    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d"]
Aug 05 17:38:11.621394 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.621364    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5aa638e-7eba-452b-b42f-c3541a9c8235-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d\" (UID: \"d5aa638e-7eba-452b-b42f-c3541a9c8235\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d"
Aug 05 17:38:11.722027 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.721995    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5aa638e-7eba-452b-b42f-c3541a9c8235-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d\" (UID: \"d5aa638e-7eba-452b-b42f-c3541a9c8235\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d"
Aug 05 17:38:11.722676 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.722652    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5aa638e-7eba-452b-b42f-c3541a9c8235-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d\" (UID: \"d5aa638e-7eba-452b-b42f-c3541a9c8235\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d"
Aug 05 17:38:11.796427 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.796346    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d"
Aug 05 17:38:11.932466 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:11.932438    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d"]
Aug 05 17:38:11.935752 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:38:11.935723    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5aa638e_7eba_452b_b42f_c3541a9c8235.slice/crio-e02413cfbc3dba5d2e949b25fe1aebe3c33a3aa26e8ac7a173edb1925453ff00 WatchSource:0}: Error finding container e02413cfbc3dba5d2e949b25fe1aebe3c33a3aa26e8ac7a173edb1925453ff00: Status 404 returned error can't find the container with id e02413cfbc3dba5d2e949b25fe1aebe3c33a3aa26e8ac7a173edb1925453ff00
Aug 05 17:38:12.683295 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:12.683268    2575 generic.go:356] "Generic (PLEG): container finished" podID="d5aa638e-7eba-452b-b42f-c3541a9c8235" containerID="91d02fe924c0b4315c3ac1dfd24092acb55dcbc0cd6786d15c3c1e9450662c04" exitCode=0
Aug 05 17:38:12.683420 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:12.683348    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d" event={"ID":"d5aa638e-7eba-452b-b42f-c3541a9c8235","Type":"ContainerDied","Data":"91d02fe924c0b4315c3ac1dfd24092acb55dcbc0cd6786d15c3c1e9450662c04"}
Aug 05 17:38:12.683420 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:12.683394    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d" event={"ID":"d5aa638e-7eba-452b-b42f-c3541a9c8235","Type":"ContainerStarted","Data":"e02413cfbc3dba5d2e949b25fe1aebe3c33a3aa26e8ac7a173edb1925453ff00"}
Aug 05 17:38:13.819758 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:13.819731    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d"
Aug 05 17:38:13.941439 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:13.941375    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5aa638e-7eba-452b-b42f-c3541a9c8235-maas-api-service-ca\") pod \"d5aa638e-7eba-452b-b42f-c3541a9c8235\" (UID: \"d5aa638e-7eba-452b-b42f-c3541a9c8235\") "
Aug 05 17:38:13.941685 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:13.941665    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5aa638e-7eba-452b-b42f-c3541a9c8235-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d5aa638e-7eba-452b-b42f-c3541a9c8235" (UID: "d5aa638e-7eba-452b-b42f-c3541a9c8235"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:38:14.042579 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:14.042554    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5aa638e-7eba-452b-b42f-c3541a9c8235-maas-api-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:14.693636 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:14.693606    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d"
Aug 05 17:38:14.693830 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:14.693610    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d" event={"ID":"d5aa638e-7eba-452b-b42f-c3541a9c8235","Type":"ContainerDied","Data":"e02413cfbc3dba5d2e949b25fe1aebe3c33a3aa26e8ac7a173edb1925453ff00"}
Aug 05 17:38:14.693830 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:14.693743    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e02413cfbc3dba5d2e949b25fe1aebe3c33a3aa26e8ac7a173edb1925453ff00"
Aug 05 17:38:22.053400 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.053356    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"]
Aug 05 17:38:22.053897 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.053697    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff" podUID="2ba74793-bd46-4f96-a13c-bd7fd7fe0498" containerName="maas-api" containerID="cri-o://298c395b3d40c3eb2caa5c35fa0667a904b82203f78f91a3b7601ad8ffc5faaf" gracePeriod=30
Aug 05 17:38:22.089373 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.089323    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:22.185206 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.185174    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:22.261850 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.261795    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:22.299316 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.299288    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d"]
Aug 05 17:38:22.301485 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.301457    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-40374d-98v2d"]
Aug 05 17:38:22.317704 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.317652    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:38:22.337930 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.337834    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:22.417326 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.417297    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzwpd\" (UniqueName: \"kubernetes.io/projected/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-kube-api-access-pzwpd\") pod \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\" (UID: \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\") "
Aug 05 17:38:22.417451 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.417341    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-maas-api-tls\") pod \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\" (UID: \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\") "
Aug 05 17:38:22.417451 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.417375    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-openshift-service-ca\") pod \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\" (UID: \"2ba74793-bd46-4f96-a13c-bd7fd7fe0498\") "
Aug 05 17:38:22.417796 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.417771    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2ba74793-bd46-4f96-a13c-bd7fd7fe0498" (UID: "2ba74793-bd46-4f96-a13c-bd7fd7fe0498"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:38:22.419306 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.419282    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2ba74793-bd46-4f96-a13c-bd7fd7fe0498" (UID: "2ba74793-bd46-4f96-a13c-bd7fd7fe0498"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:38:22.419420 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.419402    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-kube-api-access-pzwpd" (OuterVolumeSpecName: "kube-api-access-pzwpd") pod "2ba74793-bd46-4f96-a13c-bd7fd7fe0498" (UID: "2ba74793-bd46-4f96-a13c-bd7fd7fe0498"). InnerVolumeSpecName "kube-api-access-pzwpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:22.518524 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.518481    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:22.518524 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.518508    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzwpd\" (UniqueName: \"kubernetes.io/projected/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-kube-api-access-pzwpd\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:22.518524 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.518519    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ba74793-bd46-4f96-a13c-bd7fd7fe0498-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:22.674695 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.674658    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:22.735038 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.735010    2575 generic.go:356] "Generic (PLEG): container finished" podID="2ba74793-bd46-4f96-a13c-bd7fd7fe0498" containerID="298c395b3d40c3eb2caa5c35fa0667a904b82203f78f91a3b7601ad8ffc5faaf" exitCode=0
Aug 05 17:38:22.735165 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.735066    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"
Aug 05 17:38:22.735165 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.735096    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff" event={"ID":"2ba74793-bd46-4f96-a13c-bd7fd7fe0498","Type":"ContainerDied","Data":"298c395b3d40c3eb2caa5c35fa0667a904b82203f78f91a3b7601ad8ffc5faaf"}
Aug 05 17:38:22.735165 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.735144    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff" event={"ID":"2ba74793-bd46-4f96-a13c-bd7fd7fe0498","Type":"ContainerDied","Data":"15d3df9d84303d9ab9e18de5e2ac24ee769c35c7e986d4c93cdb357e45ff7368"}
Aug 05 17:38:22.735268 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.735167    2575 scope.go:117] "RemoveContainer" containerID="298c395b3d40c3eb2caa5c35fa0667a904b82203f78f91a3b7601ad8ffc5faaf"
Aug 05 17:38:22.744463 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.744445    2575 scope.go:117] "RemoveContainer" containerID="298c395b3d40c3eb2caa5c35fa0667a904b82203f78f91a3b7601ad8ffc5faaf"
Aug 05 17:38:22.744699 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:38:22.744675    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"298c395b3d40c3eb2caa5c35fa0667a904b82203f78f91a3b7601ad8ffc5faaf\": container with ID starting with 298c395b3d40c3eb2caa5c35fa0667a904b82203f78f91a3b7601ad8ffc5faaf not found: ID does not exist" containerID="298c395b3d40c3eb2caa5c35fa0667a904b82203f78f91a3b7601ad8ffc5faaf"
Aug 05 17:38:22.744761 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.744712    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"298c395b3d40c3eb2caa5c35fa0667a904b82203f78f91a3b7601ad8ffc5faaf"} err="failed to get container status \"298c395b3d40c3eb2caa5c35fa0667a904b82203f78f91a3b7601ad8ffc5faaf\": rpc error: code = NotFound desc = could not find container \"298c395b3d40c3eb2caa5c35fa0667a904b82203f78f91a3b7601ad8ffc5faaf\": container with ID starting with 298c395b3d40c3eb2caa5c35fa0667a904b82203f78f91a3b7601ad8ffc5faaf not found: ID does not exist"
Aug 05 17:38:22.759623 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.759600    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"]
Aug 05 17:38:22.764998 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:22.764977    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-40374d-5fd7ff4c77-gntff"]
Aug 05 17:38:24.014400 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:24.014366    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ba74793-bd46-4f96-a13c-bd7fd7fe0498" path="/var/lib/kubelet/pods/2ba74793-bd46-4f96-a13c-bd7fd7fe0498/volumes"
Aug 05 17:38:24.014759 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:24.014698    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5aa638e-7eba-452b-b42f-c3541a9c8235" path="/var/lib/kubelet/pods/d5aa638e-7eba-452b-b42f-c3541a9c8235/volumes"
Aug 05 17:38:24.402222 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:24.402134    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:38:29.048996 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.048955    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:29.123164 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.123125    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:29.343044 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.342955    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:29.538080 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.538042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:29.678721 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.678693    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x"]
Aug 05 17:38:29.679113 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.679100    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ba74793-bd46-4f96-a13c-bd7fd7fe0498" containerName="maas-api"
Aug 05 17:38:29.679165 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.679114    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ba74793-bd46-4f96-a13c-bd7fd7fe0498" containerName="maas-api"
Aug 05 17:38:29.679165 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.679136    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5aa638e-7eba-452b-b42f-c3541a9c8235" containerName="revoke-keys"
Aug 05 17:38:29.679165 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.679142    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5aa638e-7eba-452b-b42f-c3541a9c8235" containerName="revoke-keys"
Aug 05 17:38:29.679256 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.679197    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ba74793-bd46-4f96-a13c-bd7fd7fe0498" containerName="maas-api"
Aug 05 17:38:29.679256 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.679206    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5aa638e-7eba-452b-b42f-c3541a9c8235" containerName="revoke-keys"
Aug 05 17:38:29.683765 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.683747    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x"
Aug 05 17:38:29.686200 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.686181    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:38:29.692717 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.692696    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x"]
Aug 05 17:38:29.784799 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.784767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f676e52e-e1e3-4e92-bc7b-373ed8f84505-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x\" (UID: \"f676e52e-e1e3-4e92-bc7b-373ed8f84505\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x"
Aug 05 17:38:29.885612 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.885577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f676e52e-e1e3-4e92-bc7b-373ed8f84505-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x\" (UID: \"f676e52e-e1e3-4e92-bc7b-373ed8f84505\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x"
Aug 05 17:38:29.886196 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.886179    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f676e52e-e1e3-4e92-bc7b-373ed8f84505-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x\" (UID: \"f676e52e-e1e3-4e92-bc7b-373ed8f84505\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x"
Aug 05 17:38:29.995057 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:29.994984    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x"
Aug 05 17:38:30.127775 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:30.127747    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x"]
Aug 05 17:38:30.128428 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:38:30.128398    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf676e52e_e1e3_4e92_bc7b_373ed8f84505.slice/crio-716b2cd9eba426eab89ae1d443b181ea7925e6a13c241eb2118d0be6eb8322e4 WatchSource:0}: Error finding container 716b2cd9eba426eab89ae1d443b181ea7925e6a13c241eb2118d0be6eb8322e4: Status 404 returned error can't find the container with id 716b2cd9eba426eab89ae1d443b181ea7925e6a13c241eb2118d0be6eb8322e4
Aug 05 17:38:30.776915 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:30.776879    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x" event={"ID":"f676e52e-e1e3-4e92-bc7b-373ed8f84505","Type":"ContainerStarted","Data":"24f4f8b338ac762024ae0a562b64f441d37b5937074923db8e264caefafdf64d"}
Aug 05 17:38:30.777071 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:30.776935    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x" event={"ID":"f676e52e-e1e3-4e92-bc7b-373ed8f84505","Type":"ContainerStarted","Data":"716b2cd9eba426eab89ae1d443b181ea7925e6a13c241eb2118d0be6eb8322e4"}
Aug 05 17:38:30.801148 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:30.801100    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x" podStartSLOduration=1.801083963 podStartE2EDuration="1.801083963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:38:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:38:30.799362204 +0000 UTC m=+3565.248908503" watchObservedRunningTime="2026-08-05 17:38:30.801083963 +0000 UTC m=+3565.250630261"
Aug 05 17:38:31.783007 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:31.782972    2575 generic.go:356] "Generic (PLEG): container finished" podID="f676e52e-e1e3-4e92-bc7b-373ed8f84505" containerID="24f4f8b338ac762024ae0a562b64f441d37b5937074923db8e264caefafdf64d" exitCode=0
Aug 05 17:38:31.783407 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:31.783019    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x" event={"ID":"f676e52e-e1e3-4e92-bc7b-373ed8f84505","Type":"ContainerDied","Data":"24f4f8b338ac762024ae0a562b64f441d37b5937074923db8e264caefafdf64d"}
Aug 05 17:38:32.917154 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:32.917129    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x"
Aug 05 17:38:33.014651 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:33.014618    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f676e52e-e1e3-4e92-bc7b-373ed8f84505-maas-api-service-ca\") pod \"f676e52e-e1e3-4e92-bc7b-373ed8f84505\" (UID: \"f676e52e-e1e3-4e92-bc7b-373ed8f84505\") "
Aug 05 17:38:33.015021 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:33.014998    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f676e52e-e1e3-4e92-bc7b-373ed8f84505-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f676e52e-e1e3-4e92-bc7b-373ed8f84505" (UID: "f676e52e-e1e3-4e92-bc7b-373ed8f84505"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:38:33.116003 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:33.115918    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f676e52e-e1e3-4e92-bc7b-373ed8f84505-maas-api-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:33.794139 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:33.794108    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x" event={"ID":"f676e52e-e1e3-4e92-bc7b-373ed8f84505","Type":"ContainerDied","Data":"716b2cd9eba426eab89ae1d443b181ea7925e6a13c241eb2118d0be6eb8322e4"}
Aug 05 17:38:33.794139 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:33.794124    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x"
Aug 05 17:38:33.794333 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:33.794163    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="716b2cd9eba426eab89ae1d443b181ea7925e6a13c241eb2118d0be6eb8322e4"
Aug 05 17:38:36.556159 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:36.556117    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:40.190324 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.190287    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"]
Aug 05 17:38:40.190800 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.190541    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4" podUID="6f8ce195-061b-4dc8-a0bd-58e400400047" containerName="maas-api" containerID="cri-o://79e24829edec8b3a4b5b580b4d2bc236397b693e4273a430dca10d2040039877" gracePeriod=30
Aug 05 17:38:40.220042 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.220009    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:40.252266 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.252236    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"]
Aug 05 17:38:40.252521 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.252488    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx" podUID="bf6d32d1-adfe-4fde-9655-f58139588bb1" containerName="payload-processing" containerID="cri-o://91d004976aa78c995cdf352d80831b40331c98aa9ca5997e5a3fdb3c5d3663b7" gracePeriod=30
Aug 05 17:38:40.257332 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.257306    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"]
Aug 05 17:38:40.257539 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.257515    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd" podUID="f5476629-b9fe-41e2-85d6-040c4d86ddca" containerName="payload-pre-processing" containerID="cri-o://3f84f1c7f2300bd5564e6e8fcf00d6c275a4120085e3a0a7b695a3694bc59e0f" gracePeriod=30
Aug 05 17:38:40.313874 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.313755    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:40.405592 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.405557    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x"]
Aug 05 17:38:40.408783 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.408681    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:40.411702 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.411676    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a1e09f-snt2x"]
Aug 05 17:38:40.520864 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.520762    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:40.568566 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.568422    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"
Aug 05 17:38:40.571709 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.571684    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:38:40.577059 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.577038    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"
Aug 05 17:38:40.686838 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.686777    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v224\" (UniqueName: \"kubernetes.io/projected/f5476629-b9fe-41e2-85d6-040c4d86ddca-kube-api-access-4v224\") pod \"f5476629-b9fe-41e2-85d6-040c4d86ddca\" (UID: \"f5476629-b9fe-41e2-85d6-040c4d86ddca\") "
Aug 05 17:38:40.686838 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.686841    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8ce195-061b-4dc8-a0bd-58e400400047-maas-api-tls\") pod \"6f8ce195-061b-4dc8-a0bd-58e400400047\" (UID: \"6f8ce195-061b-4dc8-a0bd-58e400400047\") "
Aug 05 17:38:40.687083 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.686914    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6lx6\" (UniqueName: \"kubernetes.io/projected/6f8ce195-061b-4dc8-a0bd-58e400400047-kube-api-access-z6lx6\") pod \"6f8ce195-061b-4dc8-a0bd-58e400400047\" (UID: \"6f8ce195-061b-4dc8-a0bd-58e400400047\") "
Aug 05 17:38:40.687083 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.686941    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8ce195-061b-4dc8-a0bd-58e400400047-openshift-service-ca\") pod \"6f8ce195-061b-4dc8-a0bd-58e400400047\" (UID: \"6f8ce195-061b-4dc8-a0bd-58e400400047\") "
Aug 05 17:38:40.687083 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.686966    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nl8l\" (UniqueName: \"kubernetes.io/projected/bf6d32d1-adfe-4fde-9655-f58139588bb1-kube-api-access-2nl8l\") pod \"bf6d32d1-adfe-4fde-9655-f58139588bb1\" (UID: \"bf6d32d1-adfe-4fde-9655-f58139588bb1\") "
Aug 05 17:38:40.687083 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.687035    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5476629-b9fe-41e2-85d6-040c4d86ddca-plugins-config-volume\") pod \"f5476629-b9fe-41e2-85d6-040c4d86ddca\" (UID: \"f5476629-b9fe-41e2-85d6-040c4d86ddca\") "
Aug 05 17:38:40.687298 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.687081    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf6d32d1-adfe-4fde-9655-f58139588bb1-plugins-config-volume\") pod \"bf6d32d1-adfe-4fde-9655-f58139588bb1\" (UID: \"bf6d32d1-adfe-4fde-9655-f58139588bb1\") "
Aug 05 17:38:40.687376 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.687344    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8ce195-061b-4dc8-a0bd-58e400400047-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6f8ce195-061b-4dc8-a0bd-58e400400047" (UID: "6f8ce195-061b-4dc8-a0bd-58e400400047"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:38:40.687502 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.687479    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8ce195-061b-4dc8-a0bd-58e400400047-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:40.688155 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.688089    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf6d32d1-adfe-4fde-9655-f58139588bb1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bf6d32d1-adfe-4fde-9655-f58139588bb1" (UID: "bf6d32d1-adfe-4fde-9655-f58139588bb1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:38:40.689471 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.688905    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5476629-b9fe-41e2-85d6-040c4d86ddca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5476629-b9fe-41e2-85d6-040c4d86ddca" (UID: "f5476629-b9fe-41e2-85d6-040c4d86ddca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:38:40.689613 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.689464    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5476629-b9fe-41e2-85d6-040c4d86ddca-kube-api-access-4v224" (OuterVolumeSpecName: "kube-api-access-4v224") pod "f5476629-b9fe-41e2-85d6-040c4d86ddca" (UID: "f5476629-b9fe-41e2-85d6-040c4d86ddca"). InnerVolumeSpecName "kube-api-access-4v224". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:40.689676 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.689600    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8ce195-061b-4dc8-a0bd-58e400400047-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6f8ce195-061b-4dc8-a0bd-58e400400047" (UID: "6f8ce195-061b-4dc8-a0bd-58e400400047"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:38:40.689676 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.689641    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf6d32d1-adfe-4fde-9655-f58139588bb1-kube-api-access-2nl8l" (OuterVolumeSpecName: "kube-api-access-2nl8l") pod "bf6d32d1-adfe-4fde-9655-f58139588bb1" (UID: "bf6d32d1-adfe-4fde-9655-f58139588bb1"). InnerVolumeSpecName "kube-api-access-2nl8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:40.691859 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.689879    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8ce195-061b-4dc8-a0bd-58e400400047-kube-api-access-z6lx6" (OuterVolumeSpecName: "kube-api-access-z6lx6") pod "6f8ce195-061b-4dc8-a0bd-58e400400047" (UID: "6f8ce195-061b-4dc8-a0bd-58e400400047"). InnerVolumeSpecName "kube-api-access-z6lx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:40.771991 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.771875    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:40.788034 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.788012    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v224\" (UniqueName: \"kubernetes.io/projected/f5476629-b9fe-41e2-85d6-040c4d86ddca-kube-api-access-4v224\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:40.788159 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.788036    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8ce195-061b-4dc8-a0bd-58e400400047-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:40.788159 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.788051    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6lx6\" (UniqueName: \"kubernetes.io/projected/6f8ce195-061b-4dc8-a0bd-58e400400047-kube-api-access-z6lx6\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:40.788159 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.788062    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nl8l\" (UniqueName: \"kubernetes.io/projected/bf6d32d1-adfe-4fde-9655-f58139588bb1-kube-api-access-2nl8l\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:40.788159 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.788071    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5476629-b9fe-41e2-85d6-040c4d86ddca-plugins-config-volume\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:40.788159 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.788079    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf6d32d1-adfe-4fde-9655-f58139588bb1-plugins-config-volume\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:40.828478 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.828449    2575 generic.go:356] "Generic (PLEG): container finished" podID="6f8ce195-061b-4dc8-a0bd-58e400400047" containerID="79e24829edec8b3a4b5b580b4d2bc236397b693e4273a430dca10d2040039877" exitCode=0
Aug 05 17:38:40.828592 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.828509    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"
Aug 05 17:38:40.828592 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.828545    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4" event={"ID":"6f8ce195-061b-4dc8-a0bd-58e400400047","Type":"ContainerDied","Data":"79e24829edec8b3a4b5b580b4d2bc236397b693e4273a430dca10d2040039877"}
Aug 05 17:38:40.828719 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.828624    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4" event={"ID":"6f8ce195-061b-4dc8-a0bd-58e400400047","Type":"ContainerDied","Data":"d0c9d0ac6561ac396ae7d0b75a8b8bd8c03040b0973b86fddae6c5cbda3a30cb"}
Aug 05 17:38:40.828719 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.828648    2575 scope.go:117] "RemoveContainer" containerID="79e24829edec8b3a4b5b580b4d2bc236397b693e4273a430dca10d2040039877"
Aug 05 17:38:40.830065 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.830043    2575 generic.go:356] "Generic (PLEG): container finished" podID="bf6d32d1-adfe-4fde-9655-f58139588bb1" containerID="91d004976aa78c995cdf352d80831b40331c98aa9ca5997e5a3fdb3c5d3663b7" exitCode=0
Aug 05 17:38:40.830185 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.830107    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"
Aug 05 17:38:40.830185 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.830107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx" event={"ID":"bf6d32d1-adfe-4fde-9655-f58139588bb1","Type":"ContainerDied","Data":"91d004976aa78c995cdf352d80831b40331c98aa9ca5997e5a3fdb3c5d3663b7"}
Aug 05 17:38:40.830185 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.830161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx" event={"ID":"bf6d32d1-adfe-4fde-9655-f58139588bb1","Type":"ContainerDied","Data":"ac9e3253c2402dce71b6bc2766dbd0df492a3037ee32dff85e7058b4a5939091"}
Aug 05 17:38:40.831467 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.831445    2575 generic.go:356] "Generic (PLEG): container finished" podID="f5476629-b9fe-41e2-85d6-040c4d86ddca" containerID="3f84f1c7f2300bd5564e6e8fcf00d6c275a4120085e3a0a7b695a3694bc59e0f" exitCode=0
Aug 05 17:38:40.831575 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.831500    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"
Aug 05 17:38:40.831575 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.831543    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd" event={"ID":"f5476629-b9fe-41e2-85d6-040c4d86ddca","Type":"ContainerDied","Data":"3f84f1c7f2300bd5564e6e8fcf00d6c275a4120085e3a0a7b695a3694bc59e0f"}
Aug 05 17:38:40.831673 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.831590    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd" event={"ID":"f5476629-b9fe-41e2-85d6-040c4d86ddca","Type":"ContainerDied","Data":"548182034e7af7ae345661f2a49409adafabe67d8b94f6f793f2abf53b313614"}
Aug 05 17:38:40.839228 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.839208    2575 scope.go:117] "RemoveContainer" containerID="79e24829edec8b3a4b5b580b4d2bc236397b693e4273a430dca10d2040039877"
Aug 05 17:38:40.839535 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:38:40.839513    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79e24829edec8b3a4b5b580b4d2bc236397b693e4273a430dca10d2040039877\": container with ID starting with 79e24829edec8b3a4b5b580b4d2bc236397b693e4273a430dca10d2040039877 not found: ID does not exist" containerID="79e24829edec8b3a4b5b580b4d2bc236397b693e4273a430dca10d2040039877"
Aug 05 17:38:40.839613 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.839544    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e24829edec8b3a4b5b580b4d2bc236397b693e4273a430dca10d2040039877"} err="failed to get container status \"79e24829edec8b3a4b5b580b4d2bc236397b693e4273a430dca10d2040039877\": rpc error: code = NotFound desc = could not find container \"79e24829edec8b3a4b5b580b4d2bc236397b693e4273a430dca10d2040039877\": container with ID starting with 79e24829edec8b3a4b5b580b4d2bc236397b693e4273a430dca10d2040039877 not found: ID does not exist"
Aug 05 17:38:40.839613 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.839568    2575 scope.go:117] "RemoveContainer" containerID="91d004976aa78c995cdf352d80831b40331c98aa9ca5997e5a3fdb3c5d3663b7"
Aug 05 17:38:40.847677 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.847662    2575 scope.go:117] "RemoveContainer" containerID="91d004976aa78c995cdf352d80831b40331c98aa9ca5997e5a3fdb3c5d3663b7"
Aug 05 17:38:40.847931 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:38:40.847913    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91d004976aa78c995cdf352d80831b40331c98aa9ca5997e5a3fdb3c5d3663b7\": container with ID starting with 91d004976aa78c995cdf352d80831b40331c98aa9ca5997e5a3fdb3c5d3663b7 not found: ID does not exist" containerID="91d004976aa78c995cdf352d80831b40331c98aa9ca5997e5a3fdb3c5d3663b7"
Aug 05 17:38:40.848018 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.847940    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91d004976aa78c995cdf352d80831b40331c98aa9ca5997e5a3fdb3c5d3663b7"} err="failed to get container status \"91d004976aa78c995cdf352d80831b40331c98aa9ca5997e5a3fdb3c5d3663b7\": rpc error: code = NotFound desc = could not find container \"91d004976aa78c995cdf352d80831b40331c98aa9ca5997e5a3fdb3c5d3663b7\": container with ID starting with 91d004976aa78c995cdf352d80831b40331c98aa9ca5997e5a3fdb3c5d3663b7 not found: ID does not exist"
Aug 05 17:38:40.848018 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.847960    2575 scope.go:117] "RemoveContainer" containerID="3f84f1c7f2300bd5564e6e8fcf00d6c275a4120085e3a0a7b695a3694bc59e0f"
Aug 05 17:38:40.855235 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.855217    2575 scope.go:117] "RemoveContainer" containerID="3f84f1c7f2300bd5564e6e8fcf00d6c275a4120085e3a0a7b695a3694bc59e0f"
Aug 05 17:38:40.855498 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:38:40.855478    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f84f1c7f2300bd5564e6e8fcf00d6c275a4120085e3a0a7b695a3694bc59e0f\": container with ID starting with 3f84f1c7f2300bd5564e6e8fcf00d6c275a4120085e3a0a7b695a3694bc59e0f not found: ID does not exist" containerID="3f84f1c7f2300bd5564e6e8fcf00d6c275a4120085e3a0a7b695a3694bc59e0f"
Aug 05 17:38:40.855585 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.855501    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f84f1c7f2300bd5564e6e8fcf00d6c275a4120085e3a0a7b695a3694bc59e0f"} err="failed to get container status \"3f84f1c7f2300bd5564e6e8fcf00d6c275a4120085e3a0a7b695a3694bc59e0f\": rpc error: code = NotFound desc = could not find container \"3f84f1c7f2300bd5564e6e8fcf00d6c275a4120085e3a0a7b695a3694bc59e0f\": container with ID starting with 3f84f1c7f2300bd5564e6e8fcf00d6c275a4120085e3a0a7b695a3694bc59e0f not found: ID does not exist"
Aug 05 17:38:40.858094 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.858071    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"]
Aug 05 17:38:40.865211 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.865192    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a1e09f-546c587f5d-bhsr4"]
Aug 05 17:38:40.877458 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.877437    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"]
Aug 05 17:38:40.884986 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.884966    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a1e09f-7cf56564b6-9mpwx"]
Aug 05 17:38:40.895268 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.895248    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"]
Aug 05 17:38:40.902840 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:40.902820    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-a1e09f-548bbdc8fb-szvgd"]
Aug 05 17:38:42.014376 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:42.014347    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f8ce195-061b-4dc8-a0bd-58e400400047" path="/var/lib/kubelet/pods/6f8ce195-061b-4dc8-a0bd-58e400400047/volumes"
Aug 05 17:38:42.014831 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:42.014698    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf6d32d1-adfe-4fde-9655-f58139588bb1" path="/var/lib/kubelet/pods/bf6d32d1-adfe-4fde-9655-f58139588bb1/volumes"
Aug 05 17:38:42.015055 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:42.015041    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5476629-b9fe-41e2-85d6-040c4d86ddca" path="/var/lib/kubelet/pods/f5476629-b9fe-41e2-85d6-040c4d86ddca/volumes"
Aug 05 17:38:42.015323 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:42.015311    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f676e52e-e1e3-4e92-bc7b-373ed8f84505" path="/var/lib/kubelet/pods/f676e52e-e1e3-4e92-bc7b-373ed8f84505/volumes"
Aug 05 17:38:42.497751 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:42.497717    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:38:47.137701 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.137661    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:47.257413 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.257378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:47.396858 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.396737    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:47.641524 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.641486    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:47.767385 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.767352    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw"]
Aug 05 17:38:47.767768 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.767755    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5476629-b9fe-41e2-85d6-040c4d86ddca" containerName="payload-pre-processing"
Aug 05 17:38:47.767833 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.767770    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5476629-b9fe-41e2-85d6-040c4d86ddca" containerName="payload-pre-processing"
Aug 05 17:38:47.767833 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.767779    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf6d32d1-adfe-4fde-9655-f58139588bb1" containerName="payload-processing"
Aug 05 17:38:47.767833 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.767786    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf6d32d1-adfe-4fde-9655-f58139588bb1" containerName="payload-processing"
Aug 05 17:38:47.767833 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.767826    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8ce195-061b-4dc8-a0bd-58e400400047" containerName="maas-api"
Aug 05 17:38:47.767833 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.767832    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8ce195-061b-4dc8-a0bd-58e400400047" containerName="maas-api"
Aug 05 17:38:47.767996 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.767842    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f676e52e-e1e3-4e92-bc7b-373ed8f84505" containerName="revoke-keys"
Aug 05 17:38:47.767996 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.767848    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f676e52e-e1e3-4e92-bc7b-373ed8f84505" containerName="revoke-keys"
Aug 05 17:38:47.767996 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.767906    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf6d32d1-adfe-4fde-9655-f58139588bb1" containerName="payload-processing"
Aug 05 17:38:47.767996 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.767915    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8ce195-061b-4dc8-a0bd-58e400400047" containerName="maas-api"
Aug 05 17:38:47.767996 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.767921    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f676e52e-e1e3-4e92-bc7b-373ed8f84505" containerName="revoke-keys"
Aug 05 17:38:47.767996 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.767929    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5476629-b9fe-41e2-85d6-040c4d86ddca" containerName="payload-pre-processing"
Aug 05 17:38:47.772458 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.772441    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw"
Aug 05 17:38:47.774800 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.774778    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:38:47.780419 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.780102    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw"]
Aug 05 17:38:47.852251 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.852223    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42e874b2-207d-481c-9869-4c6f9f11c18c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw\" (UID: \"42e874b2-207d-481c-9869-4c6f9f11c18c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw"
Aug 05 17:38:47.953242 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.953210    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42e874b2-207d-481c-9869-4c6f9f11c18c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw\" (UID: \"42e874b2-207d-481c-9869-4c6f9f11c18c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw"
Aug 05 17:38:47.953842 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:47.953797    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42e874b2-207d-481c-9869-4c6f9f11c18c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw\" (UID: \"42e874b2-207d-481c-9869-4c6f9f11c18c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw"
Aug 05 17:38:48.084745 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:48.084668    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw"
Aug 05 17:38:48.219868 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:48.219843    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw"]
Aug 05 17:38:48.222420 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:38:48.222390    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e874b2_207d_481c_9869_4c6f9f11c18c.slice/crio-0fba7cd40e8940df3bdd82eaacd46a3e1959674bfa4ac5526e1d49d0cc7fbad8 WatchSource:0}: Error finding container 0fba7cd40e8940df3bdd82eaacd46a3e1959674bfa4ac5526e1d49d0cc7fbad8: Status 404 returned error can't find the container with id 0fba7cd40e8940df3bdd82eaacd46a3e1959674bfa4ac5526e1d49d0cc7fbad8
Aug 05 17:38:48.876662 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:48.876568    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw" event={"ID":"42e874b2-207d-481c-9869-4c6f9f11c18c","Type":"ContainerStarted","Data":"755106db177882d75643274d94bd7b13490c898a390ba81d371a63d6be489cc7"}
Aug 05 17:38:48.876662 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:48.876638    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw" event={"ID":"42e874b2-207d-481c-9869-4c6f9f11c18c","Type":"ContainerStarted","Data":"0fba7cd40e8940df3bdd82eaacd46a3e1959674bfa4ac5526e1d49d0cc7fbad8"}
Aug 05 17:38:48.893743 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:48.893689    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw" podStartSLOduration=1.8936753309999999 podStartE2EDuration="1.893675331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:38:48.891641639 +0000 UTC m=+3583.341187938" watchObservedRunningTime="2026-08-05 17:38:48.893675331 +0000 UTC m=+3583.343221630"
Aug 05 17:38:49.882916 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:49.882883    2575 generic.go:356] "Generic (PLEG): container finished" podID="42e874b2-207d-481c-9869-4c6f9f11c18c" containerID="755106db177882d75643274d94bd7b13490c898a390ba81d371a63d6be489cc7" exitCode=0
Aug 05 17:38:49.883385 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:49.882969    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw" event={"ID":"42e874b2-207d-481c-9869-4c6f9f11c18c","Type":"ContainerDied","Data":"755106db177882d75643274d94bd7b13490c898a390ba81d371a63d6be489cc7"}
Aug 05 17:38:51.029248 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:51.029226    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw"
Aug 05 17:38:51.081970 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:51.081949    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42e874b2-207d-481c-9869-4c6f9f11c18c-maas-api-service-ca\") pod \"42e874b2-207d-481c-9869-4c6f9f11c18c\" (UID: \"42e874b2-207d-481c-9869-4c6f9f11c18c\") "
Aug 05 17:38:51.082292 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:51.082270    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e874b2-207d-481c-9869-4c6f9f11c18c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "42e874b2-207d-481c-9869-4c6f9f11c18c" (UID: "42e874b2-207d-481c-9869-4c6f9f11c18c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:38:51.183378 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:51.183353    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42e874b2-207d-481c-9869-4c6f9f11c18c-maas-api-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:51.894116 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:51.894091    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw"
Aug 05 17:38:51.894295 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:51.894090    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw" event={"ID":"42e874b2-207d-481c-9869-4c6f9f11c18c","Type":"ContainerDied","Data":"0fba7cd40e8940df3bdd82eaacd46a3e1959674bfa4ac5526e1d49d0cc7fbad8"}
Aug 05 17:38:51.894295 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:51.894200    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fba7cd40e8940df3bdd82eaacd46a3e1959674bfa4ac5526e1d49d0cc7fbad8"
Aug 05 17:38:58.428522 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.428439    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"]
Aug 05 17:38:58.428948 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.428700    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684" podUID="863022e1-0c17-49ab-b75c-314de1be84fa" containerName="maas-api" containerID="cri-o://34da5ca11e6c49b5a6ba903370ef0ddf4e5638e4c26bd10de1c8197628a6c844" gracePeriod=30
Aug 05 17:38:58.468944 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.468918    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a81ee3-29765850-msppz"]
Aug 05 17:38:58.476686 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.476663    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a81ee3-29765850-msppz"]
Aug 05 17:38:58.477556 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.477534    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:58.519068 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.519006    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"]
Aug 05 17:38:58.519450 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.519250    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh" podUID="eb67f6c9-1e8a-41e5-a135-40a2d5319932" containerName="payload-processing" containerID="cri-o://adda2c744e31dd1605e338e80c9b78ac105f07695351b3f04ce4faa80f1fb674" gracePeriod=30
Aug 05 17:38:58.534324 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.534296    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"]
Aug 05 17:38:58.534549 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.534517    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth" podUID="c9c49b36-d36c-4057-845e-2466c5dd6849" containerName="payload-pre-processing" containerID="cri-o://c9c731d5f42651f72fce35e41dfcd655763f9f348fc4bbd31c7db7cf2e3ae06e" gracePeriod=30
Aug 05 17:38:58.573455 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.573420    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:58.653533 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.653501    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:58.730951 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.730915    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw"]
Aug 05 17:38:58.736514 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.736482    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a81ee3-g5pkw"]
Aug 05 17:38:58.754212 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.754173    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:58.784994 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.784969    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:38:58.807671 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.807641    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"
Aug 05 17:38:58.820317 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.820290    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"
Aug 05 17:38:58.850571 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.850548    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/863022e1-0c17-49ab-b75c-314de1be84fa-openshift-service-ca\") pod \"863022e1-0c17-49ab-b75c-314de1be84fa\" (UID: \"863022e1-0c17-49ab-b75c-314de1be84fa\") "
Aug 05 17:38:58.850706 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.850667    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/863022e1-0c17-49ab-b75c-314de1be84fa-maas-api-tls\") pod \"863022e1-0c17-49ab-b75c-314de1be84fa\" (UID: \"863022e1-0c17-49ab-b75c-314de1be84fa\") "
Aug 05 17:38:58.850764 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.850723    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqtn5\" (UniqueName: \"kubernetes.io/projected/863022e1-0c17-49ab-b75c-314de1be84fa-kube-api-access-fqtn5\") pod \"863022e1-0c17-49ab-b75c-314de1be84fa\" (UID: \"863022e1-0c17-49ab-b75c-314de1be84fa\") "
Aug 05 17:38:58.850966 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.850935    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/863022e1-0c17-49ab-b75c-314de1be84fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "863022e1-0c17-49ab-b75c-314de1be84fa" (UID: "863022e1-0c17-49ab-b75c-314de1be84fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:38:58.852637 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.852608    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/863022e1-0c17-49ab-b75c-314de1be84fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "863022e1-0c17-49ab-b75c-314de1be84fa" (UID: "863022e1-0c17-49ab-b75c-314de1be84fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:38:58.852735 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.852644    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/863022e1-0c17-49ab-b75c-314de1be84fa-kube-api-access-fqtn5" (OuterVolumeSpecName: "kube-api-access-fqtn5") pod "863022e1-0c17-49ab-b75c-314de1be84fa" (UID: "863022e1-0c17-49ab-b75c-314de1be84fa"). InnerVolumeSpecName "kube-api-access-fqtn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:58.936130 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.935998    2575 generic.go:356] "Generic (PLEG): container finished" podID="863022e1-0c17-49ab-b75c-314de1be84fa" containerID="34da5ca11e6c49b5a6ba903370ef0ddf4e5638e4c26bd10de1c8197628a6c844" exitCode=0
Aug 05 17:38:58.936130 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.936087    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"
Aug 05 17:38:58.936130 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.936051    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684" event={"ID":"863022e1-0c17-49ab-b75c-314de1be84fa","Type":"ContainerDied","Data":"34da5ca11e6c49b5a6ba903370ef0ddf4e5638e4c26bd10de1c8197628a6c844"}
Aug 05 17:38:58.936426 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.936218    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684" event={"ID":"863022e1-0c17-49ab-b75c-314de1be84fa","Type":"ContainerDied","Data":"c7d54dbf33ffca79a8934fbc4e82c7a4376602e404577289fcc71f85a629f51a"}
Aug 05 17:38:58.936426 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.936259    2575 scope.go:117] "RemoveContainer" containerID="34da5ca11e6c49b5a6ba903370ef0ddf4e5638e4c26bd10de1c8197628a6c844"
Aug 05 17:38:58.937726 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.937705    2575 generic.go:356] "Generic (PLEG): container finished" podID="eb67f6c9-1e8a-41e5-a135-40a2d5319932" containerID="adda2c744e31dd1605e338e80c9b78ac105f07695351b3f04ce4faa80f1fb674" exitCode=0
Aug 05 17:38:58.937856 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.937755    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"
Aug 05 17:38:58.937856 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.937792    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh" event={"ID":"eb67f6c9-1e8a-41e5-a135-40a2d5319932","Type":"ContainerDied","Data":"adda2c744e31dd1605e338e80c9b78ac105f07695351b3f04ce4faa80f1fb674"}
Aug 05 17:38:58.937990 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.937871    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh" event={"ID":"eb67f6c9-1e8a-41e5-a135-40a2d5319932","Type":"ContainerDied","Data":"29caea4c6b5a7400fc5a8a7972e6c3d4a72f3bd0d6b743d8504e763f6669a2c7"}
Aug 05 17:38:58.939425 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.939392    2575 generic.go:356] "Generic (PLEG): container finished" podID="c9c49b36-d36c-4057-845e-2466c5dd6849" containerID="c9c731d5f42651f72fce35e41dfcd655763f9f348fc4bbd31c7db7cf2e3ae06e" exitCode=0
Aug 05 17:38:58.939532 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.939482    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth" event={"ID":"c9c49b36-d36c-4057-845e-2466c5dd6849","Type":"ContainerDied","Data":"c9c731d5f42651f72fce35e41dfcd655763f9f348fc4bbd31c7db7cf2e3ae06e"}
Aug 05 17:38:58.939601 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.939532    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"
Aug 05 17:38:58.939662 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.939542    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth" event={"ID":"c9c49b36-d36c-4057-845e-2466c5dd6849","Type":"ContainerDied","Data":"b4548240cba8242d681c497a582455dc3968ee2ef81ff027d6b527a2a2b239f6"}
Aug 05 17:38:58.945961 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.945945    2575 scope.go:117] "RemoveContainer" containerID="34da5ca11e6c49b5a6ba903370ef0ddf4e5638e4c26bd10de1c8197628a6c844"
Aug 05 17:38:58.946205 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:38:58.946186    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34da5ca11e6c49b5a6ba903370ef0ddf4e5638e4c26bd10de1c8197628a6c844\": container with ID starting with 34da5ca11e6c49b5a6ba903370ef0ddf4e5638e4c26bd10de1c8197628a6c844 not found: ID does not exist" containerID="34da5ca11e6c49b5a6ba903370ef0ddf4e5638e4c26bd10de1c8197628a6c844"
Aug 05 17:38:58.946253 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.946212    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34da5ca11e6c49b5a6ba903370ef0ddf4e5638e4c26bd10de1c8197628a6c844"} err="failed to get container status \"34da5ca11e6c49b5a6ba903370ef0ddf4e5638e4c26bd10de1c8197628a6c844\": rpc error: code = NotFound desc = could not find container \"34da5ca11e6c49b5a6ba903370ef0ddf4e5638e4c26bd10de1c8197628a6c844\": container with ID starting with 34da5ca11e6c49b5a6ba903370ef0ddf4e5638e4c26bd10de1c8197628a6c844 not found: ID does not exist"
Aug 05 17:38:58.946253 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.946228    2575 scope.go:117] "RemoveContainer" containerID="adda2c744e31dd1605e338e80c9b78ac105f07695351b3f04ce4faa80f1fb674"
Aug 05 17:38:58.951644 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.951626    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9c49b36-d36c-4057-845e-2466c5dd6849-plugins-config-volume\") pod \"c9c49b36-d36c-4057-845e-2466c5dd6849\" (UID: \"c9c49b36-d36c-4057-845e-2466c5dd6849\") "
Aug 05 17:38:58.951747 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.951683    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snnn4\" (UniqueName: \"kubernetes.io/projected/c9c49b36-d36c-4057-845e-2466c5dd6849-kube-api-access-snnn4\") pod \"c9c49b36-d36c-4057-845e-2466c5dd6849\" (UID: \"c9c49b36-d36c-4057-845e-2466c5dd6849\") "
Aug 05 17:38:58.951747 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.951732    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l9pw\" (UniqueName: \"kubernetes.io/projected/eb67f6c9-1e8a-41e5-a135-40a2d5319932-kube-api-access-4l9pw\") pod \"eb67f6c9-1e8a-41e5-a135-40a2d5319932\" (UID: \"eb67f6c9-1e8a-41e5-a135-40a2d5319932\") "
Aug 05 17:38:58.951880 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.951761    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb67f6c9-1e8a-41e5-a135-40a2d5319932-plugins-config-volume\") pod \"eb67f6c9-1e8a-41e5-a135-40a2d5319932\" (UID: \"eb67f6c9-1e8a-41e5-a135-40a2d5319932\") "
Aug 05 17:38:58.952119 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.952098    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/863022e1-0c17-49ab-b75c-314de1be84fa-maas-api-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:58.952226 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.952127    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqtn5\" (UniqueName: \"kubernetes.io/projected/863022e1-0c17-49ab-b75c-314de1be84fa-kube-api-access-fqtn5\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:58.952226 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.952148    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/863022e1-0c17-49ab-b75c-314de1be84fa-openshift-service-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:58.952226 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.952152    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9c49b36-d36c-4057-845e-2466c5dd6849-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c9c49b36-d36c-4057-845e-2466c5dd6849" (UID: "c9c49b36-d36c-4057-845e-2466c5dd6849"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:38:58.952371 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.952248    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb67f6c9-1e8a-41e5-a135-40a2d5319932-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eb67f6c9-1e8a-41e5-a135-40a2d5319932" (UID: "eb67f6c9-1e8a-41e5-a135-40a2d5319932"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:38:58.953910 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.953876    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9c49b36-d36c-4057-845e-2466c5dd6849-kube-api-access-snnn4" (OuterVolumeSpecName: "kube-api-access-snnn4") pod "c9c49b36-d36c-4057-845e-2466c5dd6849" (UID: "c9c49b36-d36c-4057-845e-2466c5dd6849"). InnerVolumeSpecName "kube-api-access-snnn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:58.954011 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.953930    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb67f6c9-1e8a-41e5-a135-40a2d5319932-kube-api-access-4l9pw" (OuterVolumeSpecName: "kube-api-access-4l9pw") pod "eb67f6c9-1e8a-41e5-a135-40a2d5319932" (UID: "eb67f6c9-1e8a-41e5-a135-40a2d5319932"). InnerVolumeSpecName "kube-api-access-4l9pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:58.954122 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.954064    2575 scope.go:117] "RemoveContainer" containerID="adda2c744e31dd1605e338e80c9b78ac105f07695351b3f04ce4faa80f1fb674"
Aug 05 17:38:58.954335 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:38:58.954319    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adda2c744e31dd1605e338e80c9b78ac105f07695351b3f04ce4faa80f1fb674\": container with ID starting with adda2c744e31dd1605e338e80c9b78ac105f07695351b3f04ce4faa80f1fb674 not found: ID does not exist" containerID="adda2c744e31dd1605e338e80c9b78ac105f07695351b3f04ce4faa80f1fb674"
Aug 05 17:38:58.954385 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.954342    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adda2c744e31dd1605e338e80c9b78ac105f07695351b3f04ce4faa80f1fb674"} err="failed to get container status \"adda2c744e31dd1605e338e80c9b78ac105f07695351b3f04ce4faa80f1fb674\": rpc error: code = NotFound desc = could not find container \"adda2c744e31dd1605e338e80c9b78ac105f07695351b3f04ce4faa80f1fb674\": container with ID starting with adda2c744e31dd1605e338e80c9b78ac105f07695351b3f04ce4faa80f1fb674 not found: ID does not exist"
Aug 05 17:38:58.954385 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.954358    2575 scope.go:117] "RemoveContainer" containerID="c9c731d5f42651f72fce35e41dfcd655763f9f348fc4bbd31c7db7cf2e3ae06e"
Aug 05 17:38:58.961718 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.961701    2575 scope.go:117] "RemoveContainer" containerID="c9c731d5f42651f72fce35e41dfcd655763f9f348fc4bbd31c7db7cf2e3ae06e"
Aug 05 17:38:58.962010 ip-10-0-130-35 kubenswrapper[2575]: E0805 17:38:58.961990    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9c731d5f42651f72fce35e41dfcd655763f9f348fc4bbd31c7db7cf2e3ae06e\": container with ID starting with c9c731d5f42651f72fce35e41dfcd655763f9f348fc4bbd31c7db7cf2e3ae06e not found: ID does not exist" containerID="c9c731d5f42651f72fce35e41dfcd655763f9f348fc4bbd31c7db7cf2e3ae06e"
Aug 05 17:38:58.962067 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.962015    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9c731d5f42651f72fce35e41dfcd655763f9f348fc4bbd31c7db7cf2e3ae06e"} err="failed to get container status \"c9c731d5f42651f72fce35e41dfcd655763f9f348fc4bbd31c7db7cf2e3ae06e\": rpc error: code = NotFound desc = could not find container \"c9c731d5f42651f72fce35e41dfcd655763f9f348fc4bbd31c7db7cf2e3ae06e\": container with ID starting with c9c731d5f42651f72fce35e41dfcd655763f9f348fc4bbd31c7db7cf2e3ae06e not found: ID does not exist"
Aug 05 17:38:58.978269 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.978251    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"]
Aug 05 17:38:58.982695 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:58.982673    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a81ee3-796469b6fd-nm684"]
Aug 05 17:38:59.053018 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:59.052995    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9c49b36-d36c-4057-845e-2466c5dd6849-plugins-config-volume\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:59.053018 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:59.053018    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snnn4\" (UniqueName: \"kubernetes.io/projected/c9c49b36-d36c-4057-845e-2466c5dd6849-kube-api-access-snnn4\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:59.053168 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:59.053031    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l9pw\" (UniqueName: \"kubernetes.io/projected/eb67f6c9-1e8a-41e5-a135-40a2d5319932-kube-api-access-4l9pw\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:59.053168 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:59.053040    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb67f6c9-1e8a-41e5-a135-40a2d5319932-plugins-config-volume\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Aug 05 17:38:59.098287 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:59.098259    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:38:59.263330 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:59.263301    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"]
Aug 05 17:38:59.269508 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:59.269478    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a81ee3-7d4d8d8d5b-qttth"]
Aug 05 17:38:59.286499 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:59.286478    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"]
Aug 05 17:38:59.290080 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:38:59.290058    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a81ee3-75896fdf8-mk8wh"]
Aug 05 17:39:00.013598 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:00.013558    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42e874b2-207d-481c-9869-4c6f9f11c18c" path="/var/lib/kubelet/pods/42e874b2-207d-481c-9869-4c6f9f11c18c/volumes"
Aug 05 17:39:00.014166 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:00.014145    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="863022e1-0c17-49ab-b75c-314de1be84fa" path="/var/lib/kubelet/pods/863022e1-0c17-49ab-b75c-314de1be84fa/volumes"
Aug 05 17:39:00.014454 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:00.014437    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b82cf3ef-6350-485c-80a4-7e052355fd8e" path="/var/lib/kubelet/pods/b82cf3ef-6350-485c-80a4-7e052355fd8e/volumes"
Aug 05 17:39:00.014785 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:00.014769    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9c49b36-d36c-4057-845e-2466c5dd6849" path="/var/lib/kubelet/pods/c9c49b36-d36c-4057-845e-2466c5dd6849/volumes"
Aug 05 17:39:00.015484 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:00.015463    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb67f6c9-1e8a-41e5-a135-40a2d5319932" path="/var/lib/kubelet/pods/eb67f6c9-1e8a-41e5-a135-40a2d5319932/volumes"
Aug 05 17:39:01.007356 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:01.007317    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-bq685"]
Aug 05 17:39:05.760059 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:05.760013    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:39:05.856861 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:05.856795    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:39:06.029930 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:06.029841    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:39:06.231236 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:06.231183    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:39:06.262395 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:06.262371    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:39:06.269429 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:06.269406    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5rjf_0c240570-c8ab-4d5a-ac59-4c45cd4a9417/ovn-acl-logging/0.log"
Aug 05 17:39:06.500981 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:06.500953    2575 scope.go:117] "RemoveContainer" containerID="f5332d2f795f540c2b47cc986f367dba9eb518f8b5a59bc64054d638d690eff7"
Aug 05 17:39:12.559261 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:12.559229    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b469b89cc-ptw9z_a287a66d-2fdd-4362-b253-57499b2f0073/manager/0.log"
Aug 05 17:39:12.567668 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:12.567645    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b469b89cc-ptw9z_a287a66d-2fdd-4362-b253-57499b2f0073/copy-manifests/0.log"
Aug 05 17:39:13.356103 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:13.356073    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29765850-s74vp_1379f4ae-58f0-486a-aa4d-b0353ac8eae7/cleanup/0.log"
Aug 05 17:39:14.776937 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:14.776905    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-bq685_4f8a3195-c5bf-4d71-9b08-072a37eae537/limitador/0.log"
Aug 05 17:39:15.346500 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:15.346471    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2f692_3cad0713-1b43-41e8-8f38-7b98594140ea/discovery/0.log"
Aug 05 17:39:16.063601 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:16.063571    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79969d86b4-ds5sb_b1680b14-97ef-4d2a-876a-3c52b77f06cc/router/0.log"
Aug 05 17:39:16.754878 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:16.754834    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg26lj_44b8a280-3bcd-4134-8256-f5d47cecf850/main/0.log"
Aug 05 17:39:19.921730 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:19.921693    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:39:20.060688 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:20.060649    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:39:22.710694 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:22.710659    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:39:22.878416 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:22.878385    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:39:25.548566 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:25.548538    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cjd4p_19978542-a8d5-4584-b68a-6f2cf12f2461/global-pull-secret-syncer/0.log"
Aug 05 17:39:25.647287 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:25.647258    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log"
Aug 05 17:39:25.755684 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:25.755652    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-35.ec2.internal_c3a83236ec0dc10215cc696b78d0e7a5/haproxy/0.log"
Aug 05 17:39:29.783748 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:29.783712    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w5s4x_11f8ada3-7b4b-4584-9d69-6ec3dd068487/konnectivity-agent/0.log" limit=1024
Aug 05 17:39:31.443428 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:31.443401    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-bq685_4f8a3195-c5bf-4d71-9b08-072a37eae537/limitador/0.log"
Aug 05 17:39:33.151276 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:33.151243    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_489ecca6-1e00-4435-836c-958afc542a36/alertmanager/0.log"
Aug 05 17:39:33.229704 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:33.229673    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_489ecca6-1e00-4435-836c-958afc542a36/config-reloader/0.log"
Aug 05 17:39:33.289298 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:33.289272    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_489ecca6-1e00-4435-836c-958afc542a36/kube-rbac-proxy-web/0.log"
Aug 05 17:39:33.329429 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:33.329398    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_489ecca6-1e00-4435-836c-958afc542a36/kube-rbac-proxy/0.log"
Aug 05 17:39:33.371866 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:33.371837    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_489ecca6-1e00-4435-836c-958afc542a36/kube-rbac-proxy-metric/0.log"
Aug 05 17:39:33.412002 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:33.411976    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_489ecca6-1e00-4435-836c-958afc542a36/prom-label-proxy/0.log"
Aug 05 17:39:33.491539 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:33.491509    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_489ecca6-1e00-4435-836c-958afc542a36/init-config-reloader/0.log"
Aug 05 17:39:33.622346 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:33.622320    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-9ddwn_44ee2551-7b6a-4ca7-8ce5-bb7132d7626a/kube-state-metrics/0.log"
Aug 05 17:39:33.660068 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:33.660043    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-9ddwn_44ee2551-7b6a-4ca7-8ce5-bb7132d7626a/kube-rbac-proxy-main/0.log"
Aug 05 17:39:33.712407 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:33.712321    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-9ddwn_44ee2551-7b6a-4ca7-8ce5-bb7132d7626a/kube-rbac-proxy-self/0.log"
Aug 05 17:39:33.826563 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:33.826534    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f48dbb44f-54b49_529b3595-b8ab-4c0c-b10a-ee9a83309cdb/metrics-server/0.log"
Aug 05 17:39:34.138986 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:34.138961    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kz4hj_f73f6931-9502-414c-a31d-229a93e63e5c/node-exporter/0.log"
Aug 05 17:39:34.169236 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:34.169203    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kz4hj_f73f6931-9502-414c-a31d-229a93e63e5c/kube-rbac-proxy/0.log"
Aug 05 17:39:34.220658 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:34.220632    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kz4hj_f73f6931-9502-414c-a31d-229a93e63e5c/init-textfile/0.log"
Aug 05 17:39:34.515186 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:34.515153    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0/prometheus/0.log"
Aug 05 17:39:34.578699 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:34.578673    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0/config-reloader/0.log"
Aug 05 17:39:34.665154 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:34.665133    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0/thanos-sidecar/0.log"
Aug 05 17:39:34.730499 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:34.730468    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0/kube-rbac-proxy-web/0.log"
Aug 05 17:39:34.796341 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:34.796269    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0/kube-rbac-proxy/0.log"
Aug 05 17:39:34.841467 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:34.841444    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0/kube-rbac-proxy-thanos/0.log"
Aug 05 17:39:34.879997 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:34.879973    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aa208187-7ebe-4fa5-8c73-1cd26ca2a5a0/init-config-reloader/0.log"
Aug 05 17:39:35.040939 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.040906    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-f4hmf_6f21e9c6-bb31-4c27-b29d-d6ad6d1d4d30/prometheus-operator-admission-webhook/0.log"
Aug 05 17:39:35.165058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.162367    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"]
Aug 05 17:39:35.165058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.163089    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9c49b36-d36c-4057-845e-2466c5dd6849" containerName="payload-pre-processing"
Aug 05 17:39:35.165058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.163110    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9c49b36-d36c-4057-845e-2466c5dd6849" containerName="payload-pre-processing"
Aug 05 17:39:35.165058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.163122    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="863022e1-0c17-49ab-b75c-314de1be84fa" containerName="maas-api"
Aug 05 17:39:35.165058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.163132    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="863022e1-0c17-49ab-b75c-314de1be84fa" containerName="maas-api"
Aug 05 17:39:35.165058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.163155    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb67f6c9-1e8a-41e5-a135-40a2d5319932" containerName="payload-processing"
Aug 05 17:39:35.165058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.163164    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb67f6c9-1e8a-41e5-a135-40a2d5319932" containerName="payload-processing"
Aug 05 17:39:35.165058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.163222    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e874b2-207d-481c-9869-4c6f9f11c18c" containerName="revoke-keys"
Aug 05 17:39:35.165058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.163231    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e874b2-207d-481c-9869-4c6f9f11c18c" containerName="revoke-keys"
Aug 05 17:39:35.165058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.163368    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb67f6c9-1e8a-41e5-a135-40a2d5319932" containerName="payload-processing"
Aug 05 17:39:35.165058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.163379    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="42e874b2-207d-481c-9869-4c6f9f11c18c" containerName="revoke-keys"
Aug 05 17:39:35.165058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.163393    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9c49b36-d36c-4057-845e-2466c5dd6849" containerName="payload-pre-processing"
Aug 05 17:39:35.165058 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.163407    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="863022e1-0c17-49ab-b75c-314de1be84fa" containerName="maas-api"
Aug 05 17:39:35.167374 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.167344    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.169832 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.169784    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w2hzf\"/\"openshift-service-ca.crt\""
Aug 05 17:39:35.170200 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.169903    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w2hzf\"/\"default-dockercfg-hjlhd\""
Aug 05 17:39:35.170472 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.170450    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w2hzf\"/\"kube-root-ca.crt\""
Aug 05 17:39:35.183076 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.183053    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"]
Aug 05 17:39:35.274595 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.274560    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgr7z\" (UniqueName: \"kubernetes.io/projected/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-kube-api-access-mgr7z\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.274771 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.274612    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-sys\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.274771 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.274641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-proc\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.274771 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.274739    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-podres\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.274909 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.274773    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-lib-modules\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.375898 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.375861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgr7z\" (UniqueName: \"kubernetes.io/projected/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-kube-api-access-mgr7z\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.376068 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.375923    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-sys\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.376068 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.375959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-proc\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.376068 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.376036    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-proc\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.376068 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.376054    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-sys\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.376208 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.376101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-podres\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.376208 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.376124    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-lib-modules\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.376275 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.376223    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-podres\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.376275 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.376256    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-lib-modules\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.408231 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.408201    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgr7z\" (UniqueName: \"kubernetes.io/projected/1b2c5a0c-e240-4ef7-ab9c-97ca596cb834-kube-api-access-mgr7z\") pod \"perf-node-gather-daemonset-jbnv2\" (UID: \"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.478278 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.478205    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:35.627174 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:35.627133    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"]
Aug 05 17:39:35.629535 ip-10-0-130-35 kubenswrapper[2575]: W0805 17:39:35.629511    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1b2c5a0c_e240_4ef7_ab9c_97ca596cb834.slice/crio-91fd8e0bbce50fb82b74436dc304ccba0f36319803822ed33be1f50e15a94839 WatchSource:0}: Error finding container 91fd8e0bbce50fb82b74436dc304ccba0f36319803822ed33be1f50e15a94839: Status 404 returned error can't find the container with id 91fd8e0bbce50fb82b74436dc304ccba0f36319803822ed33be1f50e15a94839
Aug 05 17:39:36.118196 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:36.118109    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2" event={"ID":"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834","Type":"ContainerStarted","Data":"bb55a161a482969ffebd99a5a1ea2ed91acefba896a2ea667658ee9d5f6cb39c"}
Aug 05 17:39:36.118196 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:36.118162    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2" event={"ID":"1b2c5a0c-e240-4ef7-ab9c-97ca596cb834","Type":"ContainerStarted","Data":"91fd8e0bbce50fb82b74436dc304ccba0f36319803822ed33be1f50e15a94839"}
Aug 05 17:39:36.118196 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:36.118191    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:36.149611 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:36.149564    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2" podStartSLOduration=1.149548032 podStartE2EDuration="1.149548032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:39:36.148140422 +0000 UTC m=+3630.597686720" watchObservedRunningTime="2026-08-05 17:39:36.149548032 +0000 UTC m=+3630.599094332"
Aug 05 17:39:40.290517 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:40.290484    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-45ltw_6d629bd8-964f-4458-93bc-d7719b91491c/dns/0.log"
Aug 05 17:39:40.350156 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:40.350122    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-45ltw_6d629bd8-964f-4458-93bc-d7719b91491c/kube-rbac-proxy/0.log"
Aug 05 17:39:40.690862 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:40.690834    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vzjpl_9cb1412e-89c2-4df1-a15c-2cd8cd50dd87/dns-node-resolver/0.log"
Aug 05 17:39:41.382321 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:41.382283    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7b59665466-p5rql_b9a099fa-dbd7-420c-9f10-42479359f875/registry/0.log"
Aug 05 17:39:41.590161 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:41.590126    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hj9wk_fd4a785f-fc18-40c6-a5bc-14f4064d26ba/node-ca/0.log"
Aug 05 17:39:42.133686 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:42.133658    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-jbnv2"
Aug 05 17:39:42.955218 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:42.955188    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2f692_3cad0713-1b43-41e8-8f38-7b98594140ea/discovery/0.log"
Aug 05 17:39:43.232478 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:43.232399    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79969d86b4-ds5sb_b1680b14-97ef-4d2a-876a-3c52b77f06cc/router/0.log"
Aug 05 17:39:44.279557 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:44.279463    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jbgzp_ef4eeedd-04e8-4f1f-892c-67192a3c0ffc/serve-healthcheck-canary/0.log"
Aug 05 17:39:44.988005 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:44.987972    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-pqb7z_f78c7b72-7cdf-4eda-8751-975306bd3265/insights-operator/0.log"
Aug 05 17:39:44.989532 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:44.989504    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-pqb7z_f78c7b72-7cdf-4eda-8751-975306bd3265/insights-operator/1.log"
Aug 05 17:39:45.182007 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:45.181981    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trdrs_1d72561a-dcc4-4073-972a-156cdd9c2b1b/kube-rbac-proxy/0.log"
Aug 05 17:39:45.210671 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:45.210650    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trdrs_1d72561a-dcc4-4073-972a-156cdd9c2b1b/exporter/0.log"
Aug 05 17:39:45.234411 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:45.234387    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trdrs_1d72561a-dcc4-4073-972a-156cdd9c2b1b/extractor/0.log"
Aug 05 17:39:46.365090 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:46.365058    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2f692_3cad0713-1b43-41e8-8f38-7b98594140ea/discovery/0.log"
Aug 05 17:39:46.497842 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:46.497734    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79969d86b4-ds5sb_b1680b14-97ef-4d2a-876a-3c52b77f06cc/router/0.log"
Aug 05 17:39:48.229591 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:48.229520    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2f692_3cad0713-1b43-41e8-8f38-7b98594140ea/discovery/0.log"
Aug 05 17:39:48.380719 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:48.380687    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79969d86b4-ds5sb_b1680b14-97ef-4d2a-876a-3c52b77f06cc/router/0.log"
Aug 05 17:39:48.455441 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:48.455412    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b469b89cc-ptw9z_a287a66d-2fdd-4362-b253-57499b2f0073/manager/0.log"
Aug 05 17:39:48.473697 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:48.473667    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b469b89cc-ptw9z_a287a66d-2fdd-4362-b253-57499b2f0073/copy-manifests/0.log"
Aug 05 17:39:49.737289 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:49.737249    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-598789449f-x2z7q_0413b4b4-f539-4890-88f4-2736d768dc7d/manager/0.log"
Aug 05 17:39:49.763101 ip-10-0-130-35 kubenswrapper[2575]: I0805 17:39:49.763075    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-q9rns_2bb77051-4fc9-4352-ab42-a67a9c4f7cea/openshift-lws-operator/0.log"