Jul 26 16:08:04.338391 ip-10-0-131-99 systemd[1]: Starting Kubernetes Kubelet...
Jul 26 16:08:04.780598 ip-10-0-131-99 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 16:08:04.780598 ip-10-0-131-99 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 26 16:08:04.780598 ip-10-0-131-99 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 16:08:04.780598 ip-10-0-131-99 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 26 16:08:04.780598 ip-10-0-131-99 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 16:08:04.781757 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.781667    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 26 16:08:04.788446 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788428    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 16:08:04.788446 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788444    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 16:08:04.788446 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788448    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 16:08:04.788446 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788453    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788457    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788461    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788465    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788469    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788473    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788476    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788480    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788484    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788487    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788493    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788497    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788501    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788505    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788509    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788512    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788517    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788522    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788525    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788529    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 16:08:04.788680 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788533    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788538    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788542    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788546    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788555    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788560    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788564    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788569    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788573    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788578    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788582    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788586    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788591    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788597    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788601    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788606    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788611    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788615    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788619    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788624    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 16:08:04.789607 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788628    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788632    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788636    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788640    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788645    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788649    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788654    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788658    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788663    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788667    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788674    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788679    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788685    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788690    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788694    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788699    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788704    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788709    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788714    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 16:08:04.790484 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788718    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788722    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788727    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788731    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788735    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788739    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788743    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788748    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788753    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788758    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788762    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788766    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788770    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788777    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788782    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788788    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788793    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788799    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788803    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788807    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 16:08:04.791302 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788811    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788815    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788819    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788823    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788828    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788833    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788837    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788841    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788845    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788849    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788854    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788858    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788862    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788866    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788870    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788877    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.788884    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790032    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790042    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 16:08:04.792219 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790048    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790053    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790058    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790062    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790067    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790071    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790076    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790080    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790084    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790088    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790092    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790098    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790102    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790107    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790111    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790115    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790141    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790148    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790153    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790158    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 16:08:04.793030 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790162    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790167    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790172    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790179    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790185    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790191    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790197    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790202    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790207    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790212    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790216    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790220    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790226    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790230    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790234    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790239    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790243    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790248    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790253    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 16:08:04.793625 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790257    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790261    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790266    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790270    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790274    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790280    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790284    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790289    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790293    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790297    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790301    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790306    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790310    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790313    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790319    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790323    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790328    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790333    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790337    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790342    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 16:08:04.794217 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790346    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790351    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790355    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790359    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790364    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790369    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790374    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790378    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790383    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790387    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790391    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790396    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790400    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790404    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790408    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790413    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790417    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790421    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790426    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 16:08:04.794703 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790431    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790437    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790441    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790445    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790450    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790454    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790458    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790462    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790467    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790472    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790476    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790480    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790484    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790488    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790492    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790496    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790500    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790505    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.790509    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 16:08:04.795419 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791158    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791167    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791171    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791176    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791181    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791186    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791191    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791195    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791199    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791204    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791208    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791212    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791217    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791222    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791226    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791230    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791234    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791241    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791247    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 16:08:04.795883 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791252    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791257    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791261    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791270    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791276    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791281    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791285    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791289    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791294    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791298    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791302    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791306    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791310    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791314    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791319    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791323    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791327    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791331    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791336    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791340    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 16:08:04.796358 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791344    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791349    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791353    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791357    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791361    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791365    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791370    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791374    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791379    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791383    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791388    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791392    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791396    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791400    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791405    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791412    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791416    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791422    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791429    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 16:08:04.796939 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791435    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791439    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791443    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791448    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791453    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791458    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791462    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791466    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791471    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791475    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791479    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791483    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791488    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791492    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791496    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791500    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791504    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791508    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791513    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791517    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 16:08:04.797435 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791522    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791526    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791530    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791534    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791540    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791544    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791549    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791554    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791560    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791564    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791568    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791573    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791577    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791582    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791587    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791592    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791596    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791601    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791605    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791612    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 16:08:04.797987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.791617    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791710    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791720    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791729    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791735    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791749    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791755    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791761    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791768    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791773    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791778    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791784    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791789    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791797    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791802    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791807    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791812    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791817    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791821    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791832    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791839    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791844    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791849    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791855    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 26 16:08:04.798530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791861    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791865    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791871    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791877    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791882    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791887    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791892    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791897    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791902    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791909    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791914    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791919    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791924    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791928    2559 flags.go:64] FLAG: --enable-server="true"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791933    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791940    2559 flags.go:64] FLAG: --event-burst="100"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791944    2559 flags.go:64] FLAG: --event-qps="50"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791949    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791954    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791959    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791965    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791970    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791976    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791981    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791986    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 26 16:08:04.799098 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791990    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.791995    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792002    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792008    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792014    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792018    2559 flags.go:64] FLAG: --feature-gates=""
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792025    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792030    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792035    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792040    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792045    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792050    2559 flags.go:64] FLAG: --help="false"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792055    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-131-99.ec2.internal"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792060    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792064    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792069    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792075    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792081    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792086    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792090    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792095    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792099    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792104    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792109    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 26 16:08:04.799787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792114    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792119    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792139    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792144    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792149    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792154    2559 flags.go:64] FLAG: --lock-file=""
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792159    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792164    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792168    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792177    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792184    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792191    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792196    2559 flags.go:64] FLAG: --logging-format="text"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792201    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792206    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792211    2559 flags.go:64] FLAG: --manifest-url=""
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792215    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792222    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792227    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792233    2559 flags.go:64] FLAG: --max-pods="110"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792238    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792243    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792247    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792253    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792258    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 26 16:08:04.800426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792262    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792268    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792279    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792283    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792288    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792293    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792298    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792307    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792312    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792317    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792321    2559 flags.go:64] FLAG: --port="10250"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792326    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792331    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0654443a0c62238f3"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792337    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792342    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792347    2559 flags.go:64] FLAG: --register-node="true"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792352    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792358    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792364    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792369    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792374    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792380    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792385    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792390    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792395    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 26 16:08:04.801048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792399    2559 flags.go:64] FLAG: --runonce="false"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792404    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792409    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792414    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792419    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792423    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792428    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792433    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792438    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792442    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792447    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792452    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792456    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792462    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792467    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792471    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792480    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792484    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792489    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792496    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792501    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792505    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792511    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792515    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792520    2559 flags.go:64] FLAG: --v="2"
Jul 26 16:08:04.801716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792528    2559 flags.go:64] FLAG: --version="false"
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792535    2559 flags.go:64] FLAG: --vmodule=""
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792541    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.792547    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792732    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792739    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792745    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792750    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792755    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792759    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792764    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792768    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792773    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792777    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792782    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792786    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792790    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792795    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792799    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792804    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 16:08:04.802360 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792809    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792813    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792817    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792821    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792825    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792830    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792834    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792839    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792843    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792848    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792852    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792857    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792863    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792867    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792872    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792876    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792881    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792885    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792889    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792894    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 16:08:04.802845 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792898    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792902    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792908    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792915    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792920    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792924    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792929    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792933    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792937    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792942    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792946    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792950    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792954    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792959    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792965    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792970    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792975    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792979    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792983    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 16:08:04.803348 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792987    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792992    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.792996    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793000    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793006    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793012    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793016    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793020    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793025    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793029    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793033    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793036    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793040    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793044    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793048    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793052    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793057    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793062    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793066    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793070    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 16:08:04.803810 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793074    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793078    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793083    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793087    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793091    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793095    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793099    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793103    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793108    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793112    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793117    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793137    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793142    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793146    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793150    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793154    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793158    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793167    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793172    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793176    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 16:08:04.804314 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793181    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 16:08:04.804807 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793187    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 16:08:04.804807 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793193    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 16:08:04.804807 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.793198    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 16:08:04.804807 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.793979    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 16:08:04.804807 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.801458    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 26 16:08:04.804807 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.801472    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 26 16:08:04.804807 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.801491    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 26 16:08:04.804807 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.801496    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 26 16:08:04.804807 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801571    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 16:08:04.804807 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801576    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 16:08:04.804807 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801579    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 16:08:04.804807 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801582    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 16:08:04.804807 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801586    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 16:08:04.804807 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801588    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801591    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801594    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801596    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801599    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801602    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801605    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801608    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801610    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801613    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801616    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801619    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801623    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801627    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801630    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801639    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801642    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801645    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801647    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 16:08:04.805164 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801650    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801653    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801655    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801658    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801661    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801664    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801667    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801670    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801673    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801675    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801678    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801681    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801683    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801686    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801689    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801691    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801694    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801697    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801699    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801702    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 16:08:04.805627 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801705    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801707    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801710    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801718    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801722    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801724    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801727    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801730    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801733    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801741    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801744    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801746    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801749    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801751    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801754    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801756    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801759    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801762    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801765    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801768    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801774    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 16:08:04.806104 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801777    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801779    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801782    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801785    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801787    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801790    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801792    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801795    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801797    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801800    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801803    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801805    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801808    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801811    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801813    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801816    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801818    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801821    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801823    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801826    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 16:08:04.806672 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801828    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 16:08:04.807207 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801844    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 16:08:04.807207 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801848    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 16:08:04.807207 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801852    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 16:08:04.807207 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801856    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 16:08:04.807207 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801858    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 16:08:04.807207 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801861    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 16:08:04.807207 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801865    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 16:08:04.807207 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801868    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 16:08:04.807207 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801871    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 16:08:04.807207 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801874    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 16:08:04.807207 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801877    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 16:08:04.807207 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801880    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 16:08:04.807207 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.801882    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 16:08:04.807207 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.801887    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802031    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802036    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802039    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802042    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802045    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802048    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802051    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802053    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802056    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802058    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802061    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802063    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802066    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802068    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802071    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802073    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802076    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802078    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802081    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 16:08:04.807559 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802090    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802093    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802096    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802098    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802101    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802103    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802107    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802109    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802112    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802114    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802117    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802119    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802135    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802139    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802142    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802145    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802148    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802152    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802155    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802157    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 16:08:04.808081 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802160    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802162    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802165    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802167    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802170    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802173    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802175    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802179    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802183    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802186    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802189    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802191    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802194    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802204    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802207    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802210    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802212    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802215    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802218    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 16:08:04.808573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802221    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802223    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802226    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802229    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802232    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802234    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802253    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802257    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802260    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802263    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802266    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802268    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802271    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802274    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802276    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802279    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802281    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802284    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802286    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 16:08:04.809041 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802290    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802293    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802296    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802299    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802301    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802304    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802307    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802309    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802322    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802324    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802327    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802329    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802332    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802335    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802337    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802340    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802343    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802345    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802348    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802351    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 16:08:04.809502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802353    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 16:08:04.809987 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:04.802356    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 16:08:04.809987 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.802360    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 16:08:04.809987 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.802466    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 26 16:08:04.809987 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.804911    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 26 16:08:04.809987 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.806596    2559 server.go:1019] "Starting client certificate rotation"
Jul 26 16:08:04.809987 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.806706    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 26 16:08:04.809987 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.806740    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 26 16:08:04.809987 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.809541    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 26 16:08:04.811079 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.811060    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 26 16:08:04.823172 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.823151    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 26 16:08:04.825598 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.825584    2559 log.go:25] "Validated CRI v1 image API"
Jul 26 16:08:04.826465 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.826446    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 26 16:08:04.831709 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.831687    2559 fs.go:135] Filesystem UUIDs: map[34e1d9c6-a6bc-4340-bf20-9ed1926cfaed:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cc9248d4-13e1-49a5-907d-a86791bb117a:/dev/nvme0n1p3]
Jul 26 16:08:04.831777 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.831708    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 26 16:08:04.837812 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.837699    2559 manager.go:216] Machine: {Timestamp:2026-07-26 16:08:04.836245665 +0000 UTC m=+0.370944931 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101999 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a53b11c56766d85bd85b1d86ed4c7 SystemUUID:ec2a53b1-1c56-766d-85bd-85b1d86ed4c7 BootID:0bf27566-cd1a-42c1-b8de-31094d63ee70 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:61:7e:af:cd:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:61:7e:af:cd:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:13:1c:59:a5:85 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 26 16:08:04.837812 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.837801    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 26 16:08:04.837946 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.837884    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 26 16:08:04.838260 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.838246    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 26 16:08:04.841318 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.841289    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 26 16:08:04.841460 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.841322    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-99.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 26 16:08:04.842193 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.842183    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 26 16:08:04.842234 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.842196    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 26 16:08:04.842234 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.842204    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 26 16:08:04.842234 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.842217    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 26 16:08:04.843563 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.843554    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 26 16:08:04.846374 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.846363    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 26 16:08:04.846481 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.846471    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 26 16:08:04.846511 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.846500    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 26 16:08:04.846538 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.846515    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 26 16:08:04.846538 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.846527    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 26 16:08:04.846538 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.846535    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 26 16:08:04.846661 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.846543    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 26 16:08:04.846905 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.846893    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 26 16:08:04.846964 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.846911    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 26 16:08:04.849366 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.849352    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 26 16:08:04.851813 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.851795    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 26 16:08:04.851868 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.851830    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 26 16:08:04.853878 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.853865    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 26 16:08:04.853918 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.853883    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 26 16:08:04.853918 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.853890    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 26 16:08:04.853918 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.853908    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 26 16:08:04.853918 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.853918    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 26 16:08:04.854037 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.853934    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 26 16:08:04.854037 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.853943    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 26 16:08:04.854037 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.853948    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 26 16:08:04.854037 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.853954    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 26 16:08:04.854037 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.853960    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 26 16:08:04.854037 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.853974    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 26 16:08:04.854037 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.853980    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 26 16:08:04.854935 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.854922    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 26 16:08:04.854935 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.854934    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 26 16:08:04.857216 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.857201    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-99.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 26 16:08:04.857292 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:04.857199    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 26 16:08:04.857292 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:04.857203    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 26 16:08:04.858277 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.858265    2559 server.go:1268] "Started kubelet"
Jul 26 16:08:04.858372 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.858346    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 26 16:08:04.862812 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.862759    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 26 16:08:04.862910 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.862835    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 26 16:08:04.863501 ip-10-0-131-99 systemd[1]: Started Kubernetes Kubelet.
Jul 26 16:08:04.867118 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.866994    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 26 16:08:04.868401 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:04.868380    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 26 16:08:04.868643 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.868601    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 26 16:08:04.870542 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:04.869411    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-99.ec2.internal.18c5e2b2cae2b115  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-99.ec2.internal,UID:ip-10-0-131-99.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-99.ec2.internal,},FirstTimestamp:2026-07-26 16:08:04.858179861 +0000 UTC m=+0.392879127,LastTimestamp:2026-07-26 16:08:04.858179861 +0000 UTC m=+0.392879127,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-99.ec2.internal,}"
Jul 26 16:08:04.877999 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.877980    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 26 16:08:04.878101 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.877998    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 26 16:08:04.878208 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:04.878195    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-99.ec2.internal\" not found"
Jul 26 16:08:04.878758 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.878739    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 26 16:08:04.878758 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.878758    2559 factory.go:55] Registering systemd factory
Jul 26 16:08:04.878896 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.878767    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 26 16:08:04.878896 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.878775    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 26 16:08:04.878896 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.878805    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 26 16:08:04.878896 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.878807    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 26 16:08:04.879061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.878904    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 26 16:08:04.879061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.878912    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 26 16:08:04.879061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.879030    2559 factory.go:153] Registering CRI-O factory
Jul 26 16:08:04.879061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.879044    2559 factory.go:223] Registration of the crio container factory successfully
Jul 26 16:08:04.879252 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.879065    2559 factory.go:103] Registering Raw factory
Jul 26 16:08:04.879252 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.879079    2559 manager.go:1196] Started watching for new ooms in manager
Jul 26 16:08:04.879600 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.879456    2559 manager.go:349] Starting recovery of all containers
Jul 26 16:08:04.880414 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:04.880391    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 26 16:08:04.880508 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:04.880487    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 26 16:08:04.887952 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.887930    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d2lcd"
Jul 26 16:08:04.891009 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.890997    2559 manager.go:354] Recovery completed
Jul 26 16:08:04.893612 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.893590    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d2lcd"
Jul 26 16:08:04.897201 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.897187    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 16:08:04.900453 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.900437    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 16:08:04.900523 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.900466    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 16:08:04.900523 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.900479    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasSufficientPID"
Jul 26 16:08:04.901092 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.901078    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 16:08:04.901527 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.901512    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 26 16:08:04.901527 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.901527    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 26 16:08:04.901656 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.901544    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 26 16:08:04.902263 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.902246    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 16:08:04.902343 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.902278    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 16:08:04.902343 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.902294    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasSufficientPID"
Jul 26 16:08:04.904288 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.904275    2559 policy_none.go:49] "None policy: Start"
Jul 26 16:08:04.904357 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.904292    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 26 16:08:04.904357 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.904303    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 26 16:08:04.906217 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.906205    2559 policy_none.go:47] "Start"
Jul 26 16:08:04.938686 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.938668    2559 manager.go:337] "Starting Device Plugin manager"
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:04.938705    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.938717    2559 server.go:87] "Starting device plugin registration server"
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.938949    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.938961    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.939093    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.939225    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.939235    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:04.939693    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:04.939859    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-99.ec2.internal\" not found"
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.947083    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.948182    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.948224    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.948249    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:04.948287    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 26 16:08:04.956718 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:04.950628    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 16:08:05.040112 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.040036    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 16:08:05.041140 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.041111    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 16:08:05.041252 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.041157    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 16:08:05.041252 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.041173    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasSufficientPID"
Jul 26 16:08:05.041252 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.041201    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.048622 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.048601    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-99.ec2.internal"]
Jul 26 16:08:05.048704 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.048664    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 16:08:05.051434 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.051415    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.051524 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:05.051442    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-99.ec2.internal\": node \"ip-10-0-131-99.ec2.internal\" not found"
Jul 26 16:08:05.051713 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.051699    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 16:08:05.051759 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.051725    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 16:08:05.051759 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.051736    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasSufficientPID"
Jul 26 16:08:05.053897 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.053885    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 16:08:05.054022 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.054008    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.054063 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.054038    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 16:08:05.054646 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.054629    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 16:08:05.054646 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.054644    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 16:08:05.054767 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.054661    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 16:08:05.054767 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.054678    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasSufficientPID"
Jul 26 16:08:05.054767 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.054664    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 16:08:05.054767 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.054742    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasSufficientPID"
Jul 26 16:08:05.056963 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.056948    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.057036 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.056972    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 16:08:05.057592 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.057578    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 16:08:05.057650 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.057603    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 16:08:05.057650 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.057613    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeHasSufficientPID"
Jul 26 16:08:05.076925 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:05.076906    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-99.ec2.internal\" not found"
Jul 26 16:08:05.080743 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.080726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b8c82cd2b2600eb21dd1494d0fff63e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal\" (UID: \"6b8c82cd2b2600eb21dd1494d0fff63e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.080817 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.080750    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b8c82cd2b2600eb21dd1494d0fff63e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal\" (UID: \"6b8c82cd2b2600eb21dd1494d0fff63e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.080817 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:05.080764    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-99.ec2.internal\" not found" node="ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.080817 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.080768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8adaacd782e93dbe1035567c610a881f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-99.ec2.internal\" (UID: \"8adaacd782e93dbe1035567c610a881f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.085205 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:05.085184    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-99.ec2.internal\" not found" node="ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.177850 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:05.177804    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-99.ec2.internal\" not found"
Jul 26 16:08:05.181047 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.181030    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8adaacd782e93dbe1035567c610a881f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-99.ec2.internal\" (UID: \"8adaacd782e93dbe1035567c610a881f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.181106 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.181056    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b8c82cd2b2600eb21dd1494d0fff63e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal\" (UID: \"6b8c82cd2b2600eb21dd1494d0fff63e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.181106 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.181074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b8c82cd2b2600eb21dd1494d0fff63e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal\" (UID: \"6b8c82cd2b2600eb21dd1494d0fff63e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.181194 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.181137    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b8c82cd2b2600eb21dd1494d0fff63e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal\" (UID: \"6b8c82cd2b2600eb21dd1494d0fff63e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.181194 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.181146    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8adaacd782e93dbe1035567c610a881f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-99.ec2.internal\" (UID: \"8adaacd782e93dbe1035567c610a881f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.181194 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.181167    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b8c82cd2b2600eb21dd1494d0fff63e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal\" (UID: \"6b8c82cd2b2600eb21dd1494d0fff63e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.278289 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:05.278234    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-99.ec2.internal\" not found"
Jul 26 16:08:05.378928 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:05.378866    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-99.ec2.internal\" not found"
Jul 26 16:08:05.385212 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.385185    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.389467 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.389451    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.479467 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:05.479433    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-99.ec2.internal\" not found"
Jul 26 16:08:05.580072 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:05.580045    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-99.ec2.internal\" not found"
Jul 26 16:08:05.681175 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:05.681095    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-99.ec2.internal\" not found"
Jul 26 16:08:05.724229 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.724200    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 16:08:05.781666 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:05.781634    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-99.ec2.internal\" not found"
Jul 26 16:08:05.806823 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.806789    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 26 16:08:05.806999 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.806975    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 26 16:08:05.807050 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.806980    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 26 16:08:05.882393 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:05.882357    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-99.ec2.internal\" not found"
Jul 26 16:08:05.900659 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.900621    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-25 16:03:05 +0000 UTC" deadline="2028-01-14 06:30:34.721948638 +0000 UTC"
Jul 26 16:08:05.900659 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.900654    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12878h22m28.82129983s"
Jul 26 16:08:05.902413 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.902393    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 16:08:05.978648 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.978431    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:05.987822 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.987797    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 16:08:05.989366 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.989345    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 26 16:08:05.990506 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:05.990489    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal"
Jul 26 16:08:06.004629 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.004505    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 26 16:08:06.088967 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:06.088930    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8adaacd782e93dbe1035567c610a881f.slice/crio-40c69752592a0e6b90d8a7eff213864800a359241579fa8461699e1b98bf3237 WatchSource:0}: Error finding container 40c69752592a0e6b90d8a7eff213864800a359241579fa8461699e1b98bf3237: Status 404 returned error can't find the container with id 40c69752592a0e6b90d8a7eff213864800a359241579fa8461699e1b98bf3237
Jul 26 16:08:06.095773 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.095756    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 16:08:06.099135 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:06.099108    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b8c82cd2b2600eb21dd1494d0fff63e.slice/crio-1b4b81eefc537f83884640b8106b513d0146ef2f9f24b08f9a099fc291dbd9a2 WatchSource:0}: Error finding container 1b4b81eefc537f83884640b8106b513d0146ef2f9f24b08f9a099fc291dbd9a2: Status 404 returned error can't find the container with id 1b4b81eefc537f83884640b8106b513d0146ef2f9f24b08f9a099fc291dbd9a2
Jul 26 16:08:06.798229 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.798199    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 16:08:06.849644 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.849589    2559 apiserver.go:52] "Watching apiserver"
Jul 26 16:08:06.858905 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.858879    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 26 16:08:06.860604 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.860574    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-x7ztp","openshift-ovn-kubernetes/ovnkube-node-dc557","kube-system/kube-apiserver-proxy-ip-10-0-131-99.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6","openshift-dns/node-resolver-gvssk","openshift-image-registry/node-ca-z66qt","openshift-multus/multus-5h9qg","openshift-network-diagnostics/network-check-target-4crpp","kube-system/global-pull-secret-syncer-z5w5l","kube-system/konnectivity-agent-2s5df","openshift-cluster-node-tuning-operator/tuned-km55d","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal","openshift-multus/multus-additional-cni-plugins-7qhfk","openshift-multus/network-metrics-daemon-x7grb"]
Jul 26 16:08:06.863882 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.863861    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.866217 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.866024    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:06.866217 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:06.866124    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:06.867157 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.867134    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 26 16:08:06.867389 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.867371    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 26 16:08:06.867750 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.867732    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 26 16:08:06.867827 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.867732    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 26 16:08:06.868128 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.868103    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w2j8x\""
Jul 26 16:08:06.868913 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.868890    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:06.871379 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.870971    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 26 16:08:06.871379 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.871120    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:06.871379 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.871233    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qv8fl\""
Jul 26 16:08:06.871379 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.871233    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 26 16:08:06.873543 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.873525    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 26 16:08:06.873662 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.873621    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gvssk"
Jul 26 16:08:06.873991 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.873850    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 26 16:08:06.874125 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.874107    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 26 16:08:06.874362 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.874335    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vltp9\""
Jul 26 16:08:06.876019 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.875994    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z66qt"
Jul 26 16:08:06.876234 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.876216    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 26 16:08:06.876494 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.876473    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9gdj6\""
Jul 26 16:08:06.877083 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.877066    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 26 16:08:06.878509 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.878489    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7ztp"
Jul 26 16:08:06.879007 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.878984    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 26 16:08:06.879108 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.879054    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dkfmz\""
Jul 26 16:08:06.879367 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.879346    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 26 16:08:06.879367 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.879358    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 26 16:08:06.879655 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.879638    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 26 16:08:06.880917 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.880896    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 26 16:08:06.881163 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.881128    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 26 16:08:06.881434 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.881402    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 26 16:08:06.881624 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.881607    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:06.881697 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:06.881674    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:06.881864 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.881846    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jdg84\""
Jul 26 16:08:06.883630 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.883613    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:06.883733 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:06.883694    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:06.886919 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.886896    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2s5df"
Jul 26 16:08:06.889488 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.889236    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bcs97\""
Jul 26 16:08:06.889585 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.889501    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:06.889585 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.889561    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 26 16:08:06.891032 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.890922    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.891606    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a797309-faed-4e45-b1d9-480ed7a7cc19-cnibin\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.891661    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-system-cni-dir\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.891709    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b377323e-dc82-4563-9cd5-e3cae8ee8002-cni-binary-copy\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.891867    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b377323e-dc82-4563-9cd5-e3cae8ee8002-multus-daemon-config\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.891898    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a797309-faed-4e45-b1d9-480ed7a7cc19-system-cni-dir\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.891931    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a797309-faed-4e45-b1d9-480ed7a7cc19-os-release\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.891961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a797309-faed-4e45-b1d9-480ed7a7cc19-cni-binary-copy\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.892546    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-run-netns\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.892598    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-hostroot\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.892628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5-tmp-dir\") pod \"node-resolver-gvssk\" (UID: \"86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5\") " pod="openshift-dns/node-resolver-gvssk"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.892663    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tb6p\" (UniqueName: \"kubernetes.io/projected/7253b8f8-7797-434e-9789-b796950e4959-kube-api-access-7tb6p\") pod \"node-ca-z66qt\" (UID: \"7253b8f8-7797-434e-9789-b796950e4959\") " pod="openshift-image-registry/node-ca-z66qt"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.892779    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a797309-faed-4e45-b1d9-480ed7a7cc19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.892818    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-multus-cni-dir\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.892873    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-multus-socket-dir-parent\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.892901    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3d27607-9b42-43de-9123-060459575df7-host-slash\") pod \"iptables-alerter-x7ztp\" (UID: \"d3d27607-9b42-43de-9123-060459575df7\") " pod="openshift-network-operator/iptables-alerter-x7ztp"
Jul 26 16:08:06.894182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.892933    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-run-k8s-cni-cncf-io\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.892977    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-var-lib-cni-multus\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893015    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-sys-fs\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893067    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5-hosts-file\") pod \"node-resolver-gvssk\" (UID: \"86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5\") " pod="openshift-dns/node-resolver-gvssk"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893255    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-var-lib-cni-bin\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893299    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-etc-kubernetes\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893330    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cmqk\" (UniqueName: \"kubernetes.io/projected/b377323e-dc82-4563-9cd5-e3cae8ee8002-kube-api-access-6cmqk\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-socket-dir\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893396    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-device-dir\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893496    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a797309-faed-4e45-b1d9-480ed7a7cc19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893517    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmngq\" (UniqueName: \"kubernetes.io/projected/0a797309-faed-4e45-b1d9-480ed7a7cc19-kube-api-access-rmngq\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893545    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-os-release\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893566    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-var-lib-kubelet\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-multus-conf-dir\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-run-multus-certs\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893626    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs\") pod \"network-metrics-daemon-x7grb\" (UID: \"47facb48-c30f-47eb-b670-a4ff92388d64\") " pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:06.894874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntwwl\" (UniqueName: \"kubernetes.io/projected/47facb48-c30f-47eb-b670-a4ff92388d64-kube-api-access-ntwwl\") pod \"network-metrics-daemon-x7grb\" (UID: \"47facb48-c30f-47eb-b670-a4ff92388d64\") " pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893799    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-registration-dir\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893862    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmldm\" (UniqueName: \"kubernetes.io/projected/0f67f8fb-930e-454a-a7c5-85159ec29c6a-kube-api-access-dmldm\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893895    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k4f9\" (UniqueName: \"kubernetes.io/projected/86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5-kube-api-access-8k4f9\") pod \"node-resolver-gvssk\" (UID: \"86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5\") " pod="openshift-dns/node-resolver-gvssk"
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893936    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7253b8f8-7797-434e-9789-b796950e4959-serviceca\") pod \"node-ca-z66qt\" (UID: \"7253b8f8-7797-434e-9789-b796950e4959\") " pod="openshift-image-registry/node-ca-z66qt"
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.893991    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48h99\" (UniqueName: \"kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99\") pod \"network-check-target-4crpp\" (UID: \"7f896b51-c96d-43be-a208-6ef29f15a96e\") " pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.894010    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.894027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a797309-faed-4e45-b1d9-480ed7a7cc19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.894063    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3d27607-9b42-43de-9123-060459575df7-iptables-alerter-script\") pod \"iptables-alerter-x7ztp\" (UID: \"d3d27607-9b42-43de-9123-060459575df7\") " pod="openshift-network-operator/iptables-alerter-x7ztp"
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.894062    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ptq2r\""
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.894126    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxzw6\" (UniqueName: \"kubernetes.io/projected/d3d27607-9b42-43de-9123-060459575df7-kube-api-access-fxzw6\") pod \"iptables-alerter-x7ztp\" (UID: \"d3d27607-9b42-43de-9123-060459575df7\") " pod="openshift-network-operator/iptables-alerter-x7ztp"
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.894348    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.894964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-cnibin\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.894985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7253b8f8-7797-434e-9789-b796950e4959-host\") pod \"node-ca-z66qt\" (UID: \"7253b8f8-7797-434e-9789-b796950e4959\") " pod="openshift-image-registry/node-ca-z66qt"
Jul 26 16:08:06.895472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.895449    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 26 16:08:06.898379 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.897961    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:06.900307 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.900282    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 26 16:08:06.900403 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.900346    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 26 16:08:06.900462 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.900409    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 26 16:08:06.900462 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.900424    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 26 16:08:06.900567 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.900456    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hq5gc\""
Jul 26 16:08:06.900821 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.900802    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 26 16:08:06.901061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.901042    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 26 16:08:06.915352 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.915332    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zx9mh"
Jul 26 16:08:06.925321 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.925298    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zx9mh"
Jul 26 16:08:06.955337 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.955283    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal" event={"ID":"6b8c82cd2b2600eb21dd1494d0fff63e","Type":"ContainerStarted","Data":"1b4b81eefc537f83884640b8106b513d0146ef2f9f24b08f9a099fc291dbd9a2"}
Jul 26 16:08:06.959228 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.959205    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-99.ec2.internal" event={"ID":"8adaacd782e93dbe1035567c610a881f","Type":"ContainerStarted","Data":"40c69752592a0e6b90d8a7eff213864800a359241579fa8461699e1b98bf3237"}
Jul 26 16:08:06.979951 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.979878    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.995884    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a797309-faed-4e45-b1d9-480ed7a7cc19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.995925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-run-multus-certs\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.995954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntwwl\" (UniqueName: \"kubernetes.io/projected/47facb48-c30f-47eb-b670-a4ff92388d64-kube-api-access-ntwwl\") pod \"network-metrics-daemon-x7grb\" (UID: \"47facb48-c30f-47eb-b670-a4ff92388d64\") " pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.995981    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmldm\" (UniqueName: \"kubernetes.io/projected/0f67f8fb-930e-454a-a7c5-85159ec29c6a-kube-api-access-dmldm\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996067    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-kubelet-config\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996096    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-run-openvswitch\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996122    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996150    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k4f9\" (UniqueName: \"kubernetes.io/projected/86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5-kube-api-access-8k4f9\") pod \"node-resolver-gvssk\" (UID: \"86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5\") " pod="openshift-dns/node-resolver-gvssk"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48h99\" (UniqueName: \"kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99\") pod \"network-check-target-4crpp\" (UID: \"7f896b51-c96d-43be-a208-6ef29f15a96e\") " pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996226    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-run\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996254    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-cni-netd\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996309    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a797309-faed-4e45-b1d9-480ed7a7cc19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996337    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3d27607-9b42-43de-9123-060459575df7-iptables-alerter-script\") pod \"iptables-alerter-x7ztp\" (UID: \"d3d27607-9b42-43de-9123-060459575df7\") " pod="openshift-network-operator/iptables-alerter-x7ztp"
Jul 26 16:08:06.997165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxzw6\" (UniqueName: \"kubernetes.io/projected/d3d27607-9b42-43de-9123-060459575df7-kube-api-access-fxzw6\") pod \"iptables-alerter-x7ztp\" (UID: \"d3d27607-9b42-43de-9123-060459575df7\") " pod="openshift-network-operator/iptables-alerter-x7ztp"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996413    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7253b8f8-7797-434e-9789-b796950e4959-host\") pod \"node-ca-z66qt\" (UID: \"7253b8f8-7797-434e-9789-b796950e4959\") " pod="openshift-image-registry/node-ca-z66qt"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996468    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-slash\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-system-cni-dir\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996521    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-sysconfig\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996545    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-tuned\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4wn2\" (UniqueName: \"kubernetes.io/projected/6396beb5-6e97-4b36-99cb-15e183d196b8-kube-api-access-g4wn2\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996593    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-node-log\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996624    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a797309-faed-4e45-b1d9-480ed7a7cc19-cni-binary-copy\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996650    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-hostroot\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996674    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5-tmp-dir\") pod \"node-resolver-gvssk\" (UID: \"86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5\") " pod="openshift-dns/node-resolver-gvssk"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996705    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-var-lib-kubelet\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-run-ovn-kubernetes\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab623d75-d2e3-43e6-b8c4-98f377a49561-env-overrides\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-multus-socket-dir-parent\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996826    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-sysctl-conf\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:06.998012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996851    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-systemd\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996896    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3d27607-9b42-43de-9123-060459575df7-host-slash\") pod \"iptables-alerter-x7ztp\" (UID: \"d3d27607-9b42-43de-9123-060459575df7\") " pod="openshift-network-operator/iptables-alerter-x7ztp"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-run-k8s-cni-cncf-io\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5-hosts-file\") pod \"node-resolver-gvssk\" (UID: \"86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5\") " pod="openshift-dns/node-resolver-gvssk"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.996985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-lib-modules\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-var-lib-openvswitch\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997047    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-var-lib-cni-bin\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997073    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-socket-dir\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997098    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-sysctl-d\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997143    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6396beb5-6e97-4b36-99cb-15e183d196b8-tmp\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997167    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-sys\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmngq\" (UniqueName: \"kubernetes.io/projected/0a797309-faed-4e45-b1d9-480ed7a7cc19-kube-api-access-rmngq\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-os-release\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-var-lib-kubelet\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997389    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-multus-conf-dir\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997421    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs\") pod \"network-metrics-daemon-x7grb\" (UID: \"47facb48-c30f-47eb-b670-a4ff92388d64\") " pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-registration-dir\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:07.001909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997476    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-run-ovn\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7253b8f8-7797-434e-9789-b796950e4959-serviceca\") pod \"node-ca-z66qt\" (UID: \"7253b8f8-7797-434e-9789-b796950e4959\") " pod="openshift-image-registry/node-ca-z66qt"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997533    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-run-systemd\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997558    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab623d75-d2e3-43e6-b8c4-98f377a49561-ovn-node-metrics-cert\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997585    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-cnibin\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-modprobe-d\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997645    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-kubernetes\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-kubelet\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997699    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab623d75-d2e3-43e6-b8c4-98f377a49561-ovnkube-config\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997725    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a797309-faed-4e45-b1d9-480ed7a7cc19-cnibin\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b377323e-dc82-4563-9cd5-e3cae8ee8002-cni-binary-copy\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997779    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b377323e-dc82-4563-9cd5-e3cae8ee8002-multus-daemon-config\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a05de7a3-da4b-4350-8d8b-a509ffc0b45d-konnectivity-ca\") pod \"konnectivity-agent-2s5df\" (UID: \"a05de7a3-da4b-4350-8d8b-a509ffc0b45d\") " pod="kube-system/konnectivity-agent-2s5df"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-log-socket\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997862    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n78lh\" (UniqueName: \"kubernetes.io/projected/ab623d75-d2e3-43e6-b8c4-98f377a49561-kube-api-access-n78lh\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a797309-faed-4e45-b1d9-480ed7a7cc19-system-cni-dir\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997921    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a797309-faed-4e45-b1d9-480ed7a7cc19-os-release\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:07.002667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997950    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-run-netns\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.997982    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tb6p\" (UniqueName: \"kubernetes.io/projected/7253b8f8-7797-434e-9789-b796950e4959-kube-api-access-7tb6p\") pod \"node-ca-z66qt\" (UID: \"7253b8f8-7797-434e-9789-b796950e4959\") " pod="openshift-image-registry/node-ca-z66qt"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-host\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998039    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-systemd-units\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-run-netns\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998095    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-cni-bin\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a797309-faed-4e45-b1d9-480ed7a7cc19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998159    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-multus-cni-dir\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998185    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-etc-openvswitch\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998231    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-var-lib-cni-multus\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998260    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-sys-fs\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998288    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-dbus\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998314    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a05de7a3-da4b-4350-8d8b-a509ffc0b45d-agent-certs\") pod \"konnectivity-agent-2s5df\" (UID: \"a05de7a3-da4b-4350-8d8b-a509ffc0b45d\") " pod="kube-system/konnectivity-agent-2s5df"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998343    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab623d75-d2e3-43e6-b8c4-98f377a49561-ovnkube-script-lib\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998379    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-etc-kubernetes\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998430    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a797309-faed-4e45-b1d9-480ed7a7cc19-cnibin\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998472    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cmqk\" (UniqueName: \"kubernetes.io/projected/b377323e-dc82-4563-9cd5-e3cae8ee8002-kube-api-access-6cmqk\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.003391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998496    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-var-lib-cni-bin\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998504    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-device-dir\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998634    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-socket-dir\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998679    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-device-dir\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.998993    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-os-release\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999031    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b377323e-dc82-4563-9cd5-e3cae8ee8002-cni-binary-copy\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999037    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a797309-faed-4e45-b1d9-480ed7a7cc19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999108    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-multus-conf-dir\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999121    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-registration-dir\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:06.999219    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999245    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a797309-faed-4e45-b1d9-480ed7a7cc19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:06.999308    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs podName:47facb48-c30f-47eb-b670-a4ff92388d64 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:07.499284034 +0000 UTC m=+3.033983351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs") pod "network-metrics-daemon-x7grb" (UID: "47facb48-c30f-47eb-b670-a4ff92388d64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999504    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-run-multus-certs\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999521    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-multus-cni-dir\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999572    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b377323e-dc82-4563-9cd5-e3cae8ee8002-multus-daemon-config\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999614    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7253b8f8-7797-434e-9789-b796950e4959-serviceca\") pod \"node-ca-z66qt\" (UID: \"7253b8f8-7797-434e-9789-b796950e4959\") " pod="openshift-image-registry/node-ca-z66qt"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999684    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a797309-faed-4e45-b1d9-480ed7a7cc19-system-cni-dir\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:07.004123 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999707    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-cnibin\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999721    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-var-lib-cni-multus\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999763    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a797309-faed-4e45-b1d9-480ed7a7cc19-os-release\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999786    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-sys-fs\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999842    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-run-netns\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999849    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-etc-kubernetes\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.000005    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0f67f8fb-930e-454a-a7c5-85159ec29c6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.000326    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a797309-faed-4e45-b1d9-480ed7a7cc19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.000384    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-hostroot\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.000423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-multus-socket-dir-parent\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.000671    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5-tmp-dir\") pod \"node-resolver-gvssk\" (UID: \"86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5\") " pod="openshift-dns/node-resolver-gvssk"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.000745    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3d27607-9b42-43de-9123-060459575df7-host-slash\") pod \"iptables-alerter-x7ztp\" (UID: \"d3d27607-9b42-43de-9123-060459575df7\") " pod="openshift-network-operator/iptables-alerter-x7ztp"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.000789    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-run-k8s-cni-cncf-io\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.000840    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5-hosts-file\") pod \"node-resolver-gvssk\" (UID: \"86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5\") " pod="openshift-dns/node-resolver-gvssk"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:06.999045    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-host-var-lib-kubelet\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.000997    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b377323e-dc82-4563-9cd5-e3cae8ee8002-system-cni-dir\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.001005    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3d27607-9b42-43de-9123-060459575df7-iptables-alerter-script\") pod \"iptables-alerter-x7ztp\" (UID: \"d3d27607-9b42-43de-9123-060459575df7\") " pod="openshift-network-operator/iptables-alerter-x7ztp"
Jul 26 16:08:07.004814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.001101    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7253b8f8-7797-434e-9789-b796950e4959-host\") pod \"node-ca-z66qt\" (UID: \"7253b8f8-7797-434e-9789-b796950e4959\") " pod="openshift-image-registry/node-ca-z66qt"
Jul 26 16:08:07.005654 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.001560    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a797309-faed-4e45-b1d9-480ed7a7cc19-cni-binary-copy\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:07.014715 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.014677    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 26 16:08:07.018947 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.018924    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntwwl\" (UniqueName: \"kubernetes.io/projected/47facb48-c30f-47eb-b670-a4ff92388d64-kube-api-access-ntwwl\") pod \"network-metrics-daemon-x7grb\" (UID: \"47facb48-c30f-47eb-b670-a4ff92388d64\") " pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:07.019688 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.019667    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmngq\" (UniqueName: \"kubernetes.io/projected/0a797309-faed-4e45-b1d9-480ed7a7cc19-kube-api-access-rmngq\") pod \"multus-additional-cni-plugins-7qhfk\" (UID: \"0a797309-faed-4e45-b1d9-480ed7a7cc19\") " pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:07.020950 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.020927    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmldm\" (UniqueName: \"kubernetes.io/projected/0f67f8fb-930e-454a-a7c5-85159ec29c6a-kube-api-access-dmldm\") pod \"aws-ebs-csi-driver-node-69cw6\" (UID: \"0f67f8fb-930e-454a-a7c5-85159ec29c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:07.022052 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.022009    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tb6p\" (UniqueName: \"kubernetes.io/projected/7253b8f8-7797-434e-9789-b796950e4959-kube-api-access-7tb6p\") pod \"node-ca-z66qt\" (UID: \"7253b8f8-7797-434e-9789-b796950e4959\") " pod="openshift-image-registry/node-ca-z66qt"
Jul 26 16:08:07.023408 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.023385    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k4f9\" (UniqueName: \"kubernetes.io/projected/86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5-kube-api-access-8k4f9\") pod \"node-resolver-gvssk\" (UID: \"86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5\") " pod="openshift-dns/node-resolver-gvssk"
Jul 26 16:08:07.024611 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.024566    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cmqk\" (UniqueName: \"kubernetes.io/projected/b377323e-dc82-4563-9cd5-e3cae8ee8002-kube-api-access-6cmqk\") pod \"multus-5h9qg\" (UID: \"b377323e-dc82-4563-9cd5-e3cae8ee8002\") " pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.025290 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:07.024957    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 16:08:07.025290 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:07.024979    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 16:08:07.025290 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:07.024993    2559 projected.go:196] Error preparing data for projected volume kube-api-access-48h99 for pod openshift-network-diagnostics/network-check-target-4crpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 16:08:07.025290 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:07.025059    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99 podName:7f896b51-c96d-43be-a208-6ef29f15a96e nodeName:}" failed. No retries permitted until 2026-07-26 16:08:07.525039822 +0000 UTC m=+3.059739084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-48h99" (UniqueName: "kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99") pod "network-check-target-4crpp" (UID: "7f896b51-c96d-43be-a208-6ef29f15a96e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 16:08:07.028418 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.028050    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxzw6\" (UniqueName: \"kubernetes.io/projected/d3d27607-9b42-43de-9123-060459575df7-kube-api-access-fxzw6\") pod \"iptables-alerter-x7ztp\" (UID: \"d3d27607-9b42-43de-9123-060459575df7\") " pod="openshift-network-operator/iptables-alerter-x7ztp"
Jul 26 16:08:07.099012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.098926    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-run-ovn\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.099012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.098960    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-run-systemd\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.099012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.098985    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab623d75-d2e3-43e6-b8c4-98f377a49561-ovn-node-metrics-cert\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.099012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099011    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-modprobe-d\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099025    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-run-ovn\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099035    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-kubernetes\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099041    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-run-systemd\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-kubelet\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099090    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-kubelet\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099098    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab623d75-d2e3-43e6-b8c4-98f377a49561-ovnkube-config\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a05de7a3-da4b-4350-8d8b-a509ffc0b45d-konnectivity-ca\") pod \"konnectivity-agent-2s5df\" (UID: \"a05de7a3-da4b-4350-8d8b-a509ffc0b45d\") " pod="kube-system/konnectivity-agent-2s5df"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099133    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-kubernetes\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099171    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-log-socket\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099178    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-modprobe-d\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099189    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n78lh\" (UniqueName: \"kubernetes.io/projected/ab623d75-d2e3-43e6-b8c4-98f377a49561-kube-api-access-n78lh\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099217    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-host\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-systemd-units\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099266    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-run-netns\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099289    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-cni-bin\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.099340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-etc-openvswitch\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-dbus\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099389    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a05de7a3-da4b-4350-8d8b-a509ffc0b45d-agent-certs\") pod \"konnectivity-agent-2s5df\" (UID: \"a05de7a3-da4b-4350-8d8b-a509ffc0b45d\") " pod="kube-system/konnectivity-agent-2s5df"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099412    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab623d75-d2e3-43e6-b8c4-98f377a49561-ovnkube-script-lib\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099448    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-kubelet-config\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099467    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-run-openvswitch\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-run\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099509    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-cni-netd\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099525    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099550    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099576    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-slash\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099604    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-sysconfig\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099627    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-tuned\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4wn2\" (UniqueName: \"kubernetes.io/projected/6396beb5-6e97-4b36-99cb-15e183d196b8-kube-api-access-g4wn2\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099686    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-node-log\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-var-lib-kubelet\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099740    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-run-ovn-kubernetes\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.100165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099754    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a05de7a3-da4b-4350-8d8b-a509ffc0b45d-konnectivity-ca\") pod \"konnectivity-agent-2s5df\" (UID: \"a05de7a3-da4b-4350-8d8b-a509ffc0b45d\") " pod="kube-system/konnectivity-agent-2s5df"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099763    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab623d75-d2e3-43e6-b8c4-98f377a49561-env-overrides\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099801    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-sysctl-conf\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099828    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-systemd\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099853    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-lib-modules\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099878    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-var-lib-openvswitch\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099904    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-sysctl-d\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6396beb5-6e97-4b36-99cb-15e183d196b8-tmp\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.099941    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-sys\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100024    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-sys\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100056    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-lib-modules\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100068    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-var-lib-openvswitch\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100085    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab623d75-d2e3-43e6-b8c4-98f377a49561-ovnkube-config\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100155    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-systemd\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100159    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-sysctl-d\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100218    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-run-openvswitch\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100222    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-sysctl-conf\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100254    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-log-socket\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100265    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-sysconfig\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100319    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-run\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100360    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-cni-netd\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100401    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100441    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-host\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100469    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-systemd-units\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100505    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-run-netns\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100541    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-dbus\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:07.100581    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100590    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-cni-bin\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100628    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-etc-openvswitch\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:07.100639    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret podName:3287a3ce-5acd-45cc-99ca-a0b6bdf6d868 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:07.600620068 +0000 UTC m=+3.135319323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret") pod "global-pull-secret-syncer-z5w5l" (UID: "3287a3ce-5acd-45cc-99ca-a0b6bdf6d868") : object "kube-system"/"original-pull-secret" not registered
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-slash\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-node-log\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.100970    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6396beb5-6e97-4b36-99cb-15e183d196b8-var-lib-kubelet\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.101021    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab623d75-d2e3-43e6-b8c4-98f377a49561-host-run-ovn-kubernetes\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.101037    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab623d75-d2e3-43e6-b8c4-98f377a49561-env-overrides\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.101977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.101077    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-kubelet-config\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:07.102904 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.101581    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab623d75-d2e3-43e6-b8c4-98f377a49561-ovnkube-script-lib\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.103989 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.103955    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6396beb5-6e97-4b36-99cb-15e183d196b8-tmp\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.104125 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.104104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab623d75-d2e3-43e6-b8c4-98f377a49561-ovn-node-metrics-cert\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.104185 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.104126    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a05de7a3-da4b-4350-8d8b-a509ffc0b45d-agent-certs\") pod \"konnectivity-agent-2s5df\" (UID: \"a05de7a3-da4b-4350-8d8b-a509ffc0b45d\") " pod="kube-system/konnectivity-agent-2s5df"
Jul 26 16:08:07.104185 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.104140    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6396beb5-6e97-4b36-99cb-15e183d196b8-etc-tuned\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.108045 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.108000    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n78lh\" (UniqueName: \"kubernetes.io/projected/ab623d75-d2e3-43e6-b8c4-98f377a49561-kube-api-access-n78lh\") pod \"ovnkube-node-dc557\" (UID: \"ab623d75-d2e3-43e6-b8c4-98f377a49561\") " pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.109010 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.108988    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4wn2\" (UniqueName: \"kubernetes.io/projected/6396beb5-6e97-4b36-99cb-15e183d196b8-kube-api-access-g4wn2\") pod \"tuned-km55d\" (UID: \"6396beb5-6e97-4b36-99cb-15e183d196b8\") " pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.177826 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.177774    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5h9qg"
Jul 26 16:08:07.186328 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.186303    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7qhfk"
Jul 26 16:08:07.189185 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:07.189157    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb377323e_dc82_4563_9cd5_e3cae8ee8002.slice/crio-f071f5517377113dcfd57931016041d5275b8a3802f519b4aaf0235752e246d6 WatchSource:0}: Error finding container f071f5517377113dcfd57931016041d5275b8a3802f519b4aaf0235752e246d6: Status 404 returned error can't find the container with id f071f5517377113dcfd57931016041d5275b8a3802f519b4aaf0235752e246d6
Jul 26 16:08:07.198280 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.198256    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6"
Jul 26 16:08:07.198451 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:07.198423    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a797309_faed_4e45_b1d9_480ed7a7cc19.slice/crio-e719d26e0a81ad151576409634d2f91060b6629f61a5a33fa3c7b8fc95c09cad WatchSource:0}: Error finding container e719d26e0a81ad151576409634d2f91060b6629f61a5a33fa3c7b8fc95c09cad: Status 404 returned error can't find the container with id e719d26e0a81ad151576409634d2f91060b6629f61a5a33fa3c7b8fc95c09cad
Jul 26 16:08:07.205519 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.205358    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gvssk"
Jul 26 16:08:07.210257 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:07.210232    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f67f8fb_930e_454a_a7c5_85159ec29c6a.slice/crio-a3e638b4cf6b35287dd59c7f643e3196309ef85e2aa183c52d5e1293e7af7445 WatchSource:0}: Error finding container a3e638b4cf6b35287dd59c7f643e3196309ef85e2aa183c52d5e1293e7af7445: Status 404 returned error can't find the container with id a3e638b4cf6b35287dd59c7f643e3196309ef85e2aa183c52d5e1293e7af7445
Jul 26 16:08:07.215579 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.215552    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z66qt"
Jul 26 16:08:07.216603 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:07.216566    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e0c73c_e33c_4ae9_930b_6b2ab5ba9dd5.slice/crio-2bde4e2a97dcc5cb66046668ea6638a1ebd89ed50ca75aa76d179cc414d9f7be WatchSource:0}: Error finding container 2bde4e2a97dcc5cb66046668ea6638a1ebd89ed50ca75aa76d179cc414d9f7be: Status 404 returned error can't find the container with id 2bde4e2a97dcc5cb66046668ea6638a1ebd89ed50ca75aa76d179cc414d9f7be
Jul 26 16:08:07.223266 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.223239    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7ztp"
Jul 26 16:08:07.228589 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:07.228566    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7253b8f8_7797_434e_9789_b796950e4959.slice/crio-7bdd78039ffa8ecf8d13593e9126532fc8688787690b4e0ffc95b3b6a2f4bda1 WatchSource:0}: Error finding container 7bdd78039ffa8ecf8d13593e9126532fc8688787690b4e0ffc95b3b6a2f4bda1: Status 404 returned error can't find the container with id 7bdd78039ffa8ecf8d13593e9126532fc8688787690b4e0ffc95b3b6a2f4bda1
Jul 26 16:08:07.237649 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.237484    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2s5df"
Jul 26 16:08:07.237649 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:07.237589    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d27607_9b42_43de_9123_060459575df7.slice/crio-67fcedbb299d579a0e0883508ba33b3ea0730757b30636134cc63841171d1909 WatchSource:0}: Error finding container 67fcedbb299d579a0e0883508ba33b3ea0730757b30636134cc63841171d1909: Status 404 returned error can't find the container with id 67fcedbb299d579a0e0883508ba33b3ea0730757b30636134cc63841171d1909
Jul 26 16:08:07.247765 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.247741    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-km55d"
Jul 26 16:08:07.249405 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:07.249357    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05de7a3_da4b_4350_8d8b_a509ffc0b45d.slice/crio-e9c5f6b8628967eb95ac7ccde47dd6233d52959a5598e0bc912cba10fff7b87b WatchSource:0}: Error finding container e9c5f6b8628967eb95ac7ccde47dd6233d52959a5598e0bc912cba10fff7b87b: Status 404 returned error can't find the container with id e9c5f6b8628967eb95ac7ccde47dd6233d52959a5598e0bc912cba10fff7b87b
Jul 26 16:08:07.254817 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.254798    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:07.259157 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:07.258967    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6396beb5_6e97_4b36_99cb_15e183d196b8.slice/crio-092221a07b746a434464265bb03d44ae9d17deb61b5087394c809887f1698694 WatchSource:0}: Error finding container 092221a07b746a434464265bb03d44ae9d17deb61b5087394c809887f1698694: Status 404 returned error can't find the container with id 092221a07b746a434464265bb03d44ae9d17deb61b5087394c809887f1698694
Jul 26 16:08:07.267887 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:07.267860    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab623d75_d2e3_43e6_b8c4_98f377a49561.slice/crio-93e28bb6580d75aa053f6d52fdb5dff57a390026d00e5de08e8d33e67f120a7c WatchSource:0}: Error finding container 93e28bb6580d75aa053f6d52fdb5dff57a390026d00e5de08e8d33e67f120a7c: Status 404 returned error can't find the container with id 93e28bb6580d75aa053f6d52fdb5dff57a390026d00e5de08e8d33e67f120a7c
Jul 26 16:08:07.502916 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.502829    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs\") pod \"network-metrics-daemon-x7grb\" (UID: \"47facb48-c30f-47eb-b670-a4ff92388d64\") " pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:07.503095 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:07.502959    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 16:08:07.503095 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:07.503044    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs podName:47facb48-c30f-47eb-b670-a4ff92388d64 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:08.503022643 +0000 UTC m=+4.037721900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs") pod "network-metrics-daemon-x7grb" (UID: "47facb48-c30f-47eb-b670-a4ff92388d64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 16:08:07.603527 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.603486    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48h99\" (UniqueName: \"kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99\") pod \"network-check-target-4crpp\" (UID: \"7f896b51-c96d-43be-a208-6ef29f15a96e\") " pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:07.603741 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.603543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:07.603741 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:07.603627    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 16:08:07.603741 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:07.603656    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 16:08:07.603741 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:07.603671    2559 projected.go:196] Error preparing data for projected volume kube-api-access-48h99 for pod openshift-network-diagnostics/network-check-target-4crpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 16:08:07.603741 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:07.603721    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 16:08:07.604013 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:07.603731    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99 podName:7f896b51-c96d-43be-a208-6ef29f15a96e nodeName:}" failed. No retries permitted until 2026-07-26 16:08:08.603716755 +0000 UTC m=+4.138416010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-48h99" (UniqueName: "kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99") pod "network-check-target-4crpp" (UID: "7f896b51-c96d-43be-a208-6ef29f15a96e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 16:08:07.604013 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:07.603795    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret podName:3287a3ce-5acd-45cc-99ca-a0b6bdf6d868 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:08.603778506 +0000 UTC m=+4.138477774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret") pod "global-pull-secret-syncer-z5w5l" (UID: "3287a3ce-5acd-45cc-99ca-a0b6bdf6d868") : object "kube-system"/"original-pull-secret" not registered
Jul 26 16:08:07.929298 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.929208    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-25 16:03:07 +0000 UTC" deadline="2028-04-02 16:20:05.596102866 +0000 UTC"
Jul 26 16:08:07.929298 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.929252    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14784h11m57.666856009s"
Jul 26 16:08:07.963095 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.963029    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6" event={"ID":"0f67f8fb-930e-454a-a7c5-85159ec29c6a","Type":"ContainerStarted","Data":"a3e638b4cf6b35287dd59c7f643e3196309ef85e2aa183c52d5e1293e7af7445"}
Jul 26 16:08:07.965019 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.964987    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qhfk" event={"ID":"0a797309-faed-4e45-b1d9-480ed7a7cc19","Type":"ContainerStarted","Data":"e719d26e0a81ad151576409634d2f91060b6629f61a5a33fa3c7b8fc95c09cad"}
Jul 26 16:08:07.966588 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.966558    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-km55d" event={"ID":"6396beb5-6e97-4b36-99cb-15e183d196b8","Type":"ContainerStarted","Data":"092221a07b746a434464265bb03d44ae9d17deb61b5087394c809887f1698694"}
Jul 26 16:08:07.968211 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.968173    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7ztp" event={"ID":"d3d27607-9b42-43de-9123-060459575df7","Type":"ContainerStarted","Data":"67fcedbb299d579a0e0883508ba33b3ea0730757b30636134cc63841171d1909"}
Jul 26 16:08:07.969627 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.969603    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5h9qg" event={"ID":"b377323e-dc82-4563-9cd5-e3cae8ee8002","Type":"ContainerStarted","Data":"f071f5517377113dcfd57931016041d5275b8a3802f519b4aaf0235752e246d6"}
Jul 26 16:08:07.971287 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.971257    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dc557" event={"ID":"ab623d75-d2e3-43e6-b8c4-98f377a49561","Type":"ContainerStarted","Data":"93e28bb6580d75aa053f6d52fdb5dff57a390026d00e5de08e8d33e67f120a7c"}
Jul 26 16:08:07.972825 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.972795    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2s5df" event={"ID":"a05de7a3-da4b-4350-8d8b-a509ffc0b45d","Type":"ContainerStarted","Data":"e9c5f6b8628967eb95ac7ccde47dd6233d52959a5598e0bc912cba10fff7b87b"}
Jul 26 16:08:07.974395 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.974362    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z66qt" event={"ID":"7253b8f8-7797-434e-9789-b796950e4959","Type":"ContainerStarted","Data":"7bdd78039ffa8ecf8d13593e9126532fc8688787690b4e0ffc95b3b6a2f4bda1"}
Jul 26 16:08:07.975706 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:07.975682    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gvssk" event={"ID":"86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5","Type":"ContainerStarted","Data":"2bde4e2a97dcc5cb66046668ea6638a1ebd89ed50ca75aa76d179cc414d9f7be"}
Jul 26 16:08:08.250985 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:08.250945    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 16:08:08.510676 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:08.510589    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs\") pod \"network-metrics-daemon-x7grb\" (UID: \"47facb48-c30f-47eb-b670-a4ff92388d64\") " pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:08.510841 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:08.510758    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 16:08:08.510841 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:08.510833    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs podName:47facb48-c30f-47eb-b670-a4ff92388d64 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:10.510810354 +0000 UTC m=+6.045509819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs") pod "network-metrics-daemon-x7grb" (UID: "47facb48-c30f-47eb-b670-a4ff92388d64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 16:08:08.611876 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:08.611762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48h99\" (UniqueName: \"kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99\") pod \"network-check-target-4crpp\" (UID: \"7f896b51-c96d-43be-a208-6ef29f15a96e\") " pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:08.611876 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:08.611822    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:08.612128 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:08.611997    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 16:08:08.612128 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:08.612070    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret podName:3287a3ce-5acd-45cc-99ca-a0b6bdf6d868 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:10.612049644 +0000 UTC m=+6.146748902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret") pod "global-pull-secret-syncer-z5w5l" (UID: "3287a3ce-5acd-45cc-99ca-a0b6bdf6d868") : object "kube-system"/"original-pull-secret" not registered
Jul 26 16:08:08.612347 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:08.612323    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 16:08:08.612413 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:08.612357    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 16:08:08.612413 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:08.612370    2559 projected.go:196] Error preparing data for projected volume kube-api-access-48h99 for pod openshift-network-diagnostics/network-check-target-4crpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 16:08:08.612524 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:08.612422    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99 podName:7f896b51-c96d-43be-a208-6ef29f15a96e nodeName:}" failed. No retries permitted until 2026-07-26 16:08:10.612405893 +0000 UTC m=+6.147105164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-48h99" (UniqueName: "kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99") pod "network-check-target-4crpp" (UID: "7f896b51-c96d-43be-a208-6ef29f15a96e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 16:08:08.929657 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:08.929587    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-25 16:03:07 +0000 UTC" deadline="2028-02-09 20:53:46.43240233 +0000 UTC"
Jul 26 16:08:08.930044 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:08.929659    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13516h45m37.502747697s"
Jul 26 16:08:08.950326 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:08.950290    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:08.950458 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:08.950407    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:08.950549 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:08.950528    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:08.950769 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:08.950631    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:08.950855 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:08.950784    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:08.950910 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:08.950891    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:09.996093 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:09.995635    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-99.ec2.internal" event={"ID":"8adaacd782e93dbe1035567c610a881f","Type":"ContainerStarted","Data":"351f06305ebba280ac26ac886c0cd480bca30c645a73764e8f8d1d9c80244071"}
Jul 26 16:08:10.001593 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:10.000956    2559 generic.go:356] "Generic (PLEG): container finished" podID="6b8c82cd2b2600eb21dd1494d0fff63e" containerID="476906b04f08ea19c5818b6993c23b22ef15e6b122940ddfeab8c873a5142942" exitCode=0
Jul 26 16:08:10.001593 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:10.001001    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal" event={"ID":"6b8c82cd2b2600eb21dd1494d0fff63e","Type":"ContainerDied","Data":"476906b04f08ea19c5818b6993c23b22ef15e6b122940ddfeab8c873a5142942"}
Jul 26 16:08:10.027595 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:10.027533    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-99.ec2.internal" podStartSLOduration=4.027511173 podStartE2EDuration="4.027511173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:08:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:10.011484984 +0000 UTC m=+5.546184264" watchObservedRunningTime="2026-07-26 16:08:10.027511173 +0000 UTC m=+5.562210447"
Jul 26 16:08:10.530812 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:10.530775    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs\") pod \"network-metrics-daemon-x7grb\" (UID: \"47facb48-c30f-47eb-b670-a4ff92388d64\") " pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:10.531023 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:10.530941    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 16:08:10.531023 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:10.531008    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs podName:47facb48-c30f-47eb-b670-a4ff92388d64 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:14.530987902 +0000 UTC m=+10.065687172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs") pod "network-metrics-daemon-x7grb" (UID: "47facb48-c30f-47eb-b670-a4ff92388d64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 16:08:10.632308 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:10.632267    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48h99\" (UniqueName: \"kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99\") pod \"network-check-target-4crpp\" (UID: \"7f896b51-c96d-43be-a208-6ef29f15a96e\") " pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:10.632485 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:10.632321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:10.632485 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:10.632443    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 16:08:10.632592 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:10.632507    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret podName:3287a3ce-5acd-45cc-99ca-a0b6bdf6d868 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:14.632488214 +0000 UTC m=+10.167187472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret") pod "global-pull-secret-syncer-z5w5l" (UID: "3287a3ce-5acd-45cc-99ca-a0b6bdf6d868") : object "kube-system"/"original-pull-secret" not registered
Jul 26 16:08:10.632689 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:10.632603    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 16:08:10.632689 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:10.632630    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 16:08:10.632689 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:10.632645    2559 projected.go:196] Error preparing data for projected volume kube-api-access-48h99 for pod openshift-network-diagnostics/network-check-target-4crpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 16:08:10.632837 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:10.632687    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99 podName:7f896b51-c96d-43be-a208-6ef29f15a96e nodeName:}" failed. No retries permitted until 2026-07-26 16:08:14.632670817 +0000 UTC m=+10.167370074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-48h99" (UniqueName: "kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99") pod "network-check-target-4crpp" (UID: "7f896b51-c96d-43be-a208-6ef29f15a96e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 16:08:10.950716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:10.950051    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:10.950716 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:10.950209    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:10.950716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:10.950564    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:10.950716 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:10.950645    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:10.951482 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:10.951017    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:10.951482 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:10.951108    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:12.949591 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:12.949555    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:12.950062 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:12.949694    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:12.950158 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:12.950136    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:12.950290 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:12.950261    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:12.950453 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:12.950419    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:12.950543 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:12.950525    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:14.567692 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:14.567650    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs\") pod \"network-metrics-daemon-x7grb\" (UID: \"47facb48-c30f-47eb-b670-a4ff92388d64\") " pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:14.568180 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:14.567914    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 16:08:14.568180 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:14.567980    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs podName:47facb48-c30f-47eb-b670-a4ff92388d64 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:22.56796086 +0000 UTC m=+18.102660124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs") pod "network-metrics-daemon-x7grb" (UID: "47facb48-c30f-47eb-b670-a4ff92388d64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 16:08:14.668773 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:14.668732    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48h99\" (UniqueName: \"kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99\") pod \"network-check-target-4crpp\" (UID: \"7f896b51-c96d-43be-a208-6ef29f15a96e\") " pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:14.668941 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:14.668792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:14.668941 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:14.668927    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 16:08:14.669085 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:14.668934    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 16:08:14.669085 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:14.668965    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 16:08:14.669085 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:14.668981    2559 projected.go:196] Error preparing data for projected volume kube-api-access-48h99 for pod openshift-network-diagnostics/network-check-target-4crpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 16:08:14.669085 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:14.668990    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret podName:3287a3ce-5acd-45cc-99ca-a0b6bdf6d868 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:22.668971163 +0000 UTC m=+18.203670418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret") pod "global-pull-secret-syncer-z5w5l" (UID: "3287a3ce-5acd-45cc-99ca-a0b6bdf6d868") : object "kube-system"/"original-pull-secret" not registered
Jul 26 16:08:14.669085 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:14.669037    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99 podName:7f896b51-c96d-43be-a208-6ef29f15a96e nodeName:}" failed. No retries permitted until 2026-07-26 16:08:22.669020045 +0000 UTC m=+18.203719304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-48h99" (UniqueName: "kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99") pod "network-check-target-4crpp" (UID: "7f896b51-c96d-43be-a208-6ef29f15a96e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 16:08:14.952975 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:14.952351    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:14.952975 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:14.952467    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:14.952975 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:14.952833    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:14.952975 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:14.952924    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:14.953346 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:14.953113    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:14.953346 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:14.953239    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:16.948897 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:16.948852    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:16.949408 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:16.948906    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:16.949408 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:16.948863    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:16.949408 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:16.949043    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:16.949408 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:16.949164    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:16.949408 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:16.949248    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:18.949248 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:18.949201    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:18.949707 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:18.949201    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:18.949707 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:18.949333    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:18.949707 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:18.949427    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:18.949707 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:18.949211    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:18.949707 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:18.949527    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:20.948860 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:20.948820    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:20.948860 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:20.948824    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:20.948860 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:20.948825    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:20.949384 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:20.948951    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:20.949384 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:20.949024    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:20.949384 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:20.949173    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:22.630337 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:22.630297    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs\") pod \"network-metrics-daemon-x7grb\" (UID: \"47facb48-c30f-47eb-b670-a4ff92388d64\") " pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:22.630814 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:22.630417    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 16:08:22.630814 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:22.630500    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs podName:47facb48-c30f-47eb-b670-a4ff92388d64 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:38.630475534 +0000 UTC m=+34.165174794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs") pod "network-metrics-daemon-x7grb" (UID: "47facb48-c30f-47eb-b670-a4ff92388d64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 16:08:22.731146 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:22.731091    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48h99\" (UniqueName: \"kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99\") pod \"network-check-target-4crpp\" (UID: \"7f896b51-c96d-43be-a208-6ef29f15a96e\") " pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:22.731319 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:22.731166    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:22.731319 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:22.731259    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 16:08:22.731319 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:22.731286    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 16:08:22.731319 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:22.731284    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 16:08:22.731319 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:22.731300    2559 projected.go:196] Error preparing data for projected volume kube-api-access-48h99 for pod openshift-network-diagnostics/network-check-target-4crpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 16:08:22.731542 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:22.731356    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret podName:3287a3ce-5acd-45cc-99ca-a0b6bdf6d868 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:38.731334908 +0000 UTC m=+34.266034177 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret") pod "global-pull-secret-syncer-z5w5l" (UID: "3287a3ce-5acd-45cc-99ca-a0b6bdf6d868") : object "kube-system"/"original-pull-secret" not registered
Jul 26 16:08:22.731542 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:22.731376    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99 podName:7f896b51-c96d-43be-a208-6ef29f15a96e nodeName:}" failed. No retries permitted until 2026-07-26 16:08:38.731367211 +0000 UTC m=+34.266066469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-48h99" (UniqueName: "kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99") pod "network-check-target-4crpp" (UID: "7f896b51-c96d-43be-a208-6ef29f15a96e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 16:08:22.949215 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:22.949180    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:22.949395 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:22.949223    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:22.949395 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:22.949183    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:22.949395 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:22.949332    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:22.949525 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:22.949477    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:22.949580 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:22.949551    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:24.949633 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:24.949597    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:24.950110 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:24.949641    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:24.950110 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:24.949724    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:24.950110 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:24.949774    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:24.950110 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:24.949838    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:24.950110 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:24.949947    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:26.949408 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:26.949263    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:26.949785 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:26.949285    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:26.949785 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:26.949482    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:26.949785 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:26.949581    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:26.949785 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:26.949299    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:26.949785 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:26.949693    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:27.039630 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.039436    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal" event={"ID":"6b8c82cd2b2600eb21dd1494d0fff63e","Type":"ContainerStarted","Data":"89d0680599108584957cca98342c71d63fb27fb473bd6b2a79e4ad195b9f5064"}
Jul 26 16:08:27.042153 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.042065    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dc557" event={"ID":"ab623d75-d2e3-43e6-b8c4-98f377a49561","Type":"ContainerStarted","Data":"141f3e02535197d2861bf36c3c222fdb26877618345d180dfae428059a26b498"}
Jul 26 16:08:27.042260 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.042176    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dc557" event={"ID":"ab623d75-d2e3-43e6-b8c4-98f377a49561","Type":"ContainerStarted","Data":"973aadf18d1edd8c1a5b2c8a891ffed6273069ff6b8972d4dca9a11b6fea8752"}
Jul 26 16:08:27.044037 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.043992    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2s5df" event={"ID":"a05de7a3-da4b-4350-8d8b-a509ffc0b45d","Type":"ContainerStarted","Data":"cd54dcd6a2f84323e6f097032b79efffebe0b93a6719b433e08327530a6aa0c5"}
Jul 26 16:08:27.045525 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.045503    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z66qt" event={"ID":"7253b8f8-7797-434e-9789-b796950e4959","Type":"ContainerStarted","Data":"b13712096d1092be755a4f2b3e81f68f5d1b8406dc68d88831c5b6c42dbb6ba2"}
Jul 26 16:08:27.047004 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.046982    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gvssk" event={"ID":"86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5","Type":"ContainerStarted","Data":"613e4a4e376be930356e2e35196cde1915d89ecc71998eac7a8e307cd29a7996"}
Jul 26 16:08:27.048543 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.048519    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6" event={"ID":"0f67f8fb-930e-454a-a7c5-85159ec29c6a","Type":"ContainerStarted","Data":"ecd221c94c94aaff8701d09e0dfe00f285094d9ddca06b2718fc4778636310ba"}
Jul 26 16:08:27.052034 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.052012    2559 generic.go:356] "Generic (PLEG): container finished" podID="0a797309-faed-4e45-b1d9-480ed7a7cc19" containerID="5e70c9c59214829605e99d5eeab54a7f5ef630550c9fb9b2908f8b921c39b30d" exitCode=0
Jul 26 16:08:27.052119 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.052054    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qhfk" event={"ID":"0a797309-faed-4e45-b1d9-480ed7a7cc19","Type":"ContainerDied","Data":"5e70c9c59214829605e99d5eeab54a7f5ef630550c9fb9b2908f8b921c39b30d"}
Jul 26 16:08:27.053724 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.053692    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-km55d" event={"ID":"6396beb5-6e97-4b36-99cb-15e183d196b8","Type":"ContainerStarted","Data":"0769c0020bc636bea201fe224c1d220798ee8032e79b4c180fe5c13777e2a4da"}
Jul 26 16:08:27.055310 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.055199    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-99.ec2.internal" podStartSLOduration=21.055185632 podStartE2EDuration="21.055185632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:08:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:27.055098966 +0000 UTC m=+22.589798243" watchObservedRunningTime="2026-07-26 16:08:27.055185632 +0000 UTC m=+22.589884907"
Jul 26 16:08:27.055413 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.055386    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5h9qg" event={"ID":"b377323e-dc82-4563-9cd5-e3cae8ee8002","Type":"ContainerStarted","Data":"0fbb66b03b4bf6a558f0aa16093eac5dbeef7bddfb92dd43b02d98c8f13b3091"}
Jul 26 16:08:27.083601 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.083562    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z66qt" podStartSLOduration=6.221846488 podStartE2EDuration="21.083547349s" totalImagesPullingTime="14.861700861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:27.068254991 +0000 UTC m=+22.602954266" watchObservedRunningTime="2026-07-26 16:08:27.083547349 +0000 UTC m=+22.618246655"
Jul 26 16:08:27.106233 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.106195    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-km55d" podStartSLOduration=1.912784273 podStartE2EDuration="21.106180514s" totalImagesPullingTime="19.193396241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:27.083120658 +0000 UTC m=+22.617819934" watchObservedRunningTime="2026-07-26 16:08:27.106180514 +0000 UTC m=+22.640879792"
Jul 26 16:08:27.129269 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.129231    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gvssk" podStartSLOduration=1.89254168 podStartE2EDuration="21.12921344s" totalImagesPullingTime="19.23667176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:27.128376354 +0000 UTC m=+22.663075629" watchObservedRunningTime="2026-07-26 16:08:27.12921344 +0000 UTC m=+22.663912717"
Jul 26 16:08:27.159960 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.159920    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5h9qg" podStartSLOduration=2.4738592 podStartE2EDuration="22.159905343s" totalImagesPullingTime="19.686046143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:27.15983798 +0000 UTC m=+22.694537255" watchObservedRunningTime="2026-07-26 16:08:27.159905343 +0000 UTC m=+22.694604618"
Jul 26 16:08:27.160088 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:27.160069    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2s5df" podStartSLOduration=1.95677797 podStartE2EDuration="21.160063995s" totalImagesPullingTime="19.203286025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:27.142864534 +0000 UTC m=+22.677563810" watchObservedRunningTime="2026-07-26 16:08:27.160063995 +0000 UTC m=+22.694763269"
Jul 26 16:08:28.061016 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:28.060976    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dc557" event={"ID":"ab623d75-d2e3-43e6-b8c4-98f377a49561","Type":"ContainerStarted","Data":"802630d5505f9441076e1ea00ccdcb90f97b69c3430612b06226491723473c35"}
Jul 26 16:08:28.061569 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:28.061110    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dc557" event={"ID":"ab623d75-d2e3-43e6-b8c4-98f377a49561","Type":"ContainerStarted","Data":"22aef792403282fb7482bf4a992f5af1cbc7b7359bd214c08fc2c8030c689c9a"}
Jul 26 16:08:28.061569 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:28.061174    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dc557" event={"ID":"ab623d75-d2e3-43e6-b8c4-98f377a49561","Type":"ContainerStarted","Data":"3eb36696f5fc2bd2b157e4d5403bb5bd9fab51f7938ad0467c01e72c18470964"}
Jul 26 16:08:28.061569 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:28.061223    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dc557" event={"ID":"ab623d75-d2e3-43e6-b8c4-98f377a49561","Type":"ContainerStarted","Data":"ff31cd8c57ea23ef0b210e883a8c965af35aaa9898c0db9b58c2f477184032b1"}
Jul 26 16:08:28.062661 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:28.062597    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7ztp" event={"ID":"d3d27607-9b42-43de-9123-060459575df7","Type":"ContainerStarted","Data":"b24ed6ea189e2225303cee11ac400362b0ada4f5874685c3dd0a15bfb642de59"}
Jul 26 16:08:28.077319 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:28.077273    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x7ztp" podStartSLOduration=2.861802537 podStartE2EDuration="22.07725522s" totalImagesPullingTime="19.215452683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:28.07667743 +0000 UTC m=+23.611376704" watchObservedRunningTime="2026-07-26 16:08:28.07725522 +0000 UTC m=+23.611954499"
Jul 26 16:08:28.107076 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:28.106981    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 26 16:08:28.951330 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:28.951222    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-26T16:08:28.10699849Z","UUID":"1cb39797-c425-41d7-a733-91f70dfd6aa6","Handler":null,"Name":"","Endpoint":""}
Jul 26 16:08:28.952966 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:28.952934    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 26 16:08:28.953097 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:28.952978    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 26 16:08:28.953975 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:28.953951    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:28.954117 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:28.953951    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:28.954117 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:28.954076    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:28.954250 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:28.954181    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:28.954250 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:28.953951    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:28.954355 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:28.954318    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:29.068084 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:29.068046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6" event={"ID":"0f67f8fb-930e-454a-a7c5-85159ec29c6a","Type":"ContainerStarted","Data":"905294c2e74efc736e4aa9d78ab9a9038a7828d1e4c58a47c07924ebb137d32f"}
Jul 26 16:08:30.074418 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:30.074160    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dc557" event={"ID":"ab623d75-d2e3-43e6-b8c4-98f377a49561","Type":"ContainerStarted","Data":"c3442a53b1ee0821289b8b7b13fdb232e4d266efbcf86bd0fdb9a5bf2a9df3ed"}
Jul 26 16:08:30.076383 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:30.076351    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6" event={"ID":"0f67f8fb-930e-454a-a7c5-85159ec29c6a","Type":"ContainerStarted","Data":"fa6f2e158860c2bed76ed189c90d10dda7fae8c7654a188cd1e234dc249f32a7"}
Jul 26 16:08:30.093559 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:30.093510    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69cw6" podStartSLOduration=1.9682557040000002 podStartE2EDuration="24.093497422s" totalImagesPullingTime="22.125241718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:08:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:30.093160716 +0000 UTC m=+25.627859991" watchObservedRunningTime="2026-07-26 16:08:30.093497422 +0000 UTC m=+25.628196700"
Jul 26 16:08:30.526186 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:30.526154    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2s5df"
Jul 26 16:08:30.949039 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:30.949005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:30.949208 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:30.949053    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:30.949208 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:30.949005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:30.949208 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:30.949147    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:30.949379 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:30.949238    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:30.949379 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:30.949327    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:31.567674 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:31.567640    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2s5df"
Jul 26 16:08:31.568258 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:31.568223    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2s5df"
Jul 26 16:08:32.083629 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:32.083364    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dc557" event={"ID":"ab623d75-d2e3-43e6-b8c4-98f377a49561","Type":"ContainerStarted","Data":"3b06543f8b589ac6ebf8bb34a8eda36b3edd2e5ca26298ef56d32803e5eb0e92"}
Jul 26 16:08:32.083629 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:32.083622    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:32.085235 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:32.085206    2559 generic.go:356] "Generic (PLEG): container finished" podID="0a797309-faed-4e45-b1d9-480ed7a7cc19" containerID="7ba9fbf68e26d8f96011df7eefbd1a38537e81bf809f7fb26cee089d2f6d7e31" exitCode=0
Jul 26 16:08:32.085329 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:32.085268    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qhfk" event={"ID":"0a797309-faed-4e45-b1d9-480ed7a7cc19","Type":"ContainerDied","Data":"7ba9fbf68e26d8f96011df7eefbd1a38537e81bf809f7fb26cee089d2f6d7e31"}
Jul 26 16:08:32.086017 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:32.085995    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2s5df"
Jul 26 16:08:32.099555 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:32.099536    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:32.111194 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:32.111076    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dc557" podStartSLOduration=6.585898959 podStartE2EDuration="26.111058335s" totalImagesPullingTime="19.525159376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:32.109622012 +0000 UTC m=+27.644321288" watchObservedRunningTime="2026-07-26 16:08:32.111058335 +0000 UTC m=+27.645757611"
Jul 26 16:08:32.957751 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:32.957721    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:32.958482 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:32.957763    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:32.958482 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:32.957851    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:32.958482 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:32.958307    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:32.958482 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:32.958375    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:32.958482 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:32.958455    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:33.087751 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:33.087729    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 26 16:08:33.088096 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:33.088080    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:33.101746 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:33.101722    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:33.452835 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:33.452815    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:08:33.732409 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:33.732379    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4crpp"]
Jul 26 16:08:33.732547 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:33.732484    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:33.732608 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:33.732583    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:33.737335 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:33.737305    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z5w5l"]
Jul 26 16:08:33.737460 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:33.737416    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x7grb"]
Jul 26 16:08:33.738140 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:33.737524    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:33.738140 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:33.737666    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:33.738140 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:33.737745    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:33.738140 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:33.737844    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:34.091535 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:34.091460    2559 generic.go:356] "Generic (PLEG): container finished" podID="0a797309-faed-4e45-b1d9-480ed7a7cc19" containerID="4bdb72a148e5e2ca5711a781b463d8d0295bcae9721fa81d378f1cf6590ff216" exitCode=0
Jul 26 16:08:34.091874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:34.091552    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qhfk" event={"ID":"0a797309-faed-4e45-b1d9-480ed7a7cc19","Type":"ContainerDied","Data":"4bdb72a148e5e2ca5711a781b463d8d0295bcae9721fa81d378f1cf6590ff216"}
Jul 26 16:08:34.951751 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:34.951726    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:34.951922 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:34.951822    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:34.951922 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:34.951910    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:34.952068 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:34.952038    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:34.952068 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:34.952065    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:34.952177 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:34.952142    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:36.099663 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:36.099424    2559 generic.go:356] "Generic (PLEG): container finished" podID="0a797309-faed-4e45-b1d9-480ed7a7cc19" containerID="2fcc487cea3b5c5c14793584d04144a4493514e80865c608a98e442fdf8fbd49" exitCode=0
Jul 26 16:08:36.099663 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:36.099493    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qhfk" event={"ID":"0a797309-faed-4e45-b1d9-480ed7a7cc19","Type":"ContainerDied","Data":"2fcc487cea3b5c5c14793584d04144a4493514e80865c608a98e442fdf8fbd49"}
Jul 26 16:08:36.948649 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:36.948617    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:36.948872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:36.948734    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:36.948872 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:36.948748    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:36.948872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:36.948775    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:36.948872 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:36.948867    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:36.949091 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:36.948943    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:38.655303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:38.655270    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs\") pod \"network-metrics-daemon-x7grb\" (UID: \"47facb48-c30f-47eb-b670-a4ff92388d64\") " pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:38.655934 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:38.655436    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 16:08:38.655934 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:38.655514    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs podName:47facb48-c30f-47eb-b670-a4ff92388d64 nodeName:}" failed. No retries permitted until 2026-07-26 16:09:10.655492311 +0000 UTC m=+66.190191581 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs") pod "network-metrics-daemon-x7grb" (UID: "47facb48-c30f-47eb-b670-a4ff92388d64") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 16:08:38.756419 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:38.756347    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48h99\" (UniqueName: \"kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99\") pod \"network-check-target-4crpp\" (UID: \"7f896b51-c96d-43be-a208-6ef29f15a96e\") " pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:38.756419 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:38.756392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:38.756675 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:38.756517    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 16:08:38.756675 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:38.756532    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 16:08:38.756675 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:38.756538    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 16:08:38.756675 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:38.756549    2559 projected.go:196] Error preparing data for projected volume kube-api-access-48h99 for pod openshift-network-diagnostics/network-check-target-4crpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 16:08:38.756675 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:38.756591    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret podName:3287a3ce-5acd-45cc-99ca-a0b6bdf6d868 nodeName:}" failed. No retries permitted until 2026-07-26 16:09:10.756573615 +0000 UTC m=+66.291272896 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret") pod "global-pull-secret-syncer-z5w5l" (UID: "3287a3ce-5acd-45cc-99ca-a0b6bdf6d868") : object "kube-system"/"original-pull-secret" not registered
Jul 26 16:08:38.756675 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:38.756607    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99 podName:7f896b51-c96d-43be-a208-6ef29f15a96e nodeName:}" failed. No retries permitted until 2026-07-26 16:09:10.756600415 +0000 UTC m=+66.291299668 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-48h99" (UniqueName: "kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99") pod "network-check-target-4crpp" (UID: "7f896b51-c96d-43be-a208-6ef29f15a96e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 16:08:38.948508 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:38.948475    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:38.948508 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:38.948505    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:38.948740 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:38.948476    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:38.948740 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:38.948617    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7grb" podUID="47facb48-c30f-47eb-b670-a4ff92388d64"
Jul 26 16:08:38.948740 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:38.948685    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4crpp" podUID="7f896b51-c96d-43be-a208-6ef29f15a96e"
Jul 26 16:08:38.948898 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:38.948761    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5w5l" podUID="3287a3ce-5acd-45cc-99ca-a0b6bdf6d868"
Jul 26 16:08:40.807154 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.807111    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-99.ec2.internal" event="NodeReady"
Jul 26 16:08:40.807688 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.807232    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 26 16:08:40.838867 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.838840    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55fb749d87-blpw5"]
Jul 26 16:08:40.841611 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.841595    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:40.843488 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.843218    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-qvvws"]
Jul 26 16:08:40.844280 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.844014    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 26 16:08:40.844477 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.844462    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-krzsv\""
Jul 26 16:08:40.844564 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.844553    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 26 16:08:40.844687 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.844672    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 26 16:08:40.846955 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.846939    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"]
Jul 26 16:08:40.847087 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.847064    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:40.850184 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.850164    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64c4699495-5f5tt"]
Jul 26 16:08:40.850637 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.850616    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:08:40.851646 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.850927    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4l6lb\""
Jul 26 16:08:40.851646 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.851593    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 26 16:08:40.851801 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.851656    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 26 16:08:40.851867 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.851858    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 26 16:08:40.851932 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.851913    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 26 16:08:40.853865 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.853841    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 26 16:08:40.854242 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.854222    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-44t9x"]
Jul 26 16:08:40.854242 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.854233    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zkn5z\""
Jul 26 16:08:40.854398 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.854377    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 26 16:08:40.854398 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.854389    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 26 16:08:40.854503 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.854475    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 26 16:08:40.854660 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.854549    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 26 16:08:40.854720 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.854666    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:40.857603 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.857587    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 26 16:08:40.857702 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.857684    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"]
Jul 26 16:08:40.857767 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.857753    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 26 16:08:40.857821 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.857792    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:40.857821 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.857802    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 26 16:08:40.857821 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.857757    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b44x9\""
Jul 26 16:08:40.858021 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.857870    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 26 16:08:40.858021 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.857804    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 26 16:08:40.858156 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.858141    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 26 16:08:40.858281 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.858265    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 26 16:08:40.860277 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.860261    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 26 16:08:40.860376 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.860315    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 26 16:08:40.860532 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.860509    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 26 16:08:40.860634 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.860619    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wmc4h\""
Jul 26 16:08:40.860698 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.860646    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 26 16:08:40.861396 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.861378    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25"]
Jul 26 16:08:40.861507 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.861494    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"
Jul 26 16:08:40.863705 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.863689    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 26 16:08:40.863786 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.863692    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 26 16:08:40.863786 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.863713    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 26 16:08:40.864314 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.864279    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-87kmn\""
Jul 26 16:08:40.868109 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.864417    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c"]
Jul 26 16:08:40.868109 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.864583    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25"
Jul 26 16:08:40.868109 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.867698    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 26 16:08:40.868410 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.868209    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 26 16:08:40.868410 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.868240    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 26 16:08:40.868410 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.868244    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-h295k\""
Jul 26 16:08:40.868624 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.868431    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 26 16:08:40.869343 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.869312    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 26 16:08:40.870253 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.870237    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-q5cfd"]
Jul 26 16:08:40.872910 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.872891    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c"
Jul 26 16:08:40.878039 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.875106    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xc8ts"]
Jul 26 16:08:40.878039 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.875824    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 26 16:08:40.878039 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.876304    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 26 16:08:40.878039 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.876392    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dpjfq\""
Jul 26 16:08:40.878039 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.876680    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5cfd"
Jul 26 16:08:40.878039 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.876871    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 26 16:08:40.878414 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.878255    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 26 16:08:40.879006 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.878987    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55fb749d87-blpw5"]
Jul 26 16:08:40.879115 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.879039    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25"]
Jul 26 16:08:40.879115 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.879074    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6t79p"]
Jul 26 16:08:40.879311 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.879245    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 26 16:08:40.879368 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.879349    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 26 16:08:40.879557 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.879523    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9l49b\""
Jul 26 16:08:40.879645 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.879595    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xc8ts"
Jul 26 16:08:40.882188 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.882168    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dvf74\""
Jul 26 16:08:40.882188 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.882222    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 26 16:08:40.882188 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.882603    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 26 16:08:40.882188 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.883074    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xc8ts"]
Jul 26 16:08:40.886765 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.883260    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-qvvws"]
Jul 26 16:08:40.886765 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.883288    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-44t9x"]
Jul 26 16:08:40.886765 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.883399    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-q5cfd"]
Jul 26 16:08:40.886765 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.883446    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"]
Jul 26 16:08:40.886765 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.883555    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wdzsq"]
Jul 26 16:08:40.886765 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.885100    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6t79p"
Jul 26 16:08:40.887401 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.887381    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 26 16:08:40.888496 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.888456    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 26 16:08:40.888613 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.888583    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6t79p"]
Jul 26 16:08:40.888613 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.888612    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c"]
Jul 26 16:08:40.888740 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.888639    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64c4699495-5f5tt"]
Jul 26 16:08:40.888740 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.888658    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"]
Jul 26 16:08:40.888740 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.888738    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:40.889422 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.889405    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 26 16:08:40.890241 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.890220    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vf2c6\""
Jul 26 16:08:40.890806 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.890787    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wdzsq"]
Jul 26 16:08:40.891378 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.891359    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 26 16:08:40.891470 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.891421    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 26 16:08:40.891804 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.891701    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-grxdp\""
Jul 26 16:08:40.951617 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.951598    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:08:40.951769 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.951755    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:08:40.951902 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.951886    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:08:40.953883 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.953870    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6nt9n\""
Jul 26 16:08:40.953883 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.953878    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 26 16:08:40.954003 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.953878    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h6wls\""
Jul 26 16:08:40.954161 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.954148    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 26 16:08:40.974830 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.974812    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/864a4462-7451-4c85-8863-6a4ec9140c77-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25\" (UID: \"864a4462-7451-4c85-8863-6a4ec9140c77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25"
Jul 26 16:08:40.974923 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.974840    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89pwk\" (UniqueName: \"kubernetes.io/projected/864a4462-7451-4c85-8863-6a4ec9140c77-kube-api-access-89pwk\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25\" (UID: \"864a4462-7451-4c85-8863-6a4ec9140c77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25"
Jul 26 16:08:40.974923 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.974858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d65vb\" (UniqueName: \"kubernetes.io/projected/976d4655-f3a5-48e1-bc28-64652772d878-kube-api-access-d65vb\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:40.974923 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.974885    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-bound-sa-token\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:40.974923 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.974921    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dde76c96-8569-4bc2-99fd-ce2db3047018-ca-trust-extracted\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:40.975077 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.974942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c5fb98-fd57-4375-bfd8-9b3007965d80-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:40.975077 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.974958    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlnsf\" (UniqueName: \"kubernetes.io/projected/a08982fd-5a26-492b-8ff0-164b509a1f93-kube-api-access-hlnsf\") pod \"volume-data-source-validator-549c6d54cf-xc8ts\" (UID: \"a08982fd-5a26-492b-8ff0-164b509a1f93\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xc8ts"
Jul 26 16:08:40.975077 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.974984    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6c5fb98-fd57-4375-bfd8-9b3007965d80-tmp\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:40.975077 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975009    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-stats-auth\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:40.975077 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64xjk\" (UniqueName: \"kubernetes.io/projected/083e4170-cde7-406a-887b-54540eb55bf5-kube-api-access-64xjk\") pod \"console-operator-584dcb6b54-44t9x\" (UID: \"083e4170-cde7-406a-887b-54540eb55bf5\") " pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:40.975077 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dpq9w\" (UID: \"ac351cd2-b972-4607-abc4-dec4a9452647\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"
Jul 26 16:08:40.975294 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975075    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7b6t\" (UniqueName: \"kubernetes.io/projected/ac351cd2-b972-4607-abc4-dec4a9452647-kube-api-access-s7b6t\") pod \"cluster-samples-operator-6748489656-dpq9w\" (UID: \"ac351cd2-b972-4607-abc4-dec4a9452647\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"
Jul 26 16:08:40.975294 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975143    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0d800c32-37d3-421d-80a3-d0223dc36ca2-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:08:40.975294 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/970557d5-5925-4ba0-bb27-5cf4c9ff0ec1-config\") pod \"service-ca-operator-5d6c75f84f-9sx8c\" (UID: \"970557d5-5925-4ba0-bb27-5cf4c9ff0ec1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c"
Jul 26 16:08:40.975294 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975182    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-default-certificate\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:40.975294 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975197    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/970557d5-5925-4ba0-bb27-5cf4c9ff0ec1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-9sx8c\" (UID: \"970557d5-5925-4ba0-bb27-5cf4c9ff0ec1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c"
Jul 26 16:08:40.975294 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975230    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dde76c96-8569-4bc2-99fd-ce2db3047018-image-registry-private-configuration\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:40.975294 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975245    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:40.975294 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975263    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stl5b\" (UniqueName: \"kubernetes.io/projected/a6c5fb98-fd57-4375-bfd8-9b3007965d80-kube-api-access-stl5b\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:40.975294 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975297    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/083e4170-cde7-406a-887b-54540eb55bf5-config\") pod \"console-operator-584dcb6b54-44t9x\" (UID: \"083e4170-cde7-406a-887b-54540eb55bf5\") " pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:40.975618 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975322    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/083e4170-cde7-406a-887b-54540eb55bf5-serving-cert\") pod \"console-operator-584dcb6b54-44t9x\" (UID: \"083e4170-cde7-406a-887b-54540eb55bf5\") " pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:40.975618 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b9w6\" (UniqueName: \"kubernetes.io/projected/def30551-aabe-47a5-988f-99493561000e-kube-api-access-8b9w6\") pod \"network-check-source-7d88cb55d8-q5cfd\" (UID: \"def30551-aabe-47a5-988f-99493561000e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5cfd"
Jul 26 16:08:40.975618 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf9dv\" (UniqueName: \"kubernetes.io/projected/0d800c32-37d3-421d-80a3-d0223dc36ca2-kube-api-access-nf9dv\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:08:40.975618 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a6c5fb98-fd57-4375-bfd8-9b3007965d80-snapshots\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:40.975618 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975455    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:40.975618 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975481    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dde76c96-8569-4bc2-99fd-ce2db3047018-trusted-ca\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:40.975618 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975513    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-certificates\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:40.975618 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975548    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/864a4462-7451-4c85-8863-6a4ec9140c77-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25\" (UID: \"864a4462-7451-4c85-8863-6a4ec9140c77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25"
Jul 26 16:08:40.975618 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975568    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/083e4170-cde7-406a-887b-54540eb55bf5-trusted-ca\") pod \"console-operator-584dcb6b54-44t9x\" (UID: \"083e4170-cde7-406a-887b-54540eb55bf5\") " pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:40.975618 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c5fb98-fd57-4375-bfd8-9b3007965d80-service-ca-bundle\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:40.975618 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975598    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:08:40.975618 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975614    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c5fb98-fd57-4375-bfd8-9b3007965d80-serving-cert\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:40.975976 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975637    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:40.975976 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975656    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m56kr\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-kube-api-access-m56kr\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:40.975976 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975672    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jswtn\" (UniqueName: \"kubernetes.io/projected/970557d5-5925-4ba0-bb27-5cf4c9ff0ec1-kube-api-access-jswtn\") pod \"service-ca-operator-5d6c75f84f-9sx8c\" (UID: \"970557d5-5925-4ba0-bb27-5cf4c9ff0ec1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c"
Jul 26 16:08:40.975976 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:40.975688    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dde76c96-8569-4bc2-99fd-ce2db3047018-installation-pull-secrets\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.021446 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.021411    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:41.076082 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.075995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dde76c96-8569-4bc2-99fd-ce2db3047018-ca-trust-extracted\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.076082 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076039    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spd29\" (UniqueName: \"kubernetes.io/projected/599cd3cc-a2cc-4359-9dfd-2215960c847b-kube-api-access-spd29\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:41.076082 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076066    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c5fb98-fd57-4375-bfd8-9b3007965d80-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:41.076353 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076090    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlnsf\" (UniqueName: \"kubernetes.io/projected/a08982fd-5a26-492b-8ff0-164b509a1f93-kube-api-access-hlnsf\") pod \"volume-data-source-validator-549c6d54cf-xc8ts\" (UID: \"a08982fd-5a26-492b-8ff0-164b509a1f93\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xc8ts"
Jul 26 16:08:41.076353 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6c5fb98-fd57-4375-bfd8-9b3007965d80-tmp\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:41.076353 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076281    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-stats-auth\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:41.076353 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076328    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64xjk\" (UniqueName: \"kubernetes.io/projected/083e4170-cde7-406a-887b-54540eb55bf5-kube-api-access-64xjk\") pod \"console-operator-584dcb6b54-44t9x\" (UID: \"083e4170-cde7-406a-887b-54540eb55bf5\") " pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:41.076548 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dpq9w\" (UID: \"ac351cd2-b972-4607-abc4-dec4a9452647\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"
Jul 26 16:08:41.076548 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7b6t\" (UniqueName: \"kubernetes.io/projected/ac351cd2-b972-4607-abc4-dec4a9452647-kube-api-access-s7b6t\") pod \"cluster-samples-operator-6748489656-dpq9w\" (UID: \"ac351cd2-b972-4607-abc4-dec4a9452647\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"
Jul 26 16:08:41.076548 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076405    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dde76c96-8569-4bc2-99fd-ce2db3047018-ca-trust-extracted\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.076548 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0d800c32-37d3-421d-80a3-d0223dc36ca2-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:08:41.076548 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076456    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/970557d5-5925-4ba0-bb27-5cf4c9ff0ec1-config\") pod \"service-ca-operator-5d6c75f84f-9sx8c\" (UID: \"970557d5-5925-4ba0-bb27-5cf4c9ff0ec1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c"
Jul 26 16:08:41.076548 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-default-certificate\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:41.076548 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.076505    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 26 16:08:41.076548 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076515    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/970557d5-5925-4ba0-bb27-5cf4c9ff0ec1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-9sx8c\" (UID: \"970557d5-5925-4ba0-bb27-5cf4c9ff0ec1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c"
Jul 26 16:08:41.076548 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dde76c96-8569-4bc2-99fd-ce2db3047018-image-registry-private-configuration\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.076980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.076980 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.076593    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls podName:ac351cd2-b972-4607-abc4-dec4a9452647 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:41.576573724 +0000 UTC m=+37.111272979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls") pod "cluster-samples-operator-6748489656-dpq9w" (UID: "ac351cd2-b972-4607-abc4-dec4a9452647") : secret "samples-operator-tls" not found
Jul 26 16:08:41.076980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076506    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6c5fb98-fd57-4375-bfd8-9b3007965d80-tmp\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:41.076980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stl5b\" (UniqueName: \"kubernetes.io/projected/a6c5fb98-fd57-4375-bfd8-9b3007965d80-kube-api-access-stl5b\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:41.076980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076684    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:41.076980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076732    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/083e4170-cde7-406a-887b-54540eb55bf5-config\") pod \"console-operator-584dcb6b54-44t9x\" (UID: \"083e4170-cde7-406a-887b-54540eb55bf5\") " pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:41.076980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076799    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/083e4170-cde7-406a-887b-54540eb55bf5-serving-cert\") pod \"console-operator-584dcb6b54-44t9x\" (UID: \"083e4170-cde7-406a-887b-54540eb55bf5\") " pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:41.076980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076815    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/599cd3cc-a2cc-4359-9dfd-2215960c847b-config-volume\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:41.076980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076840    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b9w6\" (UniqueName: \"kubernetes.io/projected/def30551-aabe-47a5-988f-99493561000e-kube-api-access-8b9w6\") pod \"network-check-source-7d88cb55d8-q5cfd\" (UID: \"def30551-aabe-47a5-988f-99493561000e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5cfd"
Jul 26 16:08:41.076980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076864    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e52083e7-dd87-4733-870d-1b83e1f134ae-cert\") pod \"ingress-canary-6t79p\" (UID: \"e52083e7-dd87-4733-870d-1b83e1f134ae\") " pod="openshift-ingress-canary/ingress-canary-6t79p"
Jul 26 16:08:41.076980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf9dv\" (UniqueName: \"kubernetes.io/projected/0d800c32-37d3-421d-80a3-d0223dc36ca2-kube-api-access-nf9dv\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:08:41.076980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a6c5fb98-fd57-4375-bfd8-9b3007965d80-snapshots\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:41.076980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076946    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:41.076980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.076969    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dde76c96-8569-4bc2-99fd-ce2db3047018-trusted-ca\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.077669 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.077006    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-certificates\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.077669 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.077006    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c5fb98-fd57-4375-bfd8-9b3007965d80-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:41.077669 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.077032    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcrxg\" (UniqueName: \"kubernetes.io/projected/e52083e7-dd87-4733-870d-1b83e1f134ae-kube-api-access-wcrxg\") pod \"ingress-canary-6t79p\" (UID: \"e52083e7-dd87-4733-870d-1b83e1f134ae\") " pod="openshift-ingress-canary/ingress-canary-6t79p"
Jul 26 16:08:41.077669 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.077045    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/970557d5-5925-4ba0-bb27-5cf4c9ff0ec1-config\") pod \"service-ca-operator-5d6c75f84f-9sx8c\" (UID: \"970557d5-5925-4ba0-bb27-5cf4c9ff0ec1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c"
Jul 26 16:08:41.077669 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.077097    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/864a4462-7451-4c85-8863-6a4ec9140c77-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25\" (UID: \"864a4462-7451-4c85-8863-6a4ec9140c77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25"
Jul 26 16:08:41.077669 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.077157    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/083e4170-cde7-406a-887b-54540eb55bf5-trusted-ca\") pod \"console-operator-584dcb6b54-44t9x\" (UID: \"083e4170-cde7-406a-887b-54540eb55bf5\") " pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:41.077669 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.077203    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0d800c32-37d3-421d-80a3-d0223dc36ca2-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:08:41.077669 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.076654    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 16:08:41.077669 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.077570    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55fb749d87-blpw5: secret "image-registry-tls" not found
Jul 26 16:08:41.077669 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.077570    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-certificates\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.077669 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.077647    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls podName:dde76c96-8569-4bc2-99fd-ce2db3047018 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:41.577631279 +0000 UTC m=+37.112330535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls") pod "image-registry-55fb749d87-blpw5" (UID: "dde76c96-8569-4bc2-99fd-ce2db3047018") : secret "image-registry-tls" not found
Jul 26 16:08:41.078233 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.077694    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a6c5fb98-fd57-4375-bfd8-9b3007965d80-snapshots\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:41.078233 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.077738    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c5fb98-fd57-4375-bfd8-9b3007965d80-service-ca-bundle\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:41.078233 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.077768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:08:41.078233 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.077831    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c5fb98-fd57-4375-bfd8-9b3007965d80-serving-cert\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:41.078233 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.077858    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:41.078233 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.077883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m56kr\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-kube-api-access-m56kr\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.078233 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.077953    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 26 16:08:41.078233 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.078009    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls podName:0d800c32-37d3-421d-80a3-d0223dc36ca2 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:41.577993852 +0000 UTC m=+37.112693112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-5vwjk" (UID: "0d800c32-37d3-421d-80a3-d0223dc36ca2") : secret "cluster-monitoring-operator-tls" not found
Jul 26 16:08:41.078233 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.078014    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/083e4170-cde7-406a-887b-54540eb55bf5-config\") pod \"console-operator-584dcb6b54-44t9x\" (UID: \"083e4170-cde7-406a-887b-54540eb55bf5\") " pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:41.078727 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.078499    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c5fb98-fd57-4375-bfd8-9b3007965d80-service-ca-bundle\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:41.078780 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.078770    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle podName:976d4655-f3a5-48e1-bc28-64652772d878 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:41.578752214 +0000 UTC m=+37.113451488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle") pod "router-default-64c4699495-5f5tt" (UID: "976d4655-f3a5-48e1-bc28-64652772d878") : configmap references non-existent config key: service-ca.crt
Jul 26 16:08:41.078840 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.078794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jswtn\" (UniqueName: \"kubernetes.io/projected/970557d5-5925-4ba0-bb27-5cf4c9ff0ec1-kube-api-access-jswtn\") pod \"service-ca-operator-5d6c75f84f-9sx8c\" (UID: \"970557d5-5925-4ba0-bb27-5cf4c9ff0ec1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c"
Jul 26 16:08:41.078896 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.078841    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dde76c96-8569-4bc2-99fd-ce2db3047018-installation-pull-secrets\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.078896 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.078844    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dde76c96-8569-4bc2-99fd-ce2db3047018-trusted-ca\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.078994 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.078899    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/864a4462-7451-4c85-8863-6a4ec9140c77-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25\" (UID: \"864a4462-7451-4c85-8863-6a4ec9140c77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25"
Jul 26 16:08:41.078994 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.078924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89pwk\" (UniqueName: \"kubernetes.io/projected/864a4462-7451-4c85-8863-6a4ec9140c77-kube-api-access-89pwk\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25\" (UID: \"864a4462-7451-4c85-8863-6a4ec9140c77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25"
Jul 26 16:08:41.078994 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.078948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d65vb\" (UniqueName: \"kubernetes.io/projected/976d4655-f3a5-48e1-bc28-64652772d878-kube-api-access-d65vb\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:41.078994 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.078970    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-bound-sa-token\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.079217 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.078996    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/599cd3cc-a2cc-4359-9dfd-2215960c847b-tmp-dir\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:41.079582 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.079557    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/864a4462-7451-4c85-8863-6a4ec9140c77-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25\" (UID: \"864a4462-7451-4c85-8863-6a4ec9140c77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25"
Jul 26 16:08:41.080036 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.079988    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/083e4170-cde7-406a-887b-54540eb55bf5-trusted-ca\") pod \"console-operator-584dcb6b54-44t9x\" (UID: \"083e4170-cde7-406a-887b-54540eb55bf5\") " pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:41.080288 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.077426    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 26 16:08:41.080288 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.080260    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs podName:976d4655-f3a5-48e1-bc28-64652772d878 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:41.580240081 +0000 UTC m=+37.114939357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs") pod "router-default-64c4699495-5f5tt" (UID: "976d4655-f3a5-48e1-bc28-64652772d878") : secret "router-metrics-certs-default" not found
Jul 26 16:08:41.081663 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.081632    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/083e4170-cde7-406a-887b-54540eb55bf5-serving-cert\") pod \"console-operator-584dcb6b54-44t9x\" (UID: \"083e4170-cde7-406a-887b-54540eb55bf5\") " pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:41.081663 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.081641    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dde76c96-8569-4bc2-99fd-ce2db3047018-image-registry-private-configuration\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.081826 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.081711    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dde76c96-8569-4bc2-99fd-ce2db3047018-installation-pull-secrets\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.081882 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.081836    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/970557d5-5925-4ba0-bb27-5cf4c9ff0ec1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-9sx8c\" (UID: \"970557d5-5925-4ba0-bb27-5cf4c9ff0ec1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c"
Jul 26 16:08:41.081882 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.081859    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/864a4462-7451-4c85-8863-6a4ec9140c77-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25\" (UID: \"864a4462-7451-4c85-8863-6a4ec9140c77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25"
Jul 26 16:08:41.082162 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.082114    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-default-certificate\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:41.082240 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.082166    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-stats-auth\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:41.082979 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.082959    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c5fb98-fd57-4375-bfd8-9b3007965d80-serving-cert\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:41.088744 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.088482    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stl5b\" (UniqueName: \"kubernetes.io/projected/a6c5fb98-fd57-4375-bfd8-9b3007965d80-kube-api-access-stl5b\") pod \"insights-operator-5885fdb759-qvvws\" (UID: \"a6c5fb98-fd57-4375-bfd8-9b3007965d80\") " pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:41.088744 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.088500    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlnsf\" (UniqueName: \"kubernetes.io/projected/a08982fd-5a26-492b-8ff0-164b509a1f93-kube-api-access-hlnsf\") pod \"volume-data-source-validator-549c6d54cf-xc8ts\" (UID: \"a08982fd-5a26-492b-8ff0-164b509a1f93\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xc8ts"
Jul 26 16:08:41.088744 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.088632    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64xjk\" (UniqueName: \"kubernetes.io/projected/083e4170-cde7-406a-887b-54540eb55bf5-kube-api-access-64xjk\") pod \"console-operator-584dcb6b54-44t9x\" (UID: \"083e4170-cde7-406a-887b-54540eb55bf5\") " pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:41.088744 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.088667    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf9dv\" (UniqueName: \"kubernetes.io/projected/0d800c32-37d3-421d-80a3-d0223dc36ca2-kube-api-access-nf9dv\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:08:41.089001 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.088844    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b9w6\" (UniqueName: \"kubernetes.io/projected/def30551-aabe-47a5-988f-99493561000e-kube-api-access-8b9w6\") pod \"network-check-source-7d88cb55d8-q5cfd\" (UID: \"def30551-aabe-47a5-988f-99493561000e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5cfd"
Jul 26 16:08:41.089362 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.089339    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7b6t\" (UniqueName: \"kubernetes.io/projected/ac351cd2-b972-4607-abc4-dec4a9452647-kube-api-access-s7b6t\") pod \"cluster-samples-operator-6748489656-dpq9w\" (UID: \"ac351cd2-b972-4607-abc4-dec4a9452647\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"
Jul 26 16:08:41.090289 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.090261    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-bound-sa-token\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.091061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.090912    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89pwk\" (UniqueName: \"kubernetes.io/projected/864a4462-7451-4c85-8863-6a4ec9140c77-kube-api-access-89pwk\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25\" (UID: \"864a4462-7451-4c85-8863-6a4ec9140c77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25"
Jul 26 16:08:41.091061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.091020    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m56kr\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-kube-api-access-m56kr\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.091247 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.091227    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jswtn\" (UniqueName: \"kubernetes.io/projected/970557d5-5925-4ba0-bb27-5cf4c9ff0ec1-kube-api-access-jswtn\") pod \"service-ca-operator-5d6c75f84f-9sx8c\" (UID: \"970557d5-5925-4ba0-bb27-5cf4c9ff0ec1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c"
Jul 26 16:08:41.091315 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.091294    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d65vb\" (UniqueName: \"kubernetes.io/projected/976d4655-f3a5-48e1-bc28-64652772d878-kube-api-access-d65vb\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:41.105353 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.105330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:41.114233 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.114212    2559 generic.go:356] "Generic (PLEG): container finished" podID="0a797309-faed-4e45-b1d9-480ed7a7cc19" containerID="46d0f10e220c75cde60e808413ddf9b43e34005cc65210b5f197145e556ff06a" exitCode=0
Jul 26 16:08:41.114337 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.114240    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qhfk" event={"ID":"0a797309-faed-4e45-b1d9-480ed7a7cc19","Type":"ContainerDied","Data":"46d0f10e220c75cde60e808413ddf9b43e34005cc65210b5f197145e556ff06a"}
Jul 26 16:08:41.167552 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.167528    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-qvvws"
Jul 26 16:08:41.180011 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.179781    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/599cd3cc-a2cc-4359-9dfd-2215960c847b-tmp-dir\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:41.180111 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.180040    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spd29\" (UniqueName: \"kubernetes.io/projected/599cd3cc-a2cc-4359-9dfd-2215960c847b-kube-api-access-spd29\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:41.180111 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.180040    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/599cd3cc-a2cc-4359-9dfd-2215960c847b-tmp-dir\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:41.180246 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.180227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:41.180324 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.180308    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/599cd3cc-a2cc-4359-9dfd-2215960c847b-config-volume\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:41.180378 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.180345    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e52083e7-dd87-4733-870d-1b83e1f134ae-cert\") pod \"ingress-canary-6t79p\" (UID: \"e52083e7-dd87-4733-870d-1b83e1f134ae\") " pod="openshift-ingress-canary/ingress-canary-6t79p"
Jul 26 16:08:41.180429 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.180387    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 16:08:41.180570 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.180429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcrxg\" (UniqueName: \"kubernetes.io/projected/e52083e7-dd87-4733-870d-1b83e1f134ae-kube-api-access-wcrxg\") pod \"ingress-canary-6t79p\" (UID: \"e52083e7-dd87-4733-870d-1b83e1f134ae\") " pod="openshift-ingress-canary/ingress-canary-6t79p"
Jul 26 16:08:41.180570 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.180451    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls podName:599cd3cc-a2cc-4359-9dfd-2215960c847b nodeName:}" failed. No retries permitted until 2026-07-26 16:08:41.680431777 +0000 UTC m=+37.215131032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls") pod "dns-default-wdzsq" (UID: "599cd3cc-a2cc-4359-9dfd-2215960c847b") : secret "dns-default-metrics-tls" not found
Jul 26 16:08:41.181192 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.181171    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/599cd3cc-a2cc-4359-9dfd-2215960c847b-config-volume\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:41.183084 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.183064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e52083e7-dd87-4733-870d-1b83e1f134ae-cert\") pod \"ingress-canary-6t79p\" (UID: \"e52083e7-dd87-4733-870d-1b83e1f134ae\") " pod="openshift-ingress-canary/ingress-canary-6t79p"
Jul 26 16:08:41.188816 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.188796    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcrxg\" (UniqueName: \"kubernetes.io/projected/e52083e7-dd87-4733-870d-1b83e1f134ae-kube-api-access-wcrxg\") pod \"ingress-canary-6t79p\" (UID: \"e52083e7-dd87-4733-870d-1b83e1f134ae\") " pod="openshift-ingress-canary/ingress-canary-6t79p"
Jul 26 16:08:41.188911 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.188901    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spd29\" (UniqueName: \"kubernetes.io/projected/599cd3cc-a2cc-4359-9dfd-2215960c847b-kube-api-access-spd29\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:41.196388 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.196372    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xc8ts"
Jul 26 16:08:41.200735 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.200714    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:41.213284 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.213155    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25"
Jul 26 16:08:41.217932 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.217916    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c"
Jul 26 16:08:41.223880 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.223856    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5cfd"
Jul 26 16:08:41.228675 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.228611    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6t79p"
Jul 26 16:08:41.332620 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.332542    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-qvvws"]
Jul 26 16:08:41.343560 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.343534    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xc8ts"]
Jul 26 16:08:41.347264 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:41.347235    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c5fb98_fd57_4375_bfd8_9b3007965d80.slice/crio-15ca769566c4fdb4ce144b4ce210e050ac0518bd9dd8fb78ef9d739dfb96caa7 WatchSource:0}: Error finding container 15ca769566c4fdb4ce144b4ce210e050ac0518bd9dd8fb78ef9d739dfb96caa7: Status 404 returned error can't find the container with id 15ca769566c4fdb4ce144b4ce210e050ac0518bd9dd8fb78ef9d739dfb96caa7
Jul 26 16:08:41.350425 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:41.348705    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda08982fd_5a26_492b_8ff0_164b509a1f93.slice/crio-1f8da46869aa4b595134a19a22ca437fd34d0a9161a4d00858a6e06e04c0104e WatchSource:0}: Error finding container 1f8da46869aa4b595134a19a22ca437fd34d0a9161a4d00858a6e06e04c0104e: Status 404 returned error can't find the container with id 1f8da46869aa4b595134a19a22ca437fd34d0a9161a4d00858a6e06e04c0104e
Jul 26 16:08:41.485736 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.485650    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:41.506030 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.506008    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-q5cfd"]
Jul 26 16:08:41.508543 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.508518    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-44t9x"]
Jul 26 16:08:41.508856 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:41.508823    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef30551_aabe_47a5_988f_99493561000e.slice/crio-7ed10b6ce6b93df17644edd26a6cd87cb845aed46e9d230bcaca3073245aa2d0 WatchSource:0}: Error finding container 7ed10b6ce6b93df17644edd26a6cd87cb845aed46e9d230bcaca3073245aa2d0: Status 404 returned error can't find the container with id 7ed10b6ce6b93df17644edd26a6cd87cb845aed46e9d230bcaca3073245aa2d0
Jul 26 16:08:41.512573 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:41.512553    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083e4170_cde7_406a_887b_54540eb55bf5.slice/crio-9fc56165be502d8631fe7844e666d1f94d1aaa0a8f9f0e61344157576ac2d115 WatchSource:0}: Error finding container 9fc56165be502d8631fe7844e666d1f94d1aaa0a8f9f0e61344157576ac2d115: Status 404 returned error can't find the container with id 9fc56165be502d8631fe7844e666d1f94d1aaa0a8f9f0e61344157576ac2d115
Jul 26 16:08:41.514225 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.514189    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6t79p"]
Jul 26 16:08:41.521154 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.520478    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25"]
Jul 26 16:08:41.525384 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:41.525358    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod864a4462_7451_4c85_8863_6a4ec9140c77.slice/crio-569fd329d38946356ff752bfdb601f98040333fcc98f6b7647ed0ffce40a1d24 WatchSource:0}: Error finding container 569fd329d38946356ff752bfdb601f98040333fcc98f6b7647ed0ffce40a1d24: Status 404 returned error can't find the container with id 569fd329d38946356ff752bfdb601f98040333fcc98f6b7647ed0ffce40a1d24
Jul 26 16:08:41.526260 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:41.526236    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode52083e7_dd87_4733_870d_1b83e1f134ae.slice/crio-bcd955064736e74f37887a1bd0de9dba981bbcb2b3f2a39e4c671d9fbb59f5ff WatchSource:0}: Error finding container bcd955064736e74f37887a1bd0de9dba981bbcb2b3f2a39e4c671d9fbb59f5ff: Status 404 returned error can't find the container with id bcd955064736e74f37887a1bd0de9dba981bbcb2b3f2a39e4c671d9fbb59f5ff
Jul 26 16:08:41.530538 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.530517    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c"]
Jul 26 16:08:41.533477 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:41.533455    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod970557d5_5925_4ba0_bb27_5cf4c9ff0ec1.slice/crio-b7eb8b71e692e21ba8cd0bf1858ec1bc74faa89840e4683b4714c647d0491357 WatchSource:0}: Error finding container b7eb8b71e692e21ba8cd0bf1858ec1bc74faa89840e4683b4714c647d0491357: Status 404 returned error can't find the container with id b7eb8b71e692e21ba8cd0bf1858ec1bc74faa89840e4683b4714c647d0491357
Jul 26 16:08:41.584552 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.584494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dpq9w\" (UID: \"ac351cd2-b972-4607-abc4-dec4a9452647\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"
Jul 26 16:08:41.584552 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.584538    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:41.584694 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.584596    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:41.584694 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.584620    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:08:41.584694 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.584638    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 26 16:08:41.584800 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.584699    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls podName:ac351cd2-b972-4607-abc4-dec4a9452647 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:42.584679748 +0000 UTC m=+38.119379005 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls") pod "cluster-samples-operator-6748489656-dpq9w" (UID: "ac351cd2-b972-4607-abc4-dec4a9452647") : secret "samples-operator-tls" not found
Jul 26 16:08:41.584800 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.584709    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 26 16:08:41.584800 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.584726    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 26 16:08:41.584800 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.584743    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 16:08:41.584800 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.584756    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55fb749d87-blpw5: secret "image-registry-tls" not found
Jul 26 16:08:41.584800 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.584642    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:41.584800 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.584745    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs podName:976d4655-f3a5-48e1-bc28-64652772d878 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:42.584734805 +0000 UTC m=+38.119434071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs") pod "router-default-64c4699495-5f5tt" (UID: "976d4655-f3a5-48e1-bc28-64652772d878") : secret "router-metrics-certs-default" not found
Jul 26 16:08:41.585045 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.584815    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls podName:0d800c32-37d3-421d-80a3-d0223dc36ca2 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:42.584802581 +0000 UTC m=+38.119501839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-5vwjk" (UID: "0d800c32-37d3-421d-80a3-d0223dc36ca2") : secret "cluster-monitoring-operator-tls" not found
Jul 26 16:08:41.585045 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.584830    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle podName:976d4655-f3a5-48e1-bc28-64652772d878 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:42.584822785 +0000 UTC m=+38.119522037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle") pod "router-default-64c4699495-5f5tt" (UID: "976d4655-f3a5-48e1-bc28-64652772d878") : configmap references non-existent config key: service-ca.crt
Jul 26 16:08:41.585045 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.584848    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls podName:dde76c96-8569-4bc2-99fd-ce2db3047018 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:42.584838188 +0000 UTC m=+38.119537446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls") pod "image-registry-55fb749d87-blpw5" (UID: "dde76c96-8569-4bc2-99fd-ce2db3047018") : secret "image-registry-tls" not found
Jul 26 16:08:41.585760 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.585726    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:41.685820 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:41.685792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:41.685919 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.685881    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 16:08:41.685960 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:41.685928    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls podName:599cd3cc-a2cc-4359-9dfd-2215960c847b nodeName:}" failed. No retries permitted until 2026-07-26 16:08:42.685915502 +0000 UTC m=+38.220614754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls") pod "dns-default-wdzsq" (UID: "599cd3cc-a2cc-4359-9dfd-2215960c847b") : secret "dns-default-metrics-tls" not found
Jul 26 16:08:42.119024 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.118990    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x" event={"ID":"083e4170-cde7-406a-887b-54540eb55bf5","Type":"ContainerStarted","Data":"9fc56165be502d8631fe7844e666d1f94d1aaa0a8f9f0e61344157576ac2d115"}
Jul 26 16:08:42.120812 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.120745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6t79p" event={"ID":"e52083e7-dd87-4733-870d-1b83e1f134ae","Type":"ContainerStarted","Data":"bcd955064736e74f37887a1bd0de9dba981bbcb2b3f2a39e4c671d9fbb59f5ff"}
Jul 26 16:08:42.123072 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.123043    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c" event={"ID":"970557d5-5925-4ba0-bb27-5cf4c9ff0ec1","Type":"ContainerStarted","Data":"b7eb8b71e692e21ba8cd0bf1858ec1bc74faa89840e4683b4714c647d0491357"}
Jul 26 16:08:42.124521 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.124445    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25" event={"ID":"864a4462-7451-4c85-8863-6a4ec9140c77","Type":"ContainerStarted","Data":"569fd329d38946356ff752bfdb601f98040333fcc98f6b7647ed0ffce40a1d24"}
Jul 26 16:08:42.131234 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.130237    2559 generic.go:356] "Generic (PLEG): container finished" podID="0a797309-faed-4e45-b1d9-480ed7a7cc19" containerID="0c5a16a8afc45dbf7422fd789bf18dac953d901a426aacf7bcae769afd6e1a3b" exitCode=0
Jul 26 16:08:42.131234 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.130311    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qhfk" event={"ID":"0a797309-faed-4e45-b1d9-480ed7a7cc19","Type":"ContainerDied","Data":"0c5a16a8afc45dbf7422fd789bf18dac953d901a426aacf7bcae769afd6e1a3b"}
Jul 26 16:08:42.133083 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.133018    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5cfd" event={"ID":"def30551-aabe-47a5-988f-99493561000e","Type":"ContainerStarted","Data":"7ed10b6ce6b93df17644edd26a6cd87cb845aed46e9d230bcaca3073245aa2d0"}
Jul 26 16:08:42.137588 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.137511    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xc8ts" event={"ID":"a08982fd-5a26-492b-8ff0-164b509a1f93","Type":"ContainerStarted","Data":"1f8da46869aa4b595134a19a22ca437fd34d0a9161a4d00858a6e06e04c0104e"}
Jul 26 16:08:42.139354 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.139308    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-qvvws" event={"ID":"a6c5fb98-fd57-4375-bfd8-9b3007965d80","Type":"ContainerStarted","Data":"15ca769566c4fdb4ce144b4ce210e050ac0518bd9dd8fb78ef9d739dfb96caa7"}
Jul 26 16:08:42.594611 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.594370    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dpq9w\" (UID: \"ac351cd2-b972-4607-abc4-dec4a9452647\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"
Jul 26 16:08:42.594778 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:42.594541    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 26 16:08:42.594778 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:42.594739    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls podName:ac351cd2-b972-4607-abc4-dec4a9452647 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:44.594718965 +0000 UTC m=+40.129418232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls") pod "cluster-samples-operator-6748489656-dpq9w" (UID: "ac351cd2-b972-4607-abc4-dec4a9452647") : secret "samples-operator-tls" not found
Jul 26 16:08:42.594778 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:42.594743    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 16:08:42.594778 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:42.594755    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55fb749d87-blpw5: secret "image-registry-tls" not found
Jul 26 16:08:42.595009 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:42.594786    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls podName:dde76c96-8569-4bc2-99fd-ce2db3047018 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:44.594776032 +0000 UTC m=+40.129475301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls") pod "image-registry-55fb749d87-blpw5" (UID: "dde76c96-8569-4bc2-99fd-ce2db3047018") : secret "image-registry-tls" not found
Jul 26 16:08:42.595009 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.594668    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:42.595009 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.594883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:42.595009 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.594920    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:08:42.595009 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.594947    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:42.595286 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:42.595050    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle podName:976d4655-f3a5-48e1-bc28-64652772d878 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:44.59503798 +0000 UTC m=+40.129737235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle") pod "router-default-64c4699495-5f5tt" (UID: "976d4655-f3a5-48e1-bc28-64652772d878") : configmap references non-existent config key: service-ca.crt
Jul 26 16:08:42.595286 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:42.595113    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 26 16:08:42.595286 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:42.595155    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 26 16:08:42.595286 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:42.595175    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs podName:976d4655-f3a5-48e1-bc28-64652772d878 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:44.595163286 +0000 UTC m=+40.129862544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs") pod "router-default-64c4699495-5f5tt" (UID: "976d4655-f3a5-48e1-bc28-64652772d878") : secret "router-metrics-certs-default" not found
Jul 26 16:08:42.595286 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:42.595193    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls podName:0d800c32-37d3-421d-80a3-d0223dc36ca2 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:44.59518055 +0000 UTC m=+40.129879823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-5vwjk" (UID: "0d800c32-37d3-421d-80a3-d0223dc36ca2") : secret "cluster-monitoring-operator-tls" not found
Jul 26 16:08:42.697000 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:42.696368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:42.697000 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:42.696602    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 16:08:42.697000 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:42.696660    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls podName:599cd3cc-a2cc-4359-9dfd-2215960c847b nodeName:}" failed. No retries permitted until 2026-07-26 16:08:44.696642604 +0000 UTC m=+40.231341861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls") pod "dns-default-wdzsq" (UID: "599cd3cc-a2cc-4359-9dfd-2215960c847b") : secret "dns-default-metrics-tls" not found
Jul 26 16:08:43.154888 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:43.154811    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qhfk" event={"ID":"0a797309-faed-4e45-b1d9-480ed7a7cc19","Type":"ContainerStarted","Data":"f9a346e318ccc30b77d956cf216f536fd2a3479148b3903c9ed46bb8928f8d38"}
Jul 26 16:08:43.157384 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:43.157327    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xc8ts" event={"ID":"a08982fd-5a26-492b-8ff0-164b509a1f93","Type":"ContainerStarted","Data":"231d07cfc05e4d090a467610f9ddd88f7a0a164661637f56960ff8bb1c81b9a8"}
Jul 26 16:08:43.184422 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:43.183432    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7qhfk" podStartSLOduration=7.803738597 podStartE2EDuration="38.183401646s" totalImagesPullingTime="30.379663049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:08:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:43.180826487 +0000 UTC m=+38.715525762" watchObservedRunningTime="2026-07-26 16:08:43.183401646 +0000 UTC m=+38.718100935"
Jul 26 16:08:43.314659 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:43.314623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:43.414431 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:43.414281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:43.940856 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:43.940766    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:44.617940 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:44.617900    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:08:44.617940 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:44.617940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:44.618452 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:44.618004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dpq9w\" (UID: \"ac351cd2-b972-4607-abc4-dec4a9452647\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"
Jul 26 16:08:44.618452 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:44.618060    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:44.618452 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:44.618071    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 26 16:08:44.618452 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:44.618165    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls podName:0d800c32-37d3-421d-80a3-d0223dc36ca2 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:48.6181435 +0000 UTC m=+44.152842753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-5vwjk" (UID: "0d800c32-37d3-421d-80a3-d0223dc36ca2") : secret "cluster-monitoring-operator-tls" not found
Jul 26 16:08:44.618452 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:44.618180    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle podName:976d4655-f3a5-48e1-bc28-64652772d878 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:48.618173962 +0000 UTC m=+44.152873215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle") pod "router-default-64c4699495-5f5tt" (UID: "976d4655-f3a5-48e1-bc28-64652772d878") : configmap references non-existent config key: service-ca.crt
Jul 26 16:08:44.618452 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:44.618182    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 26 16:08:44.618452 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:44.618239    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:44.618452 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:44.618250    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls podName:ac351cd2-b972-4607-abc4-dec4a9452647 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:48.618230132 +0000 UTC m=+44.152929391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls") pod "cluster-samples-operator-6748489656-dpq9w" (UID: "ac351cd2-b972-4607-abc4-dec4a9452647") : secret "samples-operator-tls" not found
Jul 26 16:08:44.618452 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:44.618185    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 16:08:44.618452 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:44.618300    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 26 16:08:44.618452 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:44.618304    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55fb749d87-blpw5: secret "image-registry-tls" not found
Jul 26 16:08:44.618452 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:44.618333    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs podName:976d4655-f3a5-48e1-bc28-64652772d878 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:48.618323043 +0000 UTC m=+44.153022300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs") pod "router-default-64c4699495-5f5tt" (UID: "976d4655-f3a5-48e1-bc28-64652772d878") : secret "router-metrics-certs-default" not found
Jul 26 16:08:44.618452 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:44.618348    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls podName:dde76c96-8569-4bc2-99fd-ce2db3047018 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:48.618340077 +0000 UTC m=+44.153039336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls") pod "image-registry-55fb749d87-blpw5" (UID: "dde76c96-8569-4bc2-99fd-ce2db3047018") : secret "image-registry-tls" not found
Jul 26 16:08:44.719195 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:44.719163    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:44.719368 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:44.719305    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 16:08:44.719368 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:44.719365    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls podName:599cd3cc-a2cc-4359-9dfd-2215960c847b nodeName:}" failed. No retries permitted until 2026-07-26 16:08:48.719350082 +0000 UTC m=+44.254049338 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls") pod "dns-default-wdzsq" (UID: "599cd3cc-a2cc-4359-9dfd-2215960c847b") : secret "dns-default-metrics-tls" not found
Jul 26 16:08:45.716487 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:45.716448    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:45.775843 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:45.775815    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:46.724508 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:46.724472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:46.826051 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:46.826001    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:47.349764 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:47.349728    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:47.417772 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:47.417742    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:47.484370 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:47.484334    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:47.563356 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:47.563320    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:47.635622 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:47.635546    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:47.735780 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:47.735731    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:48.305284 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:48.305247    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:48.356040 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:48.356008    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:48.652468 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:48.652400    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:48.652468 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:48.652439    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:08:48.652468 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:48.652460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:48.652722 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:48.652491    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dpq9w\" (UID: \"ac351cd2-b972-4607-abc4-dec4a9452647\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"
Jul 26 16:08:48.652722 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:48.652554    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 26 16:08:48.652722 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:48.652570    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 26 16:08:48.652722 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:48.652597    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle podName:976d4655-f3a5-48e1-bc28-64652772d878 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:56.652580747 +0000 UTC m=+52.187280022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle") pod "router-default-64c4699495-5f5tt" (UID: "976d4655-f3a5-48e1-bc28-64652772d878") : configmap references non-existent config key: service-ca.crt
Jul 26 16:08:48.652722 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:48.652623    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs podName:976d4655-f3a5-48e1-bc28-64652772d878 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:56.652616164 +0000 UTC m=+52.187315417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs") pod "router-default-64c4699495-5f5tt" (UID: "976d4655-f3a5-48e1-bc28-64652772d878") : secret "router-metrics-certs-default" not found
Jul 26 16:08:48.652722 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:48.652638    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 26 16:08:48.652722 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:48.652640    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls podName:0d800c32-37d3-421d-80a3-d0223dc36ca2 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:56.65263214 +0000 UTC m=+52.187331406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-5vwjk" (UID: "0d800c32-37d3-421d-80a3-d0223dc36ca2") : secret "cluster-monitoring-operator-tls" not found
Jul 26 16:08:48.652722 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:48.652674    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls podName:ac351cd2-b972-4607-abc4-dec4a9452647 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:56.652663171 +0000 UTC m=+52.187362425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls") pod "cluster-samples-operator-6748489656-dpq9w" (UID: "ac351cd2-b972-4607-abc4-dec4a9452647") : secret "samples-operator-tls" not found
Jul 26 16:08:48.652722 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:48.652687    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:48.653116 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:48.652764    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 16:08:48.653116 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:48.652772    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55fb749d87-blpw5: secret "image-registry-tls" not found
Jul 26 16:08:48.653116 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:48.652800    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls podName:dde76c96-8569-4bc2-99fd-ce2db3047018 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:56.652793073 +0000 UTC m=+52.187492326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls") pod "image-registry-55fb749d87-blpw5" (UID: "dde76c96-8569-4bc2-99fd-ce2db3047018") : secret "image-registry-tls" not found
Jul 26 16:08:48.703088 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:48.703059    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:48.753833 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:48.753813    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:48.754182 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:48.753959    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 16:08:48.754182 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:48.754008    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls podName:599cd3cc-a2cc-4359-9dfd-2215960c847b nodeName:}" failed. No retries permitted until 2026-07-26 16:08:56.753993839 +0000 UTC m=+52.288693097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls") pod "dns-default-wdzsq" (UID: "599cd3cc-a2cc-4359-9dfd-2215960c847b") : secret "dns-default-metrics-tls" not found
Jul 26 16:08:48.754633 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:48.754608    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:49.174989 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:49.174961    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-qvvws" event={"ID":"a6c5fb98-fd57-4375-bfd8-9b3007965d80","Type":"ContainerStarted","Data":"c1eae1ffdad8c2cb4cd808cf407a8b4069f918e1fd66d3e038a88312efecdd73"}
Jul 26 16:08:50.186577 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.186547    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/0.log"
Jul 26 16:08:50.187052 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.186588    2559 generic.go:356] "Generic (PLEG): container finished" podID="083e4170-cde7-406a-887b-54540eb55bf5" containerID="dccb0f569f8c036c745360608ebee05c4e1c092d2f6a0913ebedcaa9262ea891" exitCode=255
Jul 26 16:08:50.187052 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.186621    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x" event={"ID":"083e4170-cde7-406a-887b-54540eb55bf5","Type":"ContainerDied","Data":"dccb0f569f8c036c745360608ebee05c4e1c092d2f6a0913ebedcaa9262ea891"}
Jul 26 16:08:50.187052 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.186962    2559 scope.go:117] "RemoveContainer" containerID="dccb0f569f8c036c745360608ebee05c4e1c092d2f6a0913ebedcaa9262ea891"
Jul 26 16:08:50.188609 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.188580    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6t79p" event={"ID":"e52083e7-dd87-4733-870d-1b83e1f134ae","Type":"ContainerStarted","Data":"adccdad17b872dbbfe9e7d422b6ebc020e128d2787824f2474512ee1c2f053f6"}
Jul 26 16:08:50.190649 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.190605    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c" event={"ID":"970557d5-5925-4ba0-bb27-5cf4c9ff0ec1","Type":"ContainerStarted","Data":"4e5da7460202109f1cc288398b360f50f401b540eebac6078f99c5d3e34798a3"}
Jul 26 16:08:50.192068 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.192046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25" event={"ID":"864a4462-7451-4c85-8863-6a4ec9140c77","Type":"ContainerStarted","Data":"9e1cd07aa64bd638131d5a585f6ae953e57282d70349c4dcb518e7ff3cdb7be7"}
Jul 26 16:08:50.193550 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.193528    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5cfd" event={"ID":"def30551-aabe-47a5-988f-99493561000e","Type":"ContainerStarted","Data":"85e4442a6cda39f3e06496f1ab2b3e5d6c03402cb39bdaded4dbd0bcf2b6ef65"}
Jul 26 16:08:50.203212 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.203173    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-xc8ts" podStartSLOduration=25.711273593 podStartE2EDuration="27.203157658s" totalImagesPullingTime="1.491884065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:43.199702817 +0000 UTC m=+38.734402095" watchObservedRunningTime="2026-07-26 16:08:50.203157658 +0000 UTC m=+45.737856933"
Jul 26 16:08:50.215696 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.215656    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q5cfd" podStartSLOduration=12.658241165 podStartE2EDuration="20.215640917s" totalImagesPullingTime="7.557399752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:50.215102263 +0000 UTC m=+45.749801539" watchObservedRunningTime="2026-07-26 16:08:50.215640917 +0000 UTC m=+45.750340185"
Jul 26 16:08:50.232761 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.232719    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-qvvws" podStartSLOduration=25.524298879 podStartE2EDuration="33.232705494s" totalImagesPullingTime="7.708406615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:50.231611725 +0000 UTC m=+45.766311013" watchObservedRunningTime="2026-07-26 16:08:50.232705494 +0000 UTC m=+45.767404749"
Jul 26 16:08:50.270944 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.269853    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25" podStartSLOduration=15.738548331 podStartE2EDuration="23.269840383s" totalImagesPullingTime="7.531292052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:50.24787848 +0000 UTC m=+45.782577756" watchObservedRunningTime="2026-07-26 16:08:50.269840383 +0000 UTC m=+45.804539663"
Jul 26 16:08:50.270944 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.270222    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c" podStartSLOduration=15.746357421999999 podStartE2EDuration="23.270211876s" totalImagesPullingTime="7.523854454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:50.2694593 +0000 UTC m=+45.804158580" watchObservedRunningTime="2026-07-26 16:08:50.270211876 +0000 UTC m=+45.804911153"
Jul 26 16:08:50.287907 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.287865    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6t79p" podStartSLOduration=2.757043631 podStartE2EDuration="10.287846188s" totalImagesPullingTime="7.530802557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:50.286629733 +0000 UTC m=+45.821329011" watchObservedRunningTime="2026-07-26 16:08:50.287846188 +0000 UTC m=+45.822545465"
Jul 26 16:08:50.294955 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.294927    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:50.391577 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.391548    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:50.493950 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.493912    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:50.511035 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.511009    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-p94pf"]
Jul 26 16:08:50.528509 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.528484    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-p94pf"]
Jul 26 16:08:50.528607 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.528586    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-p94pf"
Jul 26 16:08:50.530949 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.530928    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 26 16:08:50.531063 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.531027    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 26 16:08:50.531241 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.531211    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-69zdz\""
Jul 26 16:08:50.571382 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.571354    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpp4h\" (UniqueName: \"kubernetes.io/projected/36b2fcbc-91ef-4c79-9442-65eb2fd60104-kube-api-access-xpp4h\") pod \"migrator-6865c9967-p94pf\" (UID: \"36b2fcbc-91ef-4c79-9442-65eb2fd60104\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-p94pf"
Jul 26 16:08:50.594552 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.594522    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:50.660753 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.660695    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:50.672722 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.672698    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpp4h\" (UniqueName: \"kubernetes.io/projected/36b2fcbc-91ef-4c79-9442-65eb2fd60104-kube-api-access-xpp4h\") pod \"migrator-6865c9967-p94pf\" (UID: \"36b2fcbc-91ef-4c79-9442-65eb2fd60104\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-p94pf"
Jul 26 16:08:50.685447 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.685429    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpp4h\" (UniqueName: \"kubernetes.io/projected/36b2fcbc-91ef-4c79-9442-65eb2fd60104-kube-api-access-xpp4h\") pod \"migrator-6865c9967-p94pf\" (UID: \"36b2fcbc-91ef-4c79-9442-65eb2fd60104\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-p94pf"
Jul 26 16:08:50.743078 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.743053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:50.838951 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.838927    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-p94pf"
Jul 26 16:08:50.988724 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:50.988689    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:51.009209 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.009154    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-p94pf"]
Jul 26 16:08:51.011156 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:51.011112    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b2fcbc_91ef_4c79_9442_65eb2fd60104.slice/crio-15999b1cb67026b1c9c0f4ac52a8213cf9002888e38e68229209ba06aa585426 WatchSource:0}: Error finding container 15999b1cb67026b1c9c0f4ac52a8213cf9002888e38e68229209ba06aa585426: Status 404 returned error can't find the container with id 15999b1cb67026b1c9c0f4ac52a8213cf9002888e38e68229209ba06aa585426
Jul 26 16:08:51.088607 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.088573    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:51.201217 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.201182    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:51.201571 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.201540    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:08:51.203031 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.203003    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-p94pf" event={"ID":"36b2fcbc-91ef-4c79-9442-65eb2fd60104","Type":"ContainerStarted","Data":"15999b1cb67026b1c9c0f4ac52a8213cf9002888e38e68229209ba06aa585426"}
Jul 26 16:08:51.204495 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.204478    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:08:51.204874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.204860    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/0.log"
Jul 26 16:08:51.204928 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.204890    2559 generic.go:356] "Generic (PLEG): container finished" podID="083e4170-cde7-406a-887b-54540eb55bf5" containerID="c84bbad3da5042235d5ea450ea843fb9931eeab731cdaf0df237f0cd2d1cfb8e" exitCode=255
Jul 26 16:08:51.204928 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.204915    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x" event={"ID":"083e4170-cde7-406a-887b-54540eb55bf5","Type":"ContainerDied","Data":"c84bbad3da5042235d5ea450ea843fb9931eeab731cdaf0df237f0cd2d1cfb8e"}
Jul 26 16:08:51.205024 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.204970    2559 scope.go:117] "RemoveContainer" containerID="dccb0f569f8c036c745360608ebee05c4e1c092d2f6a0913ebedcaa9262ea891"
Jul 26 16:08:51.205266 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.205248    2559 scope.go:117] "RemoveContainer" containerID="c84bbad3da5042235d5ea450ea843fb9931eeab731cdaf0df237f0cd2d1cfb8e"
Jul 26 16:08:51.205442 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:51.205418    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-44t9x_openshift-console-operator(083e4170-cde7-406a-887b-54540eb55bf5)\"" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x" podUID="083e4170-cde7-406a-887b-54540eb55bf5"
Jul 26 16:08:51.287061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.287032    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5ndjt"]
Jul 26 16:08:51.318980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.318956    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5ndjt"]
Jul 26 16:08:51.319107 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.319058    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.321407 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.321384    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 26 16:08:51.321584 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.321565    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 26 16:08:51.321702 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.321685    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r6bm5\""
Jul 26 16:08:51.337952 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.337930    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:51.380374 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.380349    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.380499 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.380479    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/908b6598-c0d3-452f-a3b2-222478faa1f1-crio-socket\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.380558 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.380537    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/908b6598-c0d3-452f-a3b2-222478faa1f1-data-volume\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.380629 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.380618    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.380676 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.380639    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzpww\" (UniqueName: \"kubernetes.io/projected/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-api-access-fzpww\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.394725 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.394694    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:51.481543 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.481492    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzpww\" (UniqueName: \"kubernetes.io/projected/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-api-access-fzpww\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.481643 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.481548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.481643 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.481609    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/908b6598-c0d3-452f-a3b2-222478faa1f1-crio-socket\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.481643 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.481641    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/908b6598-c0d3-452f-a3b2-222478faa1f1-data-volume\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.481779 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.481667    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.481779 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:51.481728    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 16:08:51.481779 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:51.481772    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm podName:908b6598-c0d3-452f-a3b2-222478faa1f1 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:51.98176089 +0000 UTC m=+47.516460156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5ndjt" (UID: "908b6598-c0d3-452f-a3b2-222478faa1f1") : configmap "kube-rbac-proxy" not found
Jul 26 16:08:51.481893 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:51.481726    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 16:08:51.481893 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.481816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/908b6598-c0d3-452f-a3b2-222478faa1f1-crio-socket\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.481893 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:51.481861    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls podName:908b6598-c0d3-452f-a3b2-222478faa1f1 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:51.981846405 +0000 UTC m=+47.516545662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5ndjt" (UID: "908b6598-c0d3-452f-a3b2-222478faa1f1") : secret "insights-runtime-extractor-tls" not found
Jul 26 16:08:51.481985 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.481893    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/908b6598-c0d3-452f-a3b2-222478faa1f1-data-volume\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.489339 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.489313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzpww\" (UniqueName: \"kubernetes.io/projected/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-api-access-fzpww\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.985250 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.985214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.985443 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:51.985374    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 16:08:51.985443 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:51.985421    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 16:08:51.985549 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:51.985378    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:51.985549 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:51.985452    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls podName:908b6598-c0d3-452f-a3b2-222478faa1f1 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:52.98543506 +0000 UTC m=+48.520134333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5ndjt" (UID: "908b6598-c0d3-452f-a3b2-222478faa1f1") : secret "insights-runtime-extractor-tls" not found
Jul 26 16:08:51.985549 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:51.985504    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm podName:908b6598-c0d3-452f-a3b2-222478faa1f1 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:52.985489696 +0000 UTC m=+48.520188954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5ndjt" (UID: "908b6598-c0d3-452f-a3b2-222478faa1f1") : configmap "kube-rbac-proxy" not found
Jul 26 16:08:52.209564 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.209537    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:08:52.209984 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.209966    2559 scope.go:117] "RemoveContainer" containerID="c84bbad3da5042235d5ea450ea843fb9931eeab731cdaf0df237f0cd2d1cfb8e"
Jul 26 16:08:52.210196 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:52.210169    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-44t9x_openshift-console-operator(083e4170-cde7-406a-887b-54540eb55bf5)\"" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x" podUID="083e4170-cde7-406a-887b-54540eb55bf5"
Jul 26 16:08:52.384061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.383980    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:52.484819 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.484787    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:52.589455 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.589417    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-2wfdd"]
Jul 26 16:08:52.602285 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.602266    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-2wfdd"]
Jul 26 16:08:52.602408 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.602344    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-2wfdd"
Jul 26 16:08:52.604610 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.604591    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 26 16:08:52.604867 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.604843    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 26 16:08:52.604867 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.604854    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-z52gf\""
Jul 26 16:08:52.605039 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.604923    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 26 16:08:52.605039 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.604949    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 26 16:08:52.628560 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.628526    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:52.690331 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.690298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/09e738b9-f48b-48ed-ae8f-dcc9b265ba7a-signing-key\") pod \"service-ca-658d7b7c78-2wfdd\" (UID: \"09e738b9-f48b-48ed-ae8f-dcc9b265ba7a\") " pod="openshift-service-ca/service-ca-658d7b7c78-2wfdd"
Jul 26 16:08:52.690486 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.690469    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/09e738b9-f48b-48ed-ae8f-dcc9b265ba7a-signing-cabundle\") pod \"service-ca-658d7b7c78-2wfdd\" (UID: \"09e738b9-f48b-48ed-ae8f-dcc9b265ba7a\") " pod="openshift-service-ca/service-ca-658d7b7c78-2wfdd"
Jul 26 16:08:52.690532 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.690509    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2zjl\" (UniqueName: \"kubernetes.io/projected/09e738b9-f48b-48ed-ae8f-dcc9b265ba7a-kube-api-access-d2zjl\") pod \"service-ca-658d7b7c78-2wfdd\" (UID: \"09e738b9-f48b-48ed-ae8f-dcc9b265ba7a\") " pod="openshift-service-ca/service-ca-658d7b7c78-2wfdd"
Jul 26 16:08:52.792050 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.792022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/09e738b9-f48b-48ed-ae8f-dcc9b265ba7a-signing-key\") pod \"service-ca-658d7b7c78-2wfdd\" (UID: \"09e738b9-f48b-48ed-ae8f-dcc9b265ba7a\") " pod="openshift-service-ca/service-ca-658d7b7c78-2wfdd"
Jul 26 16:08:52.792206 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.792191    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/09e738b9-f48b-48ed-ae8f-dcc9b265ba7a-signing-cabundle\") pod \"service-ca-658d7b7c78-2wfdd\" (UID: \"09e738b9-f48b-48ed-ae8f-dcc9b265ba7a\") " pod="openshift-service-ca/service-ca-658d7b7c78-2wfdd"
Jul 26 16:08:52.792253 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.792215    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2zjl\" (UniqueName: \"kubernetes.io/projected/09e738b9-f48b-48ed-ae8f-dcc9b265ba7a-kube-api-access-d2zjl\") pod \"service-ca-658d7b7c78-2wfdd\" (UID: \"09e738b9-f48b-48ed-ae8f-dcc9b265ba7a\") " pod="openshift-service-ca/service-ca-658d7b7c78-2wfdd"
Jul 26 16:08:52.792754 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.792734    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/09e738b9-f48b-48ed-ae8f-dcc9b265ba7a-signing-cabundle\") pod \"service-ca-658d7b7c78-2wfdd\" (UID: \"09e738b9-f48b-48ed-ae8f-dcc9b265ba7a\") " pod="openshift-service-ca/service-ca-658d7b7c78-2wfdd"
Jul 26 16:08:52.794387 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.794365    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/09e738b9-f48b-48ed-ae8f-dcc9b265ba7a-signing-key\") pod \"service-ca-658d7b7c78-2wfdd\" (UID: \"09e738b9-f48b-48ed-ae8f-dcc9b265ba7a\") " pod="openshift-service-ca/service-ca-658d7b7c78-2wfdd"
Jul 26 16:08:52.800167 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.800144    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2zjl\" (UniqueName: \"kubernetes.io/projected/09e738b9-f48b-48ed-ae8f-dcc9b265ba7a-kube-api-access-d2zjl\") pod \"service-ca-658d7b7c78-2wfdd\" (UID: \"09e738b9-f48b-48ed-ae8f-dcc9b265ba7a\") " pod="openshift-service-ca/service-ca-658d7b7c78-2wfdd"
Jul 26 16:08:52.912027 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.911999    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-2wfdd"
Jul 26 16:08:52.994630 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.994602    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:52.994760 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:52.994673    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:52.994831 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:52.994758    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 16:08:52.994886 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:52.994850    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm podName:908b6598-c0d3-452f-a3b2-222478faa1f1 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:54.994809425 +0000 UTC m=+50.529508701 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5ndjt" (UID: "908b6598-c0d3-452f-a3b2-222478faa1f1") : configmap "kube-rbac-proxy" not found
Jul 26 16:08:52.994886 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:52.994852    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 16:08:52.995013 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:52.994906    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls podName:908b6598-c0d3-452f-a3b2-222478faa1f1 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:54.994890548 +0000 UTC m=+50.529589819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5ndjt" (UID: "908b6598-c0d3-452f-a3b2-222478faa1f1") : secret "insights-runtime-extractor-tls" not found
Jul 26 16:08:53.037346 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:53.037311    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-2wfdd"]
Jul 26 16:08:53.040212 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:08:53.040186    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e738b9_f48b_48ed_ae8f_dcc9b265ba7a.slice/crio-4bee4bac57da8c3f66bb1ac4224e2fb08cdaf23b8ddf40ab2599fac996858481 WatchSource:0}: Error finding container 4bee4bac57da8c3f66bb1ac4224e2fb08cdaf23b8ddf40ab2599fac996858481: Status 404 returned error can't find the container with id 4bee4bac57da8c3f66bb1ac4224e2fb08cdaf23b8ddf40ab2599fac996858481
Jul 26 16:08:53.214809 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:53.214726    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-2wfdd" event={"ID":"09e738b9-f48b-48ed-ae8f-dcc9b265ba7a","Type":"ContainerStarted","Data":"8cb915129077248f047df5c3ecfd189ca0a500eaf67b8a066f7b3e1c15b7448c"}
Jul 26 16:08:53.214809 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:53.214778    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-2wfdd" event={"ID":"09e738b9-f48b-48ed-ae8f-dcc9b265ba7a","Type":"ContainerStarted","Data":"4bee4bac57da8c3f66bb1ac4224e2fb08cdaf23b8ddf40ab2599fac996858481"}
Jul 26 16:08:53.220456 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:53.220429    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-p94pf" event={"ID":"36b2fcbc-91ef-4c79-9442-65eb2fd60104","Type":"ContainerStarted","Data":"714080ef77d98355f8b8141801e755d9b586fed5cb3d409ccb030c263c1ca303"}
Jul 26 16:08:53.220603 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:53.220514    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-p94pf" event={"ID":"36b2fcbc-91ef-4c79-9442-65eb2fd60104","Type":"ContainerStarted","Data":"8d10475c44f01f6e33fef1d3687ea91c3e47fdfc72ed6f1b0774149ce26bdee5"}
Jul 26 16:08:53.233218 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:53.233171    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-2wfdd" podStartSLOduration=1.233154312 podStartE2EDuration="1.233154312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:53.233071772 +0000 UTC m=+48.767771048" watchObservedRunningTime="2026-07-26 16:08:53.233154312 +0000 UTC m=+48.767853585"
Jul 26 16:08:53.249770 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:53.249732    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-p94pf" podStartSLOduration=1.526337013 podStartE2EDuration="3.249719039s" totalImagesPullingTime="1.723382026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:53.249248457 +0000 UTC m=+48.783947732" watchObservedRunningTime="2026-07-26 16:08:53.249719039 +0000 UTC m=+48.784418314"
Jul 26 16:08:53.450575 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:53.450541    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:53.481395 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:53.481340    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gvssk_86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5/dns-node-resolver/0.log"
Jul 26 16:08:54.090635 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:54.090600    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:54.295464 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:54.295430    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:54.396254 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:54.396153    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:54.481813 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:54.481787    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z66qt_7253b8f8-7797-434e-9789-b796950e4959/node-ca/0.log"
Jul 26 16:08:54.496895 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:54.496868    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:54.598189 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:54.598146    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:54.815247 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:54.815210    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:54.881102 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:54.881071    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6t79p_e52083e7-dd87-4733-870d-1b83e1f134ae/serve-healthcheck-canary/0.log"
Jul 26 16:08:55.013834 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:55.013804    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:55.014000 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:55.013910    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:55.014000 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:55.013939    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 16:08:55.014147 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:55.014011    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm podName:908b6598-c0d3-452f-a3b2-222478faa1f1 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:59.01398992 +0000 UTC m=+54.548689193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5ndjt" (UID: "908b6598-c0d3-452f-a3b2-222478faa1f1") : configmap "kube-rbac-proxy" not found
Jul 26 16:08:55.014147 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:55.014060    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 16:08:55.014147 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:55.014139    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls podName:908b6598-c0d3-452f-a3b2-222478faa1f1 nodeName:}" failed. No retries permitted until 2026-07-26 16:08:59.014106995 +0000 UTC m=+54.548806253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5ndjt" (UID: "908b6598-c0d3-452f-a3b2-222478faa1f1") : secret "insights-runtime-extractor-tls" not found
Jul 26 16:08:55.082118 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:55.082041    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-p94pf_36b2fcbc-91ef-4c79-9442-65eb2fd60104/migrator/0.log"
Jul 26 16:08:55.281536 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:55.281511    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-p94pf_36b2fcbc-91ef-4c79-9442-65eb2fd60104/graceful-termination/0.log"
Jul 26 16:08:55.482845 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:55.482785    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25_864a4462-7451-4c85-8863-6a4ec9140c77/kube-storage-version-migrator-operator/0.log"
Jul 26 16:08:55.586410 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:55.586377    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:55.689405 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:55.689373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:55.788719 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:55.788647    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:56.195819 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.195783    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:56.295597 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.295561    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:56.486419 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.486343    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:56.587033 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.587005    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:56.729979 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.729955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dpq9w\" (UID: \"ac351cd2-b972-4607-abc4-dec4a9452647\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"
Jul 26 16:08:56.730097 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.729996    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:08:56.730097 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.730054    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:56.730097 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.730076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:08:56.730097 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.730093    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:08:56.730321 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:56.730242    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle podName:976d4655-f3a5-48e1-bc28-64652772d878 nodeName:}" failed. No retries permitted until 2026-07-26 16:09:12.730224176 +0000 UTC m=+68.264923433 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle") pod "router-default-64c4699495-5f5tt" (UID: "976d4655-f3a5-48e1-bc28-64652772d878") : configmap references non-existent config key: service-ca.crt
Jul 26 16:08:56.730321 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:56.730245    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 26 16:08:56.730321 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:56.730252    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 26 16:08:56.730321 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:56.730297    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs podName:976d4655-f3a5-48e1-bc28-64652772d878 nodeName:}" failed. No retries permitted until 2026-07-26 16:09:12.730283419 +0000 UTC m=+68.264982673 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs") pod "router-default-64c4699495-5f5tt" (UID: "976d4655-f3a5-48e1-bc28-64652772d878") : secret "router-metrics-certs-default" not found
Jul 26 16:08:56.730321 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:56.730319    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls podName:0d800c32-37d3-421d-80a3-d0223dc36ca2 nodeName:}" failed. No retries permitted until 2026-07-26 16:09:12.730303074 +0000 UTC m=+68.265002331 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-5vwjk" (UID: "0d800c32-37d3-421d-80a3-d0223dc36ca2") : secret "cluster-monitoring-operator-tls" not found
Jul 26 16:08:56.730518 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:56.730248    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 16:08:56.730518 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:56.730337    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55fb749d87-blpw5: secret "image-registry-tls" not found
Jul 26 16:08:56.730518 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:56.730382    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls podName:dde76c96-8569-4bc2-99fd-ce2db3047018 nodeName:}" failed. No retries permitted until 2026-07-26 16:09:12.73037151 +0000 UTC m=+68.265070764 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls") pod "image-registry-55fb749d87-blpw5" (UID: "dde76c96-8569-4bc2-99fd-ce2db3047018") : secret "image-registry-tls" not found
Jul 26 16:08:56.732298 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.732279    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac351cd2-b972-4607-abc4-dec4a9452647-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dpq9w\" (UID: \"ac351cd2-b972-4607-abc4-dec4a9452647\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"
Jul 26 16:08:56.806910 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.806858    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"
Jul 26 16:08:56.830610 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.830588    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:08:56.830747 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:56.830730    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 16:08:56.830795 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:56.830783    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls podName:599cd3cc-a2cc-4359-9dfd-2215960c847b nodeName:}" failed. No retries permitted until 2026-07-26 16:09:12.830770117 +0000 UTC m=+68.365469370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls") pod "dns-default-wdzsq" (UID: "599cd3cc-a2cc-4359-9dfd-2215960c847b") : secret "dns-default-metrics-tls" not found
Jul 26 16:08:56.855828 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.855785    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:56.934727 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.934707    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w"]
Jul 26 16:08:56.991033 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:56.991006    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:57.187083 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:57.187053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:57.238101 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:57.238060    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w" event={"ID":"ac351cd2-b972-4607-abc4-dec4a9452647","Type":"ContainerStarted","Data":"69e6f8b56f80a15e36d0bb98e18b956c58380c32ff65a90a5de783fb724659fe"}
Jul 26 16:08:57.385413 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:57.385368    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:57.791264 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:57.791230    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:57.891669 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:57.891617    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:58.203056 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:58.203010    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:58.587468 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:58.587374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:58.989191 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:58.989155    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:59.049100 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:59.049066    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:59.049274 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:59.049180    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:59.049362 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:59.049345    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 16:08:59.049434 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:08:59.049423    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls podName:908b6598-c0d3-452f-a3b2-222478faa1f1 nodeName:}" failed. No retries permitted until 2026-07-26 16:09:07.049400824 +0000 UTC m=+62.584100090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5ndjt" (UID: "908b6598-c0d3-452f-a3b2-222478faa1f1") : secret "insights-runtime-extractor-tls" not found
Jul 26 16:08:59.049609 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:59.049591    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/908b6598-c0d3-452f-a3b2-222478faa1f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:08:59.089839 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:59.089813    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:59.190305 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:59.190273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:59.246706 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:59.246636    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w" event={"ID":"ac351cd2-b972-4607-abc4-dec4a9452647","Type":"ContainerStarted","Data":"6cf368760902a883abae107e60acabe34ef2737d64e3afc6790c63a0a5ac491d"}
Jul 26 16:08:59.246706 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:59.246691    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w" event={"ID":"ac351cd2-b972-4607-abc4-dec4a9452647","Type":"ContainerStarted","Data":"5dfcea95c5c849f7d0925415953788a888127d59f8d9ebb99c40b0afbb934ab9"}
Jul 26 16:08:59.263770 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:59.263725    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dpq9w" podStartSLOduration=34.639702487 podStartE2EDuration="36.263710816s" totalImagesPullingTime="1.624008329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:59.263307411 +0000 UTC m=+54.798006687" watchObservedRunningTime="2026-07-26 16:08:59.263710816 +0000 UTC m=+54.798410090"
Jul 26 16:08:59.391634 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:59.391605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:59.658638 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:59.658565    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:08:59.795461 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:08:59.795432    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:00.604778 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:00.604737    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:00.985405 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:00.985376    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:01.193897 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:01.193863    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:01.201543 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:01.201523    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:09:01.201648 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:01.201575    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:09:01.201936 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:01.201920    2559 scope.go:117] "RemoveContainer" containerID="c84bbad3da5042235d5ea450ea843fb9931eeab731cdaf0df237f0cd2d1cfb8e"
Jul 26 16:09:01.395477 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:01.395438    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:01.493513 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:01.493428    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:01.596840 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:01.596803    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:01.991556 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:01.991518    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:02.092724 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:02.092691    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:02.149423 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:02.149391    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:02.257924 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:02.257866    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:09:02.257924 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:02.257910    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x" event={"ID":"083e4170-cde7-406a-887b-54540eb55bf5","Type":"ContainerStarted","Data":"4b0ab06780e6146fbed11795b3fa5d797de57f3f51002130a19b6fbb4374205d"}
Jul 26 16:09:02.258173 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:02.258149    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:09:02.262673 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:02.262656    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x"
Jul 26 16:09:02.275313 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:02.275255    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-44t9x" podStartSLOduration=29.731683963000002 podStartE2EDuration="37.275235552s" totalImagesPullingTime="7.543551589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:02.273995638 +0000 UTC m=+57.808694912" watchObservedRunningTime="2026-07-26 16:09:02.275235552 +0000 UTC m=+57.809934832"
Jul 26 16:09:02.490089 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:02.490064    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:02.590418 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:02.590340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:02.691578 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:02.691532    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:02.747635 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:02.747598    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:02.916410 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:02.916330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:03.016591 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:03.016554    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:03.117642 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:03.117608    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:03.217862 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:03.217833    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:03.317940 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:03.317908    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:03.418738 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:03.418713    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:03.786348 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:03.786320    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:03.888134 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:03.888101    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:04.081885 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:04.081786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:04.388872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:04.388796    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:04.598018 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:04.597987    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:04.698601 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:04.698567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:04.799643 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:04.799603    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:04.901923 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:04.901884    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:05.109678 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:05.109608    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dc557"
Jul 26 16:09:05.189742 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:05.189708    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:07.112714 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:07.112676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:09:07.114982 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:07.114961    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/908b6598-c0d3-452f-a3b2-222478faa1f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5ndjt\" (UID: \"908b6598-c0d3-452f-a3b2-222478faa1f1\") " pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:09:07.230172 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:07.230142    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r6bm5\""
Jul 26 16:09:07.237962 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:07.237938    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5ndjt"
Jul 26 16:09:07.360864 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:07.360843    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5ndjt"]
Jul 26 16:09:07.363275 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:09:07.363214    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908b6598_c0d3_452f_a3b2_222478faa1f1.slice/crio-950d09c334e7d5ae7654eb0f3c1512b40436bc158db3ba72e3732e385bb6126f WatchSource:0}: Error finding container 950d09c334e7d5ae7654eb0f3c1512b40436bc158db3ba72e3732e385bb6126f: Status 404 returned error can't find the container with id 950d09c334e7d5ae7654eb0f3c1512b40436bc158db3ba72e3732e385bb6126f
Jul 26 16:09:08.279964 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:08.279928    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5ndjt" event={"ID":"908b6598-c0d3-452f-a3b2-222478faa1f1","Type":"ContainerStarted","Data":"950d09c334e7d5ae7654eb0f3c1512b40436bc158db3ba72e3732e385bb6126f"}
Jul 26 16:09:10.299411 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.299375    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:10.349465 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.349434    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:10.750427 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.750388    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs\") pod \"network-metrics-daemon-x7grb\" (UID: \"47facb48-c30f-47eb-b670-a4ff92388d64\") " pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:09:10.752991 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.752966    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 26 16:09:10.763468 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.763445    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47facb48-c30f-47eb-b670-a4ff92388d64-metrics-certs\") pod \"network-metrics-daemon-x7grb\" (UID: \"47facb48-c30f-47eb-b670-a4ff92388d64\") " pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:09:10.851211 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.851178    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48h99\" (UniqueName: \"kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99\") pod \"network-check-target-4crpp\" (UID: \"7f896b51-c96d-43be-a208-6ef29f15a96e\") " pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:09:10.851211 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.851212    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:09:10.853541 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.853516    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 26 16:09:10.853757 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.853733    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48h99\" (UniqueName: \"kubernetes.io/projected/7f896b51-c96d-43be-a208-6ef29f15a96e-kube-api-access-48h99\") pod \"network-check-target-4crpp\" (UID: \"7f896b51-c96d-43be-a208-6ef29f15a96e\") " pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:09:10.883546 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.883462    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3287a3ce-5acd-45cc-99ca-a0b6bdf6d868-original-pull-secret\") pod \"global-pull-secret-syncer-z5w5l\" (UID: \"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868\") " pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:09:10.962794 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.962767    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6nt9n\""
Jul 26 16:09:10.965678 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.965653    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5w5l"
Jul 26 16:09:10.970805 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.970784    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:09:10.971837 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.971818    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h6wls\""
Jul 26 16:09:10.980770 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:10.980746    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7grb"
Jul 26 16:09:11.481935 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:11.481901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:11.544428 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:11.544399    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:12.723533 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.723502    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4crpp"]
Jul 26 16:09:12.727250 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:09:12.727196    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f896b51_c96d_43be_a208_6ef29f15a96e.slice/crio-07e29b9f7f6118724c50aa8247dc2f5fc1ea4d5349669b1c6ac5d0650b9893a7 WatchSource:0}: Error finding container 07e29b9f7f6118724c50aa8247dc2f5fc1ea4d5349669b1c6ac5d0650b9893a7: Status 404 returned error can't find the container with id 07e29b9f7f6118724c50aa8247dc2f5fc1ea4d5349669b1c6ac5d0650b9893a7
Jul 26 16:09:12.769978 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.769274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:09:12.769978 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.769367    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:09:12.769978 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.769412    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:09:12.769978 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.769442    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:09:12.770483 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.770190    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/976d4655-f3a5-48e1-bc28-64652772d878-service-ca-bundle\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:09:12.773656 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.773631    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/976d4655-f3a5-48e1-bc28-64652772d878-metrics-certs\") pod \"router-default-64c4699495-5f5tt\" (UID: \"976d4655-f3a5-48e1-bc28-64652772d878\") " pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:09:12.774445 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.774426    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls\") pod \"image-registry-55fb749d87-blpw5\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") " pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:09:12.774706 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.774688    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d800c32-37d3-421d-80a3-d0223dc36ca2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5vwjk\" (UID: \"0d800c32-37d3-421d-80a3-d0223dc36ca2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:09:12.870246 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.870222    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:09:12.872273 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.872257    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599cd3cc-a2cc-4359-9dfd-2215960c847b-metrics-tls\") pod \"dns-default-wdzsq\" (UID: \"599cd3cc-a2cc-4359-9dfd-2215960c847b\") " pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:09:12.947553 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.947523    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x7grb"]
Jul 26 16:09:12.953419 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.953400    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z5w5l"]
Jul 26 16:09:12.962006 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.961986    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-krzsv\""
Jul 26 16:09:12.969858 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.969840    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:09:12.980399 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.980381    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zkn5z\""
Jul 26 16:09:12.988705 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.988684    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"
Jul 26 16:09:12.990779 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.990763    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b44x9\""
Jul 26 16:09:12.999714 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:12.999694    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:09:13.002272 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:09:13.002247    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47facb48_c30f_47eb_b670_a4ff92388d64.slice/crio-42d1a4cc16dec34182c9bc5d01423df365ce9d7f44673bf246026f633841a6dc WatchSource:0}: Error finding container 42d1a4cc16dec34182c9bc5d01423df365ce9d7f44673bf246026f633841a6dc: Status 404 returned error can't find the container with id 42d1a4cc16dec34182c9bc5d01423df365ce9d7f44673bf246026f633841a6dc
Jul 26 16:09:13.002815 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:09:13.002798    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3287a3ce_5acd_45cc_99ca_a0b6bdf6d868.slice/crio-d98508e5770ba03a22d00c76675a32d5ccbd5f0f1ca0c1db860e96710b626a77 WatchSource:0}: Error finding container d98508e5770ba03a22d00c76675a32d5ccbd5f0f1ca0c1db860e96710b626a77: Status 404 returned error can't find the container with id d98508e5770ba03a22d00c76675a32d5ccbd5f0f1ca0c1db860e96710b626a77
Jul 26 16:09:13.035232 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.035208    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-grxdp\""
Jul 26 16:09:13.043503 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.043479    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:09:13.171668 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.171433    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk"]
Jul 26 16:09:13.178663 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:09:13.177850    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d800c32_37d3_421d_80a3_d0223dc36ca2.slice/crio-5d5aa99c181b67070bd6534256f6f50af24a1f8221c8c63a6ca841e2b02a2eb0 WatchSource:0}: Error finding container 5d5aa99c181b67070bd6534256f6f50af24a1f8221c8c63a6ca841e2b02a2eb0: Status 404 returned error can't find the container with id 5d5aa99c181b67070bd6534256f6f50af24a1f8221c8c63a6ca841e2b02a2eb0
Jul 26 16:09:13.205656 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.205631    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55fb749d87-blpw5"]
Jul 26 16:09:13.208659 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:09:13.208628    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde76c96_8569_4bc2_99fd_ce2db3047018.slice/crio-c61c573e36305526ff452dbab5842112e3f8149ee15d3160b62d9828bc29ba4d WatchSource:0}: Error finding container c61c573e36305526ff452dbab5842112e3f8149ee15d3160b62d9828bc29ba4d: Status 404 returned error can't find the container with id c61c573e36305526ff452dbab5842112e3f8149ee15d3160b62d9828bc29ba4d
Jul 26 16:09:13.248200 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.248108    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wdzsq"]
Jul 26 16:09:13.252975 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:09:13.252949    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599cd3cc_a2cc_4359_9dfd_2215960c847b.slice/crio-aa674928e8a64157b5e5288fe47dd0e6fe7212e607a4a624b095658a4ac647f5 WatchSource:0}: Error finding container aa674928e8a64157b5e5288fe47dd0e6fe7212e607a4a624b095658a4ac647f5: Status 404 returned error can't find the container with id aa674928e8a64157b5e5288fe47dd0e6fe7212e607a4a624b095658a4ac647f5
Jul 26 16:09:13.300286 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.300258    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdzsq" event={"ID":"599cd3cc-a2cc-4359-9dfd-2215960c847b","Type":"ContainerStarted","Data":"aa674928e8a64157b5e5288fe47dd0e6fe7212e607a4a624b095658a4ac647f5"}
Jul 26 16:09:13.301316 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.301288    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z5w5l" event={"ID":"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868","Type":"ContainerStarted","Data":"d98508e5770ba03a22d00c76675a32d5ccbd5f0f1ca0c1db860e96710b626a77"}
Jul 26 16:09:13.302303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.302286    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk" event={"ID":"0d800c32-37d3-421d-80a3-d0223dc36ca2","Type":"ContainerStarted","Data":"5d5aa99c181b67070bd6534256f6f50af24a1f8221c8c63a6ca841e2b02a2eb0"}
Jul 26 16:09:13.303653 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.303629    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55fb749d87-blpw5" event={"ID":"dde76c96-8569-4bc2-99fd-ce2db3047018","Type":"ContainerStarted","Data":"ad982159318d52ba6c89c74e204b0cef6843a7ed98b1c2ac4ece832525a7104b"}
Jul 26 16:09:13.303748 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.303671    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55fb749d87-blpw5" event={"ID":"dde76c96-8569-4bc2-99fd-ce2db3047018","Type":"ContainerStarted","Data":"c61c573e36305526ff452dbab5842112e3f8149ee15d3160b62d9828bc29ba4d"}
Jul 26 16:09:13.303748 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.303731    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:09:13.304738 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.304717    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x7grb" event={"ID":"47facb48-c30f-47eb-b670-a4ff92388d64","Type":"ContainerStarted","Data":"42d1a4cc16dec34182c9bc5d01423df365ce9d7f44673bf246026f633841a6dc"}
Jul 26 16:09:13.306044 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.306026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5ndjt" event={"ID":"908b6598-c0d3-452f-a3b2-222478faa1f1","Type":"ContainerStarted","Data":"596c74ced623991305126bcb7224f68b48a14af525190707a69a0378216e67d1"}
Jul 26 16:09:13.307404 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.307380    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4crpp" event={"ID":"7f896b51-c96d-43be-a208-6ef29f15a96e","Type":"ContainerStarted","Data":"97305139358d205757f5d70f2c80615143e24c83a2828d2d9d318d48cb5d9838"}
Jul 26 16:09:13.307494 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.307422    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4crpp" event={"ID":"7f896b51-c96d-43be-a208-6ef29f15a96e","Type":"ContainerStarted","Data":"07e29b9f7f6118724c50aa8247dc2f5fc1ea4d5349669b1c6ac5d0650b9893a7"}
Jul 26 16:09:13.307554 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.307522    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:09:13.323894 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.323853    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55fb749d87-blpw5" podStartSLOduration=67.323841268 podStartE2EDuration="1m7.323841268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:13.323647625 +0000 UTC m=+68.858346911" watchObservedRunningTime="2026-07-26 16:09:13.323841268 +0000 UTC m=+68.858540543"
Jul 26 16:09:13.340263 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.340224    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4crpp" podStartSLOduration=67.340211098 podStartE2EDuration="1m7.340211098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:13.339652958 +0000 UTC m=+68.874352232" watchObservedRunningTime="2026-07-26 16:09:13.340211098 +0000 UTC m=+68.874910372"
Jul 26 16:09:13.411002 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:13.410883    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64c4699495-5f5tt"]
Jul 26 16:09:13.413350 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:09:13.413323    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod976d4655_f3a5_48e1_bc28_64652772d878.slice/crio-59bea357a3c4e9a5c59aa3a07c3a001fddf68dff547b5bf03d8a03da4f20f313 WatchSource:0}: Error finding container 59bea357a3c4e9a5c59aa3a07c3a001fddf68dff547b5bf03d8a03da4f20f313: Status 404 returned error can't find the container with id 59bea357a3c4e9a5c59aa3a07c3a001fddf68dff547b5bf03d8a03da4f20f313
Jul 26 16:09:14.270501 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.270465    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:14.310856 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.310819    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-p69hj"]
Jul 26 16:09:14.314831 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.314791    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"]
Jul 26 16:09:14.314958 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.314912    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-p69hj"
Jul 26 16:09:14.321959 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.320725    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 26 16:09:14.321959 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.320864    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 26 16:09:14.321959 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.320725    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vwmvh\""
Jul 26 16:09:14.321959 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.321701    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"
Jul 26 16:09:14.327277 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.325373    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64c4699495-5f5tt" event={"ID":"976d4655-f3a5-48e1-bc28-64652772d878","Type":"ContainerStarted","Data":"9ddc9db713fc0e4319727511af863ad1a72471d8311275e05d394307666126a1"}
Jul 26 16:09:14.327277 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.325415    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64c4699495-5f5tt" event={"ID":"976d4655-f3a5-48e1-bc28-64652772d878","Type":"ContainerStarted","Data":"59bea357a3c4e9a5c59aa3a07c3a001fddf68dff547b5bf03d8a03da4f20f313"}
Jul 26 16:09:14.327277 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.326371    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 26 16:09:14.327277 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.326612    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 26 16:09:14.327277 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.326809    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 26 16:09:14.327277 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.327109    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 26 16:09:14.334287 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.332729    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"]
Jul 26 16:09:14.337625 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.336405    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.339227 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.339056    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 26 16:09:14.339602 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.339465    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 26 16:09:14.342253 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.341779    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 26 16:09:14.342253 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.341998    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 26 16:09:14.344830 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.344812    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-p69hj"]
Jul 26 16:09:14.361013 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.360921    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"]
Jul 26 16:09:14.362757 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.362702    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"]
Jul 26 16:09:14.373718 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.372441    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-595cb6f75b-qg8xp"]
Jul 26 16:09:14.378745 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.378062    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-595cb6f75b-qg8xp"
Jul 26 16:09:14.381832 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.381295    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vsqjn\""
Jul 26 16:09:14.381832 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.381679    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 26 16:09:14.384147 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.384112    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-d78q7"]
Jul 26 16:09:14.388118 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.387441    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-d78q7"
Jul 26 16:09:14.388118 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.387838    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-595cb6f75b-qg8xp"]
Jul 26 16:09:14.390934 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.390698    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gprc4\""
Jul 26 16:09:14.391404 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.391216    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 26 16:09:14.391934 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.391747    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 26 16:09:14.402604 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.401923    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-d78q7"]
Jul 26 16:09:14.423593 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.423497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:14.449922 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.449867    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-64c4699495-5f5tt" podStartSLOduration=57.449845093 podStartE2EDuration="57.449845093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:14.448342491 +0000 UTC m=+69.983041767" watchObservedRunningTime="2026-07-26 16:09:14.449845093 +0000 UTC m=+69.984544370"
Jul 26 16:09:14.482816 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.482781    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/56aba15a-d885-40f5-ba06-0b5bdec50734-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-p69hj\" (UID: \"56aba15a-d885-40f5-ba06-0b5bdec50734\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-p69hj"
Jul 26 16:09:14.483032 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.482963    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/56aba15a-d885-40f5-ba06-0b5bdec50734-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-p69hj\" (UID: \"56aba15a-d885-40f5-ba06-0b5bdec50734\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-p69hj"
Jul 26 16:09:14.483109 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.483051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5178a91-e83d-4e94-9106-80925a81654b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.483177 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.483107    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/984e3dbc-447c-4211-8706-24c4afb727fb-tmp\") pod \"klusterlet-addon-workmgr-7758fc85d5-vpw72\" (UID: \"984e3dbc-447c-4211-8706-24c4afb727fb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"
Jul 26 16:09:14.483228 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.483185    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b5178a91-e83d-4e94-9106-80925a81654b-ca\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.483287 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.483235    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c3f4d26d-6904-4484-8d41-860792b66cc9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-595cb6f75b-qg8xp\" (UID: \"c3f4d26d-6904-4484-8d41-860792b66cc9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-595cb6f75b-qg8xp"
Jul 26 16:09:14.483287 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.483271    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5178a91-e83d-4e94-9106-80925a81654b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.483386 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.483316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6gcg\" (UniqueName: \"kubernetes.io/projected/b5178a91-e83d-4e94-9106-80925a81654b-kube-api-access-n6gcg\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.483386 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.483349    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b5178a91-e83d-4e94-9106-80925a81654b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.483488 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.483441    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/984e3dbc-447c-4211-8706-24c4afb727fb-klusterlet-config\") pod \"klusterlet-addon-workmgr-7758fc85d5-vpw72\" (UID: \"984e3dbc-447c-4211-8706-24c4afb727fb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"
Jul 26 16:09:14.483488 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.483469    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b5178a91-e83d-4e94-9106-80925a81654b-hub\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.483635 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.483547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pss4d\" (UniqueName: \"kubernetes.io/projected/a03e4347-94d0-49b5-90f6-306a15aea353-kube-api-access-pss4d\") pod \"downloads-7c97dc4555-d78q7\" (UID: \"a03e4347-94d0-49b5-90f6-306a15aea353\") " pod="openshift-console/downloads-7c97dc4555-d78q7"
Jul 26 16:09:14.483635 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.483609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldx79\" (UniqueName: \"kubernetes.io/projected/984e3dbc-447c-4211-8706-24c4afb727fb-kube-api-access-ldx79\") pod \"klusterlet-addon-workmgr-7758fc85d5-vpw72\" (UID: \"984e3dbc-447c-4211-8706-24c4afb727fb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"
Jul 26 16:09:14.484984 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.484958    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tf6w\" (UniqueName: \"kubernetes.io/projected/c3f4d26d-6904-4484-8d41-860792b66cc9-kube-api-access-5tf6w\") pod \"managed-serviceaccount-addon-agent-595cb6f75b-qg8xp\" (UID: \"c3f4d26d-6904-4484-8d41-860792b66cc9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-595cb6f75b-qg8xp"
Jul 26 16:09:14.587303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.586147    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c3f4d26d-6904-4484-8d41-860792b66cc9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-595cb6f75b-qg8xp\" (UID: \"c3f4d26d-6904-4484-8d41-860792b66cc9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-595cb6f75b-qg8xp"
Jul 26 16:09:14.587303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.586191    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5178a91-e83d-4e94-9106-80925a81654b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.587303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.586223    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6gcg\" (UniqueName: \"kubernetes.io/projected/b5178a91-e83d-4e94-9106-80925a81654b-kube-api-access-n6gcg\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.587303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.586253    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b5178a91-e83d-4e94-9106-80925a81654b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.587303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.586301    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/984e3dbc-447c-4211-8706-24c4afb727fb-klusterlet-config\") pod \"klusterlet-addon-workmgr-7758fc85d5-vpw72\" (UID: \"984e3dbc-447c-4211-8706-24c4afb727fb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"
Jul 26 16:09:14.587303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.586328    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b5178a91-e83d-4e94-9106-80925a81654b-hub\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.587303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.586363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pss4d\" (UniqueName: \"kubernetes.io/projected/a03e4347-94d0-49b5-90f6-306a15aea353-kube-api-access-pss4d\") pod \"downloads-7c97dc4555-d78q7\" (UID: \"a03e4347-94d0-49b5-90f6-306a15aea353\") " pod="openshift-console/downloads-7c97dc4555-d78q7"
Jul 26 16:09:14.587303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.586408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldx79\" (UniqueName: \"kubernetes.io/projected/984e3dbc-447c-4211-8706-24c4afb727fb-kube-api-access-ldx79\") pod \"klusterlet-addon-workmgr-7758fc85d5-vpw72\" (UID: \"984e3dbc-447c-4211-8706-24c4afb727fb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"
Jul 26 16:09:14.587303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.586438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tf6w\" (UniqueName: \"kubernetes.io/projected/c3f4d26d-6904-4484-8d41-860792b66cc9-kube-api-access-5tf6w\") pod \"managed-serviceaccount-addon-agent-595cb6f75b-qg8xp\" (UID: \"c3f4d26d-6904-4484-8d41-860792b66cc9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-595cb6f75b-qg8xp"
Jul 26 16:09:14.587303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.586474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/56aba15a-d885-40f5-ba06-0b5bdec50734-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-p69hj\" (UID: \"56aba15a-d885-40f5-ba06-0b5bdec50734\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-p69hj"
Jul 26 16:09:14.587303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.586503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/56aba15a-d885-40f5-ba06-0b5bdec50734-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-p69hj\" (UID: \"56aba15a-d885-40f5-ba06-0b5bdec50734\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-p69hj"
Jul 26 16:09:14.587303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.586548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5178a91-e83d-4e94-9106-80925a81654b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.587303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.586583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/984e3dbc-447c-4211-8706-24c4afb727fb-tmp\") pod \"klusterlet-addon-workmgr-7758fc85d5-vpw72\" (UID: \"984e3dbc-447c-4211-8706-24c4afb727fb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"
Jul 26 16:09:14.587303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.586625    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b5178a91-e83d-4e94-9106-80925a81654b-ca\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.590916 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.589102    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/56aba15a-d885-40f5-ba06-0b5bdec50734-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-p69hj\" (UID: \"56aba15a-d885-40f5-ba06-0b5bdec50734\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-p69hj"
Jul 26 16:09:14.590916 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.590114    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5178a91-e83d-4e94-9106-80925a81654b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.604731 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.602174    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/984e3dbc-447c-4211-8706-24c4afb727fb-tmp\") pod \"klusterlet-addon-workmgr-7758fc85d5-vpw72\" (UID: \"984e3dbc-447c-4211-8706-24c4afb727fb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"
Jul 26 16:09:14.604731 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.602757    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5178a91-e83d-4e94-9106-80925a81654b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.604731 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.603605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c3f4d26d-6904-4484-8d41-860792b66cc9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-595cb6f75b-qg8xp\" (UID: \"c3f4d26d-6904-4484-8d41-860792b66cc9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-595cb6f75b-qg8xp"
Jul 26 16:09:14.604731 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.603686    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/984e3dbc-447c-4211-8706-24c4afb727fb-klusterlet-config\") pod \"klusterlet-addon-workmgr-7758fc85d5-vpw72\" (UID: \"984e3dbc-447c-4211-8706-24c4afb727fb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"
Jul 26 16:09:14.604731 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.604150    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b5178a91-e83d-4e94-9106-80925a81654b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.604731 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.604217    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/56aba15a-d885-40f5-ba06-0b5bdec50734-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-p69hj\" (UID: \"56aba15a-d885-40f5-ba06-0b5bdec50734\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-p69hj"
Jul 26 16:09:14.607138 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.606247    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b5178a91-e83d-4e94-9106-80925a81654b-ca\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.610170 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.608346    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:14.623689 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.623624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldx79\" (UniqueName: \"kubernetes.io/projected/984e3dbc-447c-4211-8706-24c4afb727fb-kube-api-access-ldx79\") pod \"klusterlet-addon-workmgr-7758fc85d5-vpw72\" (UID: \"984e3dbc-447c-4211-8706-24c4afb727fb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"
Jul 26 16:09:14.624494 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.624315    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b5178a91-e83d-4e94-9106-80925a81654b-hub\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.625253 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.625208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6gcg\" (UniqueName: \"kubernetes.io/projected/b5178a91-e83d-4e94-9106-80925a81654b-kube-api-access-n6gcg\") pod \"cluster-proxy-proxy-agent-56fb446dd-9lmxs\" (UID: \"b5178a91-e83d-4e94-9106-80925a81654b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.627808 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.627761    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pss4d\" (UniqueName: \"kubernetes.io/projected/a03e4347-94d0-49b5-90f6-306a15aea353-kube-api-access-pss4d\") pod \"downloads-7c97dc4555-d78q7\" (UID: \"a03e4347-94d0-49b5-90f6-306a15aea353\") " pod="openshift-console/downloads-7c97dc4555-d78q7"
Jul 26 16:09:14.628446 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.628427    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tf6w\" (UniqueName: \"kubernetes.io/projected/c3f4d26d-6904-4484-8d41-860792b66cc9-kube-api-access-5tf6w\") pod \"managed-serviceaccount-addon-agent-595cb6f75b-qg8xp\" (UID: \"c3f4d26d-6904-4484-8d41-860792b66cc9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-595cb6f75b-qg8xp"
Jul 26 16:09:14.640397 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.640207    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-p69hj"
Jul 26 16:09:14.651553 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.651511    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"
Jul 26 16:09:14.677229 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.677012    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"
Jul 26 16:09:14.705591 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.705332    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-595cb6f75b-qg8xp"
Jul 26 16:09:14.709380 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.709316    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:14.719462 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.719213    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-d78q7"
Jul 26 16:09:14.854370 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.854259    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-p69hj"]
Jul 26 16:09:14.889075 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:09:14.888452    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56aba15a_d885_40f5_ba06_0b5bdec50734.slice/crio-4dfe9a44ddb69670672397bbe5222eeb9a0d3e4b9ae7df2236b9d384364815c4 WatchSource:0}: Error finding container 4dfe9a44ddb69670672397bbe5222eeb9a0d3e4b9ae7df2236b9d384364815c4: Status 404 returned error can't find the container with id 4dfe9a44ddb69670672397bbe5222eeb9a0d3e4b9ae7df2236b9d384364815c4
Jul 26 16:09:14.913289 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.912747    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"]
Jul 26 16:09:14.935453 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:09:14.935417    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod984e3dbc_447c_4211_8706_24c4afb727fb.slice/crio-74f09b419cfb099f97a621c839c5044d3ad7dbf6367884adc7bf3bc4794a04a2 WatchSource:0}: Error finding container 74f09b419cfb099f97a621c839c5044d3ad7dbf6367884adc7bf3bc4794a04a2: Status 404 returned error can't find the container with id 74f09b419cfb099f97a621c839c5044d3ad7dbf6367884adc7bf3bc4794a04a2
Jul 26 16:09:14.961355 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.961115    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs"]
Jul 26 16:09:14.978728 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:14.978699    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-595cb6f75b-qg8xp"]
Jul 26 16:09:14.984529 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:09:14.984476    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3f4d26d_6904_4484_8d41_860792b66cc9.slice/crio-051ec453529fc8a242f028c17b7d5263b204e7d1bb18099ce688438ba4a023e5 WatchSource:0}: Error finding container 051ec453529fc8a242f028c17b7d5263b204e7d1bb18099ce688438ba4a023e5: Status 404 returned error can't find the container with id 051ec453529fc8a242f028c17b7d5263b204e7d1bb18099ce688438ba4a023e5
Jul 26 16:09:15.001978 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.001330    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:09:15.004085 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.003748    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:09:15.014435 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.014413    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-d78q7"]
Jul 26 16:09:15.019808 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:09:15.019561    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03e4347_94d0_49b5_90f6_306a15aea353.slice/crio-434497a794cd7d484aa081d74fbbb25b118187d2000054addc6ca06c1eddd9f7 WatchSource:0}: Error finding container 434497a794cd7d484aa081d74fbbb25b118187d2000054addc6ca06c1eddd9f7: Status 404 returned error can't find the container with id 434497a794cd7d484aa081d74fbbb25b118187d2000054addc6ca06c1eddd9f7
Jul 26 16:09:15.334119 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.334074    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x7grb" event={"ID":"47facb48-c30f-47eb-b670-a4ff92388d64","Type":"ContainerStarted","Data":"1f7eb027faf244fc5b70620a0a41371594e01b3f0707f9f02095b1b23f86b6b8"}
Jul 26 16:09:15.334544 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.334165    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x7grb" event={"ID":"47facb48-c30f-47eb-b670-a4ff92388d64","Type":"ContainerStarted","Data":"ce1bd1b025a873fb43f2ca2ec8a0b59a94dd4280d941d9522b1ceb9cbbb06b76"}
Jul 26 16:09:15.337695 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.337628    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-d78q7" event={"ID":"a03e4347-94d0-49b5-90f6-306a15aea353","Type":"ContainerStarted","Data":"434497a794cd7d484aa081d74fbbb25b118187d2000054addc6ca06c1eddd9f7"}
Jul 26 16:09:15.340196 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.340151    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-595cb6f75b-qg8xp" event={"ID":"c3f4d26d-6904-4484-8d41-860792b66cc9","Type":"ContainerStarted","Data":"051ec453529fc8a242f028c17b7d5263b204e7d1bb18099ce688438ba4a023e5"}
Jul 26 16:09:15.341756 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.341705    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72" event={"ID":"984e3dbc-447c-4211-8706-24c4afb727fb","Type":"ContainerStarted","Data":"74f09b419cfb099f97a621c839c5044d3ad7dbf6367884adc7bf3bc4794a04a2"}
Jul 26 16:09:15.343782 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.343733    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-p69hj" event={"ID":"56aba15a-d885-40f5-ba06-0b5bdec50734","Type":"ContainerStarted","Data":"4dfe9a44ddb69670672397bbe5222eeb9a0d3e4b9ae7df2236b9d384364815c4"}
Jul 26 16:09:15.346176 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.346110    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs" event={"ID":"b5178a91-e83d-4e94-9106-80925a81654b","Type":"ContainerStarted","Data":"42c52bdf1e512e74aeb7244ee2b6aad2e29befdbc0e664ceae33edb41bd9f0a1"}
Jul 26 16:09:15.346472 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.346427    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:09:15.348208 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.348179    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64c4699495-5f5tt"
Jul 26 16:09:15.351574 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.351527    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x7grb" podStartSLOduration=68.860420146 podStartE2EDuration="1m10.351510586s" totalImagesPullingTime="1.49109044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:15.350909505 +0000 UTC m=+70.885608780" watchObservedRunningTime="2026-07-26 16:09:15.351510586 +0000 UTC m=+70.886209865"
Jul 26 16:09:15.474583 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.474460    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:15.626931 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.626846    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:15.711044 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.711008    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:15.878364 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.878267    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:15.934547 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:15.934379    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:21.442888 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:21.442844    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:22.716006 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:22.715964    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:22.783049 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:22.782998    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:23.507839 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:23.507747    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:23.556176 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:23.556105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:24.827331 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:24.827298    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:24.927450 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:24.927372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:25.450296 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:25.450252    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:25.503503 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:25.503465    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:26.124966 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:26.124931    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:26.226627 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:26.226595    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:27.416479 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.415764    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-595cb6f75b-qg8xp" event={"ID":"c3f4d26d-6904-4484-8d41-860792b66cc9","Type":"ContainerStarted","Data":"127f941a6e0ea7847b4ee6ff9585e9c0474228381f1036d5c059ba69ee68a3d7"}
Jul 26 16:09:27.420304 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.420244    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72" event={"ID":"984e3dbc-447c-4211-8706-24c4afb727fb","Type":"ContainerStarted","Data":"239313579e076fcbc8b43da112be46da4a9d4f5b8c46e5d63c81218ed9bde061"}
Jul 26 16:09:27.420732 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.420694    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"
Jul 26 16:09:27.422571 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.422552    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72"
Jul 26 16:09:27.423052 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.423030    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z5w5l" event={"ID":"3287a3ce-5acd-45cc-99ca-a0b6bdf6d868","Type":"ContainerStarted","Data":"0e0ee7bf424f1c5e964a6ce57798c85c237431a2c7efe6daed26addd28bccd8e"}
Jul 26 16:09:27.426933 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.426861    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5ndjt" event={"ID":"908b6598-c0d3-452f-a3b2-222478faa1f1","Type":"ContainerStarted","Data":"eff56d96be89f70811f67c8a01ddd000cdc428a779c05bc5dcbce01d5023639a"}
Jul 26 16:09:27.429504 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.429444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-p69hj" event={"ID":"56aba15a-d885-40f5-ba06-0b5bdec50734","Type":"ContainerStarted","Data":"9500d6f26072c4a7acb8cf6108d2fe66789d35a6413e17ed80796bceeab7e2ef"}
Jul 26 16:09:27.434786 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.432851    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdzsq" event={"ID":"599cd3cc-a2cc-4359-9dfd-2215960c847b","Type":"ContainerStarted","Data":"44cc126acd62cc9fe02f721c99c829bf256eeac51560fd93d4a966712f1f338c"}
Jul 26 16:09:27.434786 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.432896    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:09:27.434786 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.432919    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdzsq" event={"ID":"599cd3cc-a2cc-4359-9dfd-2215960c847b","Type":"ContainerStarted","Data":"879be5321c8fc4b71e7ca50251c2c9fa6b011bf00cefe5d0577f96210d5468fb"}
Jul 26 16:09:27.434786 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.433600    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-595cb6f75b-qg8xp" podStartSLOduration=1.428537236 podStartE2EDuration="13.433584663s" totalImagesPullingTime="12.005047427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:27.433001444 +0000 UTC m=+82.967700721" watchObservedRunningTime="2026-07-26 16:09:27.433584663 +0000 UTC m=+82.968283940"
Jul 26 16:09:27.438619 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.438430    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs" event={"ID":"b5178a91-e83d-4e94-9106-80925a81654b","Type":"ContainerStarted","Data":"473da857fd7d8c1ab2495fca04adc278efe4e03bbe3953bd7ec7dd87539eaabe"}
Jul 26 16:09:27.438723 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.438635    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs" event={"ID":"b5178a91-e83d-4e94-9106-80925a81654b","Type":"ContainerStarted","Data":"0ee24bc472e235c7511ea7b8d4e433139c03f0948daa8c9a1bd0c031e6880d16"}
Jul 26 16:09:27.440905 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.440850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk" event={"ID":"0d800c32-37d3-421d-80a3-d0223dc36ca2","Type":"ContainerStarted","Data":"2b68fbc1694f37b9e412ffb349dc0921d721db8c5a521b40231b6d10bf95b65c"}
Jul 26 16:09:27.450654 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.450516    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-p69hj" podStartSLOduration=1.334611891 podStartE2EDuration="13.450499816s" totalImagesPullingTime="12.115887925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:27.449890293 +0000 UTC m=+82.984589569" watchObservedRunningTime="2026-07-26 16:09:27.450499816 +0000 UTC m=+82.985199093"
Jul 26 16:09:27.480690 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.480628    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7758fc85d5-vpw72" podStartSLOduration=1.406395063 podStartE2EDuration="13.480609722s" totalImagesPullingTime="12.074214659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:27.47915057 +0000 UTC m=+83.013849846" watchObservedRunningTime="2026-07-26 16:09:27.480609722 +0000 UTC m=+83.015309001"
Jul 26 16:09:27.500773 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.500613    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z5w5l" podStartSLOduration=67.526705106 podStartE2EDuration="1m21.500592438s" totalImagesPullingTime="13.973887332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:27.499409582 +0000 UTC m=+83.034108858" watchObservedRunningTime="2026-07-26 16:09:27.500592438 +0000 UTC m=+83.035291714"
Jul 26 16:09:27.524220 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.524068    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wdzsq" podStartSLOduration=37.546910565 podStartE2EDuration="47.524054111s" totalImagesPullingTime="9.977143546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:27.52372216 +0000 UTC m=+83.058421437" watchObservedRunningTime="2026-07-26 16:09:27.524054111 +0000 UTC m=+83.058753385"
Jul 26 16:09:27.527991 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.527889    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:27.542070 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.542017    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5vwjk" podStartSLOduration=58.447728047 podStartE2EDuration="1m10.541997529s" totalImagesPullingTime="12.094269482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:27.540993791 +0000 UTC m=+83.075693067" watchObservedRunningTime="2026-07-26 16:09:27.541997529 +0000 UTC m=+83.076696806"
Jul 26 16:09:27.559509 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.559461    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs" podStartSLOduration=1.410682952 podStartE2EDuration="13.559442405s" totalImagesPullingTime="12.148759453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:27.55815572 +0000 UTC m=+83.092854995" watchObservedRunningTime="2026-07-26 16:09:27.559442405 +0000 UTC m=+83.094141683"
Jul 26 16:09:27.592402 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.592325    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:27.678410 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.678364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:27.737516 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.737482    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:27.916728 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:27.916469    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:28.450138 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:28.450042    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56fb446dd-9lmxs" event={"ID":"b5178a91-e83d-4e94-9106-80925a81654b","Type":"ContainerStarted","Data":"abe35f51606e39a41901501403188a32f00c126fcbb3a8001d1d95b22ef968af"}
Jul 26 16:09:29.506893 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:29.506855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:31.954964 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:31.954922    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:32.056284 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:32.055992    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:32.706574 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:32.706534    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:32.775734 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:32.775681    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:32.975652 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:32.975562    2559 patch_prober.go:28] interesting pod/image-registry-55fb749d87-blpw5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 26 16:09:32.975652 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:32.975633    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-55fb749d87-blpw5" podUID="dde76c96-8569-4bc2-99fd-ce2db3047018" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 16:09:33.680743 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:33.680708    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:34.330560 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:34.330527    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:09:34.606798 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:34.606716    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:34.695558 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:34.695462    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:34.754950 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:34.754914    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:36.149536 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:36.149500    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:37.452400 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:37.452365    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wdzsq"
Jul 26 16:09:37.785503 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:37.785422    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55fb749d87-blpw5"]
Jul 26 16:09:37.862183 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:37.862149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:37.919109 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:37.919074    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:38.503455 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:38.503365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-d78q7" event={"ID":"a03e4347-94d0-49b5-90f6-306a15aea353","Type":"ContainerStarted","Data":"302bb87c2e8b5c9b20682c68dacae14efdffa80cb5ebf3e8820de9d78063fb9e"}
Jul 26 16:09:38.503455 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:38.503448    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-d78q7"
Jul 26 16:09:38.505002 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:38.504972    2559 patch_prober.go:28] interesting pod/downloads-7c97dc4555-d78q7 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused" start-of-body=
Jul 26 16:09:38.505153 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:38.505020    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-d78q7" podUID="a03e4347-94d0-49b5-90f6-306a15aea353" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 26 16:09:38.505462 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:38.505440    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5ndjt" event={"ID":"908b6598-c0d3-452f-a3b2-222478faa1f1","Type":"ContainerStarted","Data":"f15b56fd89ebb90607a32f2028fd78460daeed3af01d3b9ed787cf1deb2fe427"}
Jul 26 16:09:38.520339 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:38.520298    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-d78q7" podStartSLOduration=1.3169050150000001 podStartE2EDuration="24.520284976s" totalImagesPullingTime="23.203379961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:38.519196234 +0000 UTC m=+94.053895509" watchObservedRunningTime="2026-07-26 16:09:38.520284976 +0000 UTC m=+94.054984251"
Jul 26 16:09:38.536694 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:38.536650    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5ndjt" podStartSLOduration=16.989592689 podStartE2EDuration="47.536637361s" totalImagesPullingTime="30.547044672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:08:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:38.535662737 +0000 UTC m=+94.070362013" watchObservedRunningTime="2026-07-26 16:09:38.536637361 +0000 UTC m=+94.071336636"
Jul 26 16:09:38.846332 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:38.846242    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:38.998971 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:38.998933    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:39.089788 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.089750    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:39.121742 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.121656    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8jkzj"]
Jul 26 16:09:39.132637 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.132608    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.135456 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.135428    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 26 16:09:39.135717 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.135696    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wrthp\""
Jul 26 16:09:39.136421 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.136399    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 26 16:09:39.136931 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.136612    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 26 16:09:39.136931 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.136774    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 26 16:09:39.168629 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.168602    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:39.196921 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.196889    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7458ad5-0758-46c1-99b3-92163e6b04c0-sys\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.197199 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.197165    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.197319 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.197221    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f7458ad5-0758-46c1-99b3-92163e6b04c0-root\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.197319 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.197247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ssgp\" (UniqueName: \"kubernetes.io/projected/f7458ad5-0758-46c1-99b3-92163e6b04c0-kube-api-access-2ssgp\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.197319 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.197280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.197319 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.197309    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-tls\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.197538 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.197339    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-textfile\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.197538 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.197376    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7458ad5-0758-46c1-99b3-92163e6b04c0-metrics-client-ca\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.197538 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.197428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-wtmp\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.298750 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.298715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7458ad5-0758-46c1-99b3-92163e6b04c0-sys\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.299019 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.298993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.299149 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.299040    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f7458ad5-0758-46c1-99b3-92163e6b04c0-root\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.299149 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.299069    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ssgp\" (UniqueName: \"kubernetes.io/projected/f7458ad5-0758-46c1-99b3-92163e6b04c0-kube-api-access-2ssgp\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.299149 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.299116    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.299316 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.299160    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-tls\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.299316 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.299187    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-textfile\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.299316 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.299222    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7458ad5-0758-46c1-99b3-92163e6b04c0-metrics-client-ca\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.299316 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.299274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-wtmp\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.299497 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.299444    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-wtmp\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.299497 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.298841    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7458ad5-0758-46c1-99b3-92163e6b04c0-sys\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.300419 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.300301    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7458ad5-0758-46c1-99b3-92163e6b04c0-metrics-client-ca\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.300419 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.300376    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f7458ad5-0758-46c1-99b3-92163e6b04c0-root\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.300419 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.300378    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.300947 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.300926    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-textfile\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.303567 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.303193    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-tls\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.303567 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.303525    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7458ad5-0758-46c1-99b3-92163e6b04c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.307589 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.307563    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ssgp\" (UniqueName: \"kubernetes.io/projected/f7458ad5-0758-46c1-99b3-92163e6b04c0-kube-api-access-2ssgp\") pod \"node-exporter-8jkzj\" (UID: \"f7458ad5-0758-46c1-99b3-92163e6b04c0\") " pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.356798 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.356716    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:39.447346 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.447314    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8jkzj"
Jul 26 16:09:39.512806 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.512768    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8jkzj" event={"ID":"f7458ad5-0758-46c1-99b3-92163e6b04c0","Type":"ContainerStarted","Data":"d50f10d735f72799897850a96705e50e713898611dc970eb2a19b15915c2de76"}
Jul 26 16:09:39.524570 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.524542    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-d78q7"
Jul 26 16:09:39.707763 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:39.707673    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:40.079196 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:40.079100    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:40.166461 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:40.166388    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:40.279347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:40.278783    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:40.337333 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:40.337240    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:41.480429 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:41.480378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:41.525237 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:41.525191    2559 generic.go:356] "Generic (PLEG): container finished" podID="f7458ad5-0758-46c1-99b3-92163e6b04c0" containerID="fa45f1a7de0c2d7e81b1aaaab24a9ecc25f59cc6aec3c6eb6ddcfd1ecac427ab" exitCode=0
Jul 26 16:09:41.525363 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:41.525275    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8jkzj" event={"ID":"f7458ad5-0758-46c1-99b3-92163e6b04c0","Type":"ContainerDied","Data":"fa45f1a7de0c2d7e81b1aaaab24a9ecc25f59cc6aec3c6eb6ddcfd1ecac427ab"}
Jul 26 16:09:41.551256 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:41.551228    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:42.046982 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:42.046873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:42.145176 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:42.145145    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:42.486785 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:42.486742    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:42.532781 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:42.532743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8jkzj" event={"ID":"f7458ad5-0758-46c1-99b3-92163e6b04c0","Type":"ContainerStarted","Data":"67c6d69e73c684151cd67ebae7bb66aec1d02762b8f00c287162a7c5de1cc2b2"}
Jul 26 16:09:42.532939 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:42.532815    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8jkzj" event={"ID":"f7458ad5-0758-46c1-99b3-92163e6b04c0","Type":"ContainerStarted","Data":"30ee33e3000376c656925fa5a2026532692c31f48695721491fa7d83c962953d"}
Jul 26 16:09:42.551088 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:42.551035    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8jkzj" podStartSLOduration=1.765859298 podStartE2EDuration="3.551018794s" totalImagesPullingTime="1.685686157s" totalInitContainerRuntime="99.473339ms" isStatefulPod=true podCreationTimestamp="2026-07-26 16:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:42.549810363 +0000 UTC m=+98.084509640" watchObservedRunningTime="2026-07-26 16:09:42.551018794 +0000 UTC m=+98.085718071"
Jul 26 16:09:42.554527 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:42.554497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:42.686928 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:42.686889    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:43.224280 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:43.224246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:43.872220 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:43.872190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:43.930361 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:43.930327    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:44.221691 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:44.221660    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:44.328199 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:44.328168    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4crpp"
Jul 26 16:09:44.392116 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:44.392076    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:44.445804 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:44.445766    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:45.117411 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:45.117373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:45.214638 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:45.214580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:45.416190 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:45.416103    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:45.974902 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:45.974862    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:46.073576 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:46.073520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:47.342820 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:47.342775    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:47.444490 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:47.444451    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:47.543255 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:47.543223    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:51.114093 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:51.114051    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:51.169354 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:51.169326    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:51.906938 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:51.906901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:52.007894 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:52.007850    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:55.562563 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:55.562532    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:55.586901 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:55.586873    2559 generic.go:356] "Generic (PLEG): container finished" podID="a6c5fb98-fd57-4375-bfd8-9b3007965d80" containerID="c1eae1ffdad8c2cb4cd808cf407a8b4069f918e1fd66d3e038a88312efecdd73" exitCode=0
Jul 26 16:09:55.587042 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:55.586947    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-qvvws" event={"ID":"a6c5fb98-fd57-4375-bfd8-9b3007965d80","Type":"ContainerDied","Data":"c1eae1ffdad8c2cb4cd808cf407a8b4069f918e1fd66d3e038a88312efecdd73"}
Jul 26 16:09:55.587322 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:55.587307    2559 scope.go:117] "RemoveContainer" containerID="c1eae1ffdad8c2cb4cd808cf407a8b4069f918e1fd66d3e038a88312efecdd73"
Jul 26 16:09:55.663192 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:55.663149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:55.762921 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:55.762885    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:56.484081 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:56.484047    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:56.563948 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:56.563913    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:56.594316 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:56.594287    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-qvvws" event={"ID":"a6c5fb98-fd57-4375-bfd8-9b3007965d80","Type":"ContainerStarted","Data":"817a1aa936ba878f84fe42621d0f3fb703afa5812e6fc14be3d8c002f4e1c1cf"}
Jul 26 16:09:56.645766 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:56.645733    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:56.751430 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:56.751356    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:56.847053 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:56.847017    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:09:56.948251 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:09:56.948217    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:10:00.612193 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:00.612155    2559 generic.go:356] "Generic (PLEG): container finished" podID="970557d5-5925-4ba0-bb27-5cf4c9ff0ec1" containerID="4e5da7460202109f1cc288398b360f50f401b540eebac6078f99c5d3e34798a3" exitCode=0
Jul 26 16:10:00.612643 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:00.612212    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c" event={"ID":"970557d5-5925-4ba0-bb27-5cf4c9ff0ec1","Type":"ContainerDied","Data":"4e5da7460202109f1cc288398b360f50f401b540eebac6078f99c5d3e34798a3"}
Jul 26 16:10:00.612643 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:00.612566    2559 scope.go:117] "RemoveContainer" containerID="4e5da7460202109f1cc288398b360f50f401b540eebac6078f99c5d3e34798a3"
Jul 26 16:10:01.617408 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:01.617373    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9sx8c" event={"ID":"970557d5-5925-4ba0-bb27-5cf4c9ff0ec1","Type":"ContainerStarted","Data":"cf921be144f34617b20a9f6040bea0ca44325a61aa83a153ef8b72ef2ce66974"}
Jul 26 16:10:02.804654 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:02.804615    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-55fb749d87-blpw5" podUID="dde76c96-8569-4bc2-99fd-ce2db3047018" containerName="registry" containerID="cri-o://ad982159318d52ba6c89c74e204b0cef6843a7ed98b1c2ac4ece832525a7104b" gracePeriod=30
Jul 26 16:10:03.082108 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.082044    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:10:03.201446 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.201410    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-certificates\") pod \"dde76c96-8569-4bc2-99fd-ce2db3047018\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") "
Jul 26 16:10:03.201446 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.201451    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dde76c96-8569-4bc2-99fd-ce2db3047018-image-registry-private-configuration\") pod \"dde76c96-8569-4bc2-99fd-ce2db3047018\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") "
Jul 26 16:10:03.201694 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.201494    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dde76c96-8569-4bc2-99fd-ce2db3047018-trusted-ca\") pod \"dde76c96-8569-4bc2-99fd-ce2db3047018\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") "
Jul 26 16:10:03.201694 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.201512    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dde76c96-8569-4bc2-99fd-ce2db3047018-installation-pull-secrets\") pod \"dde76c96-8569-4bc2-99fd-ce2db3047018\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") "
Jul 26 16:10:03.201694 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.201547    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m56kr\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-kube-api-access-m56kr\") pod \"dde76c96-8569-4bc2-99fd-ce2db3047018\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") "
Jul 26 16:10:03.201694 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.201584    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dde76c96-8569-4bc2-99fd-ce2db3047018-ca-trust-extracted\") pod \"dde76c96-8569-4bc2-99fd-ce2db3047018\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") "
Jul 26 16:10:03.201694 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.201617    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls\") pod \"dde76c96-8569-4bc2-99fd-ce2db3047018\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") "
Jul 26 16:10:03.201694 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.201651    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-bound-sa-token\") pod \"dde76c96-8569-4bc2-99fd-ce2db3047018\" (UID: \"dde76c96-8569-4bc2-99fd-ce2db3047018\") "
Jul 26 16:10:03.201992 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.201931    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dde76c96-8569-4bc2-99fd-ce2db3047018-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dde76c96-8569-4bc2-99fd-ce2db3047018" (UID: "dde76c96-8569-4bc2-99fd-ce2db3047018"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:10:03.201992 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.201946    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dde76c96-8569-4bc2-99fd-ce2db3047018" (UID: "dde76c96-8569-4bc2-99fd-ce2db3047018"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:10:03.204249 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.204220    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dde76c96-8569-4bc2-99fd-ce2db3047018" (UID: "dde76c96-8569-4bc2-99fd-ce2db3047018"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:10:03.204249 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.204234    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dde76c96-8569-4bc2-99fd-ce2db3047018-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dde76c96-8569-4bc2-99fd-ce2db3047018" (UID: "dde76c96-8569-4bc2-99fd-ce2db3047018"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:10:03.204429 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.204308    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-kube-api-access-m56kr" (OuterVolumeSpecName: "kube-api-access-m56kr") pod "dde76c96-8569-4bc2-99fd-ce2db3047018" (UID: "dde76c96-8569-4bc2-99fd-ce2db3047018"). InnerVolumeSpecName "kube-api-access-m56kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:10:03.204429 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.204378    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dde76c96-8569-4bc2-99fd-ce2db3047018-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dde76c96-8569-4bc2-99fd-ce2db3047018" (UID: "dde76c96-8569-4bc2-99fd-ce2db3047018"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:10:03.204429 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.204403    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dde76c96-8569-4bc2-99fd-ce2db3047018" (UID: "dde76c96-8569-4bc2-99fd-ce2db3047018"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:10:03.210524 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.210498    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dde76c96-8569-4bc2-99fd-ce2db3047018-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dde76c96-8569-4bc2-99fd-ce2db3047018" (UID: "dde76c96-8569-4bc2-99fd-ce2db3047018"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:10:03.302970 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.302937    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-bound-sa-token\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:10:03.302970 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.302963    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-certificates\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:10:03.303172 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.302975    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dde76c96-8569-4bc2-99fd-ce2db3047018-image-registry-private-configuration\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:10:03.303172 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.302985    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dde76c96-8569-4bc2-99fd-ce2db3047018-trusted-ca\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:10:03.303172 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.302993    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dde76c96-8569-4bc2-99fd-ce2db3047018-installation-pull-secrets\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:10:03.303172 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.303001    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m56kr\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-kube-api-access-m56kr\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:10:03.303172 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.303009    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dde76c96-8569-4bc2-99fd-ce2db3047018-ca-trust-extracted\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:10:03.303172 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.303017    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dde76c96-8569-4bc2-99fd-ce2db3047018-registry-tls\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:10:03.626248 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.626213    2559 generic.go:356] "Generic (PLEG): container finished" podID="dde76c96-8569-4bc2-99fd-ce2db3047018" containerID="ad982159318d52ba6c89c74e204b0cef6843a7ed98b1c2ac4ece832525a7104b" exitCode=0
Jul 26 16:10:03.626417 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.626257    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55fb749d87-blpw5"
Jul 26 16:10:03.626417 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.626281    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55fb749d87-blpw5" event={"ID":"dde76c96-8569-4bc2-99fd-ce2db3047018","Type":"ContainerDied","Data":"ad982159318d52ba6c89c74e204b0cef6843a7ed98b1c2ac4ece832525a7104b"}
Jul 26 16:10:03.626417 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.626321    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55fb749d87-blpw5" event={"ID":"dde76c96-8569-4bc2-99fd-ce2db3047018","Type":"ContainerDied","Data":"c61c573e36305526ff452dbab5842112e3f8149ee15d3160b62d9828bc29ba4d"}
Jul 26 16:10:03.626417 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.626341    2559 scope.go:117] "RemoveContainer" containerID="ad982159318d52ba6c89c74e204b0cef6843a7ed98b1c2ac4ece832525a7104b"
Jul 26 16:10:03.641674 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.641654    2559 scope.go:117] "RemoveContainer" containerID="ad982159318d52ba6c89c74e204b0cef6843a7ed98b1c2ac4ece832525a7104b"
Jul 26 16:10:03.641912 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:10:03.641893    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad982159318d52ba6c89c74e204b0cef6843a7ed98b1c2ac4ece832525a7104b\": container with ID starting with ad982159318d52ba6c89c74e204b0cef6843a7ed98b1c2ac4ece832525a7104b not found: ID does not exist" containerID="ad982159318d52ba6c89c74e204b0cef6843a7ed98b1c2ac4ece832525a7104b"
Jul 26 16:10:03.641983 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.641918    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad982159318d52ba6c89c74e204b0cef6843a7ed98b1c2ac4ece832525a7104b"} err="failed to get container status \"ad982159318d52ba6c89c74e204b0cef6843a7ed98b1c2ac4ece832525a7104b\": rpc error: code = NotFound desc = could not find container \"ad982159318d52ba6c89c74e204b0cef6843a7ed98b1c2ac4ece832525a7104b\": container with ID starting with ad982159318d52ba6c89c74e204b0cef6843a7ed98b1c2ac4ece832525a7104b not found: ID does not exist"
Jul 26 16:10:03.653026 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.653004    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55fb749d87-blpw5"]
Jul 26 16:10:03.657512 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:03.657490    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55fb749d87-blpw5"]
Jul 26 16:10:04.953493 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:04.953462    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dde76c96-8569-4bc2-99fd-ce2db3047018" path="/var/lib/kubelet/pods/dde76c96-8569-4bc2-99fd-ce2db3047018/volumes"
Jul 26 16:10:10.943252 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:10.943221    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:10:11.488747 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:11.488709    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:10:11.551633 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:11.551607    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:10:20.692099 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:20.692064    2559 generic.go:356] "Generic (PLEG): container finished" podID="864a4462-7451-4c85-8863-6a4ec9140c77" containerID="9e1cd07aa64bd638131d5a585f6ae953e57282d70349c4dcb518e7ff3cdb7be7" exitCode=0
Jul 26 16:10:20.692544 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:20.692157    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25" event={"ID":"864a4462-7451-4c85-8863-6a4ec9140c77","Type":"ContainerDied","Data":"9e1cd07aa64bd638131d5a585f6ae953e57282d70349c4dcb518e7ff3cdb7be7"}
Jul 26 16:10:20.692544 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:20.692453    2559 scope.go:117] "RemoveContainer" containerID="9e1cd07aa64bd638131d5a585f6ae953e57282d70349c4dcb518e7ff3cdb7be7"
Jul 26 16:10:21.697788 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:21.697754    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25" event={"ID":"864a4462-7451-4c85-8863-6a4ec9140c77","Type":"ContainerStarted","Data":"26ab9cca3d22c31223f3dee6035524201e5c3335a01c4169e7f1bb7e55c17650"}
Jul 26 16:10:58.372741 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:58.372657    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:10:58.479490 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:10:58.479452    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:06.553434 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:06.553395    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:06.645525 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:06.645492    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:06.746400 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:06.746364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:07.265594 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:07.265562    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:13.613079 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:13.613038    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:13.677544 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:13.677517    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:17.951627 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:17.951580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:18.003185 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:18.003145    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:18.266632 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:18.266550    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:18.317900 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:18.317864    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:18.875648 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:18.875609    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:18.924659 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:18.924627    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:19.676133 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:19.676098    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:19.728248 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:19.728213    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:25.562435 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:25.562404    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:25.612922 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:25.612884    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:28.962449 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:28.962402    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:29.066182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:29.066148    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:29.116550 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:29.116514    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:41.494070 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:41.494031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:41.593337 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:41.593311    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:11:49.412394 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:11:49.412355    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:12:44.086193 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:12:44.086094    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:12:44.182797 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:12:44.182761    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:04.883492 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:04.883459    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:13:04.893498 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:04.893467    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 26 16:13:04.894154 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:04.894113    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:13:10.727340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:10.727302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:11.785805 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:11.785769    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:14.098657 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:14.098620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:14.333671 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:14.333640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:14.432662 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:14.432630    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:15.412824 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:15.412781    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:15.513365 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:15.513324    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:15.624888 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:15.624851    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:15.729473 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:15.729440    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:17.802977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:17.802941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:18.213357 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:18.213322    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:19.379047 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:19.379013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:21.331422 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:21.331384    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:21.432313 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:21.432274    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:25.009009 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:25.008979    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:31.747345 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:31.747297    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:31.847140 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:31.847083    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:38.367347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:38.367308    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:38.474010 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:38.473974    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:40.099044 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:40.099010    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:43.274246 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:43.274215    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:47.520300 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:47.520261    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:47.569667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:47.569632    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:53.138486 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:53.138451    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:53.238079 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:53.238042    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:53.756428 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:53.756390    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:53.983271 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:53.983239    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:54.083896 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.083801    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:54.136626 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.136584    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"]
Jul 26 16:13:54.136874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.136863    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde76c96-8569-4bc2-99fd-ce2db3047018" containerName="registry"
Jul 26 16:13:54.136916 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.136876    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde76c96-8569-4bc2-99fd-ce2db3047018" containerName="registry"
Jul 26 16:13:54.136954 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.136934    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dde76c96-8569-4bc2-99fd-ce2db3047018" containerName="registry"
Jul 26 16:13:54.139836 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.139820    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.143508 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.143490    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 26 16:13:54.143905 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.143891    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 26 16:13:54.150102 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.150082    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 26 16:13:54.150914 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.150897    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 26 16:13:54.150971 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.150954    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lg5vj\""
Jul 26 16:13:54.163987 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.163965    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"]
Jul 26 16:13:54.246331 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.246294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.246499 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.246335    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-manifests\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.246499 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.246417    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-tmp\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.246499 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.246464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.246634 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.246499    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9chsb\" (UniqueName: \"kubernetes.io/projected/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-kube-api-access-9chsb\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.319463 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.319427    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:54.347447 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.347379    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.347447 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.347418    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9chsb\" (UniqueName: \"kubernetes.io/projected/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-kube-api-access-9chsb\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.347447 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.347448    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.347673 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.347465    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-manifests\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.347673 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.347496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-tmp\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.347974 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.347953    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-manifests\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.349659 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.349639    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-tmp\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.349957 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.349939    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.350021 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.349952    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.357781 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.357755    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9chsb\" (UniqueName: \"kubernetes.io/projected/87d59085-2ddc-4e68-bcc1-e9d100dd24c2-kube-api-access-9chsb\") pod \"opendatahub-operator-controller-manager-7bd4986cdb-g4hhm\" (UID: \"87d59085-2ddc-4e68-bcc1-e9d100dd24c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.419071 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.419046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:54.448964 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.448942    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:13:54.535033 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.534983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:54.604137 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.604103    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"]
Jul 26 16:13:54.606747 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:13:54.606723    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d59085_2ddc_4e68_bcc1_e9d100dd24c2.slice/crio-bac499662f19fce17a284581b38cfb882fe90c380e976eb0bc604d373ac54b8e WatchSource:0}: Error finding container bac499662f19fce17a284581b38cfb882fe90c380e976eb0bc604d373ac54b8e: Status 404 returned error can't find the container with id bac499662f19fce17a284581b38cfb882fe90c380e976eb0bc604d373ac54b8e
Jul 26 16:13:54.609379 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.609360    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 16:13:54.651768 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.651732    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:54.756883 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.756849    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:54.855420 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.855334    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:54.973431 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:54.973400    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:13:55.511720 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:55.511682    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm" event={"ID":"87d59085-2ddc-4e68-bcc1-e9d100dd24c2","Type":"ContainerStarted","Data":"bac499662f19fce17a284581b38cfb882fe90c380e976eb0bc604d373ac54b8e"}
Jul 26 16:13:58.526939 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:58.526906    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm" event={"ID":"87d59085-2ddc-4e68-bcc1-e9d100dd24c2","Type":"ContainerStarted","Data":"6ba2674a504a5ec88009844cb6f68eb2e12d3a34c09634faa92e41607204effc"}
Jul 26 16:13:59.532827 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:59.532791    2559 generic.go:356] "Generic (PLEG): container finished" podID="87d59085-2ddc-4e68-bcc1-e9d100dd24c2" containerID="6ba2674a504a5ec88009844cb6f68eb2e12d3a34c09634faa92e41607204effc" exitCode=0
Jul 26 16:13:59.533215 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:13:59.532848    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm" event={"ID":"87d59085-2ddc-4e68-bcc1-e9d100dd24c2","Type":"ContainerDied","Data":"6ba2674a504a5ec88009844cb6f68eb2e12d3a34c09634faa92e41607204effc"}
Jul 26 16:14:00.538565 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:00.538531    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm" event={"ID":"87d59085-2ddc-4e68-bcc1-e9d100dd24c2","Type":"ContainerStarted","Data":"5c65ef314b13e7b9397b7afa91ee81815ab4e058e53597f18e0c5d42b677efe0"}
Jul 26 16:14:00.538938 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:00.538665    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:14:00.565295 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:00.565244    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm" podStartSLOduration=2.127187092 podStartE2EDuration="6.565227681s" totalImagesPullingTime="3.369060783s" totalInitContainerRuntime="1.068979806s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:13:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:14:00.564187849 +0000 UTC m=+356.098887124" watchObservedRunningTime="2026-07-26 16:14:00.565227681 +0000 UTC m=+356.099926956"
Jul 26 16:14:03.130600 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:03.130563    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:03.231868 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:03.231829    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:05.371689 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:05.371658    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:05.470047 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:05.470017    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:11.544791 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:11.544761    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bd4986cdb-g4hhm"
Jul 26 16:14:13.565613 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:13.565577    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:13.658303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:13.658270    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:14.080580 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.080535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:14.147955 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.147925    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm"]
Jul 26 16:14:14.160204 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.160178    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm"
Jul 26 16:14:14.162786 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.162763    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm"]
Jul 26 16:14:14.163340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.163315    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-k82ck\""
Jul 26 16:14:14.164816 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.164795    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 26 16:14:14.164816 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.164806    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 26 16:14:14.215596 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.215553    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:14.277883 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.277847    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jrmqn"]
Jul 26 16:14:14.281023 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.281008    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jrmqn"
Jul 26 16:14:14.285364 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.285345    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kdpvg\""
Jul 26 16:14:14.285488 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.285397    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 26 16:14:14.301225 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.301195    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jrmqn"]
Jul 26 16:14:14.306271 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.306248    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5v4d\" (UniqueName: \"kubernetes.io/projected/7afe94df-ac8d-4d8a-8e17-f24a6f05c6db-kube-api-access-j5v4d\") pod \"kube-auth-proxy-6ff4cb76d8-nbhzm\" (UID: \"7afe94df-ac8d-4d8a-8e17-f24a6f05c6db\") " pod="openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm"
Jul 26 16:14:14.306384 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.306284    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7afe94df-ac8d-4d8a-8e17-f24a6f05c6db-tmp\") pod \"kube-auth-proxy-6ff4cb76d8-nbhzm\" (UID: \"7afe94df-ac8d-4d8a-8e17-f24a6f05c6db\") " pod="openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm"
Jul 26 16:14:14.306384 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.306340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7afe94df-ac8d-4d8a-8e17-f24a6f05c6db-tls-certs\") pod \"kube-auth-proxy-6ff4cb76d8-nbhzm\" (UID: \"7afe94df-ac8d-4d8a-8e17-f24a6f05c6db\") " pod="openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm"
Jul 26 16:14:14.323395 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.323365    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:14.382550 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.382479    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:14.407461 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.407427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5v4d\" (UniqueName: \"kubernetes.io/projected/7afe94df-ac8d-4d8a-8e17-f24a6f05c6db-kube-api-access-j5v4d\") pod \"kube-auth-proxy-6ff4cb76d8-nbhzm\" (UID: \"7afe94df-ac8d-4d8a-8e17-f24a6f05c6db\") " pod="openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm"
Jul 26 16:14:14.407574 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.407481    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhpzj\" (UniqueName: \"kubernetes.io/projected/f98a39dd-5919-43c5-8ce6-9f90b20fa92a-kube-api-access-jhpzj\") pod \"odh-model-controller-7998c67dc4-jrmqn\" (UID: \"f98a39dd-5919-43c5-8ce6-9f90b20fa92a\") " pod="opendatahub/odh-model-controller-7998c67dc4-jrmqn"
Jul 26 16:14:14.407574 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.407519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7afe94df-ac8d-4d8a-8e17-f24a6f05c6db-tmp\") pod \"kube-auth-proxy-6ff4cb76d8-nbhzm\" (UID: \"7afe94df-ac8d-4d8a-8e17-f24a6f05c6db\") " pod="openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm"
Jul 26 16:14:14.407688 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.407601    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7afe94df-ac8d-4d8a-8e17-f24a6f05c6db-tls-certs\") pod \"kube-auth-proxy-6ff4cb76d8-nbhzm\" (UID: \"7afe94df-ac8d-4d8a-8e17-f24a6f05c6db\") " pod="openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm"
Jul 26 16:14:14.407688 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.407675    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f98a39dd-5919-43c5-8ce6-9f90b20fa92a-cert\") pod \"odh-model-controller-7998c67dc4-jrmqn\" (UID: \"f98a39dd-5919-43c5-8ce6-9f90b20fa92a\") " pod="opendatahub/odh-model-controller-7998c67dc4-jrmqn"
Jul 26 16:14:14.409941 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.409922    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7afe94df-ac8d-4d8a-8e17-f24a6f05c6db-tmp\") pod \"kube-auth-proxy-6ff4cb76d8-nbhzm\" (UID: \"7afe94df-ac8d-4d8a-8e17-f24a6f05c6db\") " pod="openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm"
Jul 26 16:14:14.410054 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.410023    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7afe94df-ac8d-4d8a-8e17-f24a6f05c6db-tls-certs\") pod \"kube-auth-proxy-6ff4cb76d8-nbhzm\" (UID: \"7afe94df-ac8d-4d8a-8e17-f24a6f05c6db\") " pod="openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm"
Jul 26 16:14:14.415859 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.415838    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5v4d\" (UniqueName: \"kubernetes.io/projected/7afe94df-ac8d-4d8a-8e17-f24a6f05c6db-kube-api-access-j5v4d\") pod \"kube-auth-proxy-6ff4cb76d8-nbhzm\" (UID: \"7afe94df-ac8d-4d8a-8e17-f24a6f05c6db\") " pod="openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm"
Jul 26 16:14:14.470927 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.470906    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm"
Jul 26 16:14:14.482484 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.482459    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:14.508671 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.508643    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f98a39dd-5919-43c5-8ce6-9f90b20fa92a-cert\") pod \"odh-model-controller-7998c67dc4-jrmqn\" (UID: \"f98a39dd-5919-43c5-8ce6-9f90b20fa92a\") " pod="opendatahub/odh-model-controller-7998c67dc4-jrmqn"
Jul 26 16:14:14.508785 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.508723    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhpzj\" (UniqueName: \"kubernetes.io/projected/f98a39dd-5919-43c5-8ce6-9f90b20fa92a-kube-api-access-jhpzj\") pod \"odh-model-controller-7998c67dc4-jrmqn\" (UID: \"f98a39dd-5919-43c5-8ce6-9f90b20fa92a\") " pod="opendatahub/odh-model-controller-7998c67dc4-jrmqn"
Jul 26 16:14:14.510840 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.510809    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f98a39dd-5919-43c5-8ce6-9f90b20fa92a-cert\") pod \"odh-model-controller-7998c67dc4-jrmqn\" (UID: \"f98a39dd-5919-43c5-8ce6-9f90b20fa92a\") " pod="opendatahub/odh-model-controller-7998c67dc4-jrmqn"
Jul 26 16:14:14.516668 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.516647    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhpzj\" (UniqueName: \"kubernetes.io/projected/f98a39dd-5919-43c5-8ce6-9f90b20fa92a-kube-api-access-jhpzj\") pod \"odh-model-controller-7998c67dc4-jrmqn\" (UID: \"f98a39dd-5919-43c5-8ce6-9f90b20fa92a\") " pod="opendatahub/odh-model-controller-7998c67dc4-jrmqn"
Jul 26 16:14:14.590596 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.590567    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jrmqn"
Jul 26 16:14:14.598613 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.598571    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm"]
Jul 26 16:14:14.601359 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:14:14.601332    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7afe94df_ac8d_4d8a_8e17_f24a6f05c6db.slice/crio-d68d53fc2b10228088a41b5d42da67fdd190feb73f31cdbf4fd8147c02898f92 WatchSource:0}: Error finding container d68d53fc2b10228088a41b5d42da67fdd190feb73f31cdbf4fd8147c02898f92: Status 404 returned error can't find the container with id d68d53fc2b10228088a41b5d42da67fdd190feb73f31cdbf4fd8147c02898f92
Jul 26 16:14:14.724444 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:14.724413    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jrmqn"]
Jul 26 16:14:14.727502 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:14:14.727475    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf98a39dd_5919_43c5_8ce6_9f90b20fa92a.slice/crio-205213a27dfc1a3dd7a7ee2b89c7193e1a9c4ff77a274810c9cc8f20e3545375 WatchSource:0}: Error finding container 205213a27dfc1a3dd7a7ee2b89c7193e1a9c4ff77a274810c9cc8f20e3545375: Status 404 returned error can't find the container with id 205213a27dfc1a3dd7a7ee2b89c7193e1a9c4ff77a274810c9cc8f20e3545375
Jul 26 16:14:15.142354 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.142324    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mczbl"]
Jul 26 16:14:15.147010 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.146995    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-mczbl"
Jul 26 16:14:15.149278 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.149251    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 26 16:14:15.155230 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.155204    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mczbl"]
Jul 26 16:14:15.172066 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.172038    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:15.315902 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.315866    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xv74\" (UniqueName: \"kubernetes.io/projected/6b5f62b4-cbc0-43b1-8e39-ff053ef4c392-kube-api-access-6xv74\") pod \"model-serving-api-54d89bd5fc-mczbl\" (UID: \"6b5f62b4-cbc0-43b1-8e39-ff053ef4c392\") " pod="opendatahub/model-serving-api-54d89bd5fc-mczbl"
Jul 26 16:14:15.316059 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.315985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b5f62b4-cbc0-43b1-8e39-ff053ef4c392-tls-certs\") pod \"model-serving-api-54d89bd5fc-mczbl\" (UID: \"6b5f62b4-cbc0-43b1-8e39-ff053ef4c392\") " pod="opendatahub/model-serving-api-54d89bd5fc-mczbl"
Jul 26 16:14:15.330849 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.330795    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:15.332258 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.332233    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"]
Jul 26 16:14:15.335942 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.335924    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.338739 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.338718    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 26 16:14:15.339161 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.339042    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 26 16:14:15.339161 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.339065    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gxk9t\""
Jul 26 16:14:15.339561 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.339539    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 26 16:14:15.339690 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.339586    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 26 16:14:15.348563 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.348395    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"]
Jul 26 16:14:15.412388 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.412318    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:15.416838 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.416806    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvrjh\" (UniqueName: \"kubernetes.io/projected/a073b763-1771-4f03-999a-99c036e854ec-kube-api-access-tvrjh\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.417024 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.416862    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a073b763-1771-4f03-999a-99c036e854ec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.417024 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.416908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a073b763-1771-4f03-999a-99c036e854ec-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.417024 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.416939    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.417024 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.416966    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.417024 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.416998    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b5f62b4-cbc0-43b1-8e39-ff053ef4c392-tls-certs\") pod \"model-serving-api-54d89bd5fc-mczbl\" (UID: \"6b5f62b4-cbc0-43b1-8e39-ff053ef4c392\") " pod="opendatahub/model-serving-api-54d89bd5fc-mczbl"
Jul 26 16:14:15.417353 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.417044    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.417353 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.417081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a073b763-1771-4f03-999a-99c036e854ec-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.417353 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.417156    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xv74\" (UniqueName: \"kubernetes.io/projected/6b5f62b4-cbc0-43b1-8e39-ff053ef4c392-kube-api-access-6xv74\") pod \"model-serving-api-54d89bd5fc-mczbl\" (UID: \"6b5f62b4-cbc0-43b1-8e39-ff053ef4c392\") " pod="opendatahub/model-serving-api-54d89bd5fc-mczbl"
Jul 26 16:14:15.417616 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:14:15.417595    2559 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 26 16:14:15.417684 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:14:15.417674    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5f62b4-cbc0-43b1-8e39-ff053ef4c392-tls-certs podName:6b5f62b4-cbc0-43b1-8e39-ff053ef4c392 nodeName:}" failed. No retries permitted until 2026-07-26 16:14:15.917652474 +0000 UTC m=+371.452351728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6b5f62b4-cbc0-43b1-8e39-ff053ef4c392-tls-certs") pod "model-serving-api-54d89bd5fc-mczbl" (UID: "6b5f62b4-cbc0-43b1-8e39-ff053ef4c392") : secret "model-serving-api-tls" not found
Jul 26 16:14:15.442262 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.442237    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xv74\" (UniqueName: \"kubernetes.io/projected/6b5f62b4-cbc0-43b1-8e39-ff053ef4c392-kube-api-access-6xv74\") pod \"model-serving-api-54d89bd5fc-mczbl\" (UID: \"6b5f62b4-cbc0-43b1-8e39-ff053ef4c392\") " pod="opendatahub/model-serving-api-54d89bd5fc-mczbl"
Jul 26 16:14:15.517619 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.517580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a073b763-1771-4f03-999a-99c036e854ec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.517779 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.517645    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a073b763-1771-4f03-999a-99c036e854ec-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.517779 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.517675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.517779 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.517700    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.517779 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.517763    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.517988 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.517788    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a073b763-1771-4f03-999a-99c036e854ec-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.517988 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.517859    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvrjh\" (UniqueName: \"kubernetes.io/projected/a073b763-1771-4f03-999a-99c036e854ec-kube-api-access-tvrjh\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.519367 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.518802    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a073b763-1771-4f03-999a-99c036e854ec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.530865 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.521809    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a073b763-1771-4f03-999a-99c036e854ec-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.530865 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.523869    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.530865 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.525755    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.530865 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.526370    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.530865 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.528775    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvrjh\" (UniqueName: \"kubernetes.io/projected/a073b763-1771-4f03-999a-99c036e854ec-kube-api-access-tvrjh\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.530865 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.530809    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a073b763-1771-4f03-999a-99c036e854ec-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xqwc2\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.603641 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.603601    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm" event={"ID":"7afe94df-ac8d-4d8a-8e17-f24a6f05c6db","Type":"ContainerStarted","Data":"d68d53fc2b10228088a41b5d42da67fdd190feb73f31cdbf4fd8147c02898f92"}
Jul 26 16:14:15.605379 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.605349    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jrmqn" event={"ID":"f98a39dd-5919-43c5-8ce6-9f90b20fa92a","Type":"ContainerStarted","Data":"205213a27dfc1a3dd7a7ee2b89c7193e1a9c4ff77a274810c9cc8f20e3545375"}
Jul 26 16:14:15.650083 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.650037    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:15.778523 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.778476    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:15.835439 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.835409    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"]
Jul 26 16:14:15.837767 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:14:15.837736    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda073b763_1771_4f03_999a_99c036e854ec.slice/crio-9f9989c098c3fb1fec2778a3272be7d41d9207bf180d6b1f4ecea5dca5399a6e WatchSource:0}: Error finding container 9f9989c098c3fb1fec2778a3272be7d41d9207bf180d6b1f4ecea5dca5399a6e: Status 404 returned error can't find the container with id 9f9989c098c3fb1fec2778a3272be7d41d9207bf180d6b1f4ecea5dca5399a6e
Jul 26 16:14:15.922593 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.922504    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b5f62b4-cbc0-43b1-8e39-ff053ef4c392-tls-certs\") pod \"model-serving-api-54d89bd5fc-mczbl\" (UID: \"6b5f62b4-cbc0-43b1-8e39-ff053ef4c392\") " pod="opendatahub/model-serving-api-54d89bd5fc-mczbl"
Jul 26 16:14:15.925408 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:15.925382    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b5f62b4-cbc0-43b1-8e39-ff053ef4c392-tls-certs\") pod \"model-serving-api-54d89bd5fc-mczbl\" (UID: \"6b5f62b4-cbc0-43b1-8e39-ff053ef4c392\") " pod="opendatahub/model-serving-api-54d89bd5fc-mczbl"
Jul 26 16:14:16.059303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:16.059266    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-mczbl"
Jul 26 16:14:16.223716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:16.223679    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mczbl"]
Jul 26 16:14:16.226112 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:14:16.226084    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5f62b4_cbc0_43b1_8e39_ff053ef4c392.slice/crio-eab88aca2cbb02fc28eec650bd4e22a0d81c2c44d9aac42a0523d2b8adea8b58 WatchSource:0}: Error finding container eab88aca2cbb02fc28eec650bd4e22a0d81c2c44d9aac42a0523d2b8adea8b58: Status 404 returned error can't find the container with id eab88aca2cbb02fc28eec650bd4e22a0d81c2c44d9aac42a0523d2b8adea8b58
Jul 26 16:14:16.348396 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:16.348334    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:16.611243 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:16.611172    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2" event={"ID":"a073b763-1771-4f03-999a-99c036e854ec","Type":"ContainerStarted","Data":"9f9989c098c3fb1fec2778a3272be7d41d9207bf180d6b1f4ecea5dca5399a6e"}
Jul 26 16:14:16.612439 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:16.612413    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-mczbl" event={"ID":"6b5f62b4-cbc0-43b1-8e39-ff053ef4c392","Type":"ContainerStarted","Data":"eab88aca2cbb02fc28eec650bd4e22a0d81c2c44d9aac42a0523d2b8adea8b58"}
Jul 26 16:14:19.956036 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:19.956003    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:14:19.956368 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:19.956063    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:14:20.538266 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:20.538226    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:20.633855 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:20.633818    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-mczbl" event={"ID":"6b5f62b4-cbc0-43b1-8e39-ff053ef4c392","Type":"ContainerStarted","Data":"a568edfdac441f28ac533b26ba049c2b34cef2d7c0dae8355989e1b2a7349eb9"}
Jul 26 16:14:20.634062 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:20.633913    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-mczbl"
Jul 26 16:14:20.635683 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:20.635656    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm" event={"ID":"7afe94df-ac8d-4d8a-8e17-f24a6f05c6db","Type":"ContainerStarted","Data":"72a05c719c8168d0b4023244ca324797a0bdab483874328ac45a5b562d9ccbc1"}
Jul 26 16:14:20.637607 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:20.637577    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jrmqn" event={"ID":"f98a39dd-5919-43c5-8ce6-9f90b20fa92a","Type":"ContainerStarted","Data":"b4520a7e0f22703cf2dad1d901908a27bf0090f251a5d40577584b46e22b348f"}
Jul 26 16:14:20.637716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:20.637647    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jrmqn"
Jul 26 16:14:20.639498 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:20.639473    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2" event={"ID":"a073b763-1771-4f03-999a-99c036e854ec","Type":"ContainerStarted","Data":"381c7452db118f8790ea9a8038a97d246bd9c863e589a24cb1aed2000a60a106"}
Jul 26 16:14:20.639612 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:20.639588    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:20.643174 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:20.643143    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:20.655623 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:20.655581    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-mczbl" podStartSLOduration=1.9270353180000002 podStartE2EDuration="5.655568343s" totalImagesPullingTime="3.728533025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:14:20.65462592 +0000 UTC m=+376.189325210" watchObservedRunningTime="2026-07-26 16:14:20.655568343 +0000 UTC m=+376.190267595"
Jul 26 16:14:20.675933 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:20.675896    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2" podStartSLOduration=1.5603133169999999 podStartE2EDuration="5.675881061s" totalImagesPullingTime="4.115567744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:14:20.675256006 +0000 UTC m=+376.209955281" watchObservedRunningTime="2026-07-26 16:14:20.675881061 +0000 UTC m=+376.210580336"
Jul 26 16:14:20.692652 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:20.692611    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6ff4cb76d8-nbhzm" podStartSLOduration=1.342260954 podStartE2EDuration="6.692598104s" totalImagesPullingTime="5.35033715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:14:20.690643263 +0000 UTC m=+376.225342548" watchObservedRunningTime="2026-07-26 16:14:20.692598104 +0000 UTC m=+376.227297378"
Jul 26 16:14:20.710435 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:20.710391    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jrmqn" podStartSLOduration=1.489939454 podStartE2EDuration="6.710377874s" totalImagesPullingTime="5.22043842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:14:20.710000796 +0000 UTC m=+376.244700072" watchObservedRunningTime="2026-07-26 16:14:20.710377874 +0000 UTC m=+376.245077150"
Jul 26 16:14:20.904730 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:20.904648    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:21.310506 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:21.310460    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:21.412039 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:21.411998    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:21.645942 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:21.645869    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:24.225192 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.225155    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:24.272353 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.272315    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8t26j"]
Jul 26 16:14:24.276161 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.276140    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8t26j"
Jul 26 16:14:24.280964 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.280941    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2gq56\""
Jul 26 16:14:24.281103 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.281091    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 26 16:14:24.293756 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.293709    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8t26j"]
Jul 26 16:14:24.329315 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.329278    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:24.391574 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.391532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8156b810-a774-4b2a-8cb3-92003838c0a7-cert\") pod \"kserve-controller-manager-d6f4b65b8-8t26j\" (UID: \"8156b810-a774-4b2a-8cb3-92003838c0a7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8t26j"
Jul 26 16:14:24.391748 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.391711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlh9m\" (UniqueName: \"kubernetes.io/projected/8156b810-a774-4b2a-8cb3-92003838c0a7-kube-api-access-wlh9m\") pod \"kserve-controller-manager-d6f4b65b8-8t26j\" (UID: \"8156b810-a774-4b2a-8cb3-92003838c0a7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8t26j"
Jul 26 16:14:24.493065 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.492977    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlh9m\" (UniqueName: \"kubernetes.io/projected/8156b810-a774-4b2a-8cb3-92003838c0a7-kube-api-access-wlh9m\") pod \"kserve-controller-manager-d6f4b65b8-8t26j\" (UID: \"8156b810-a774-4b2a-8cb3-92003838c0a7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8t26j"
Jul 26 16:14:24.493065 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.493015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8156b810-a774-4b2a-8cb3-92003838c0a7-cert\") pod \"kserve-controller-manager-d6f4b65b8-8t26j\" (UID: \"8156b810-a774-4b2a-8cb3-92003838c0a7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8t26j"
Jul 26 16:14:24.495466 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.495434    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8156b810-a774-4b2a-8cb3-92003838c0a7-cert\") pod \"kserve-controller-manager-d6f4b65b8-8t26j\" (UID: \"8156b810-a774-4b2a-8cb3-92003838c0a7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8t26j"
Jul 26 16:14:24.501426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.501402    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlh9m\" (UniqueName: \"kubernetes.io/projected/8156b810-a774-4b2a-8cb3-92003838c0a7-kube-api-access-wlh9m\") pod \"kserve-controller-manager-d6f4b65b8-8t26j\" (UID: \"8156b810-a774-4b2a-8cb3-92003838c0a7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8t26j"
Jul 26 16:14:24.564575 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.564540    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:24.588492 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.588455    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8t26j"
Jul 26 16:14:24.722516 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.722435    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8t26j"]
Jul 26 16:14:24.724637 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:14:24.724610    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8156b810_a774_4b2a_8cb3_92003838c0a7.slice/crio-a330c31276c33547241c50ed280ca97f59abc26042c69967d6a9bd36eaf6be64 WatchSource:0}: Error finding container a330c31276c33547241c50ed280ca97f59abc26042c69967d6a9bd36eaf6be64: Status 404 returned error can't find the container with id a330c31276c33547241c50ed280ca97f59abc26042c69967d6a9bd36eaf6be64
Jul 26 16:14:24.958962 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:24.953669    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:25.469767 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:25.469729    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:25.567577 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:25.567545    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:14:25.662470 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:25.662437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8t26j" event={"ID":"8156b810-a774-4b2a-8cb3-92003838c0a7","Type":"ContainerStarted","Data":"a330c31276c33547241c50ed280ca97f59abc26042c69967d6a9bd36eaf6be64"}
Jul 26 16:14:26.698163 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:26.698103    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"]
Jul 26 16:14:26.698602 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:26.698328    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2" podUID="a073b763-1771-4f03-999a-99c036e854ec" containerName="discovery" containerID="cri-o://381c7452db118f8790ea9a8038a97d246bd9c863e589a24cb1aed2000a60a106" gracePeriod=30
Jul 26 16:14:26.951166 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:26.951099    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:27.116445 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.116411    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvrjh\" (UniqueName: \"kubernetes.io/projected/a073b763-1771-4f03-999a-99c036e854ec-kube-api-access-tvrjh\") pod \"a073b763-1771-4f03-999a-99c036e854ec\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") "
Jul 26 16:14:27.116445 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.116458    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-cacerts\") pod \"a073b763-1771-4f03-999a-99c036e854ec\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") "
Jul 26 16:14:27.116681 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.116491    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-istio-csr-dns-cert\") pod \"a073b763-1771-4f03-999a-99c036e854ec\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") "
Jul 26 16:14:27.116681 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.116517    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a073b763-1771-4f03-999a-99c036e854ec-istio-csr-ca-configmap\") pod \"a073b763-1771-4f03-999a-99c036e854ec\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") "
Jul 26 16:14:27.116681 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.116546    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-istio-kubeconfig\") pod \"a073b763-1771-4f03-999a-99c036e854ec\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") "
Jul 26 16:14:27.116681 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.116571    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a073b763-1771-4f03-999a-99c036e854ec-istio-token\") pod \"a073b763-1771-4f03-999a-99c036e854ec\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") "
Jul 26 16:14:27.117219 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.116915    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a073b763-1771-4f03-999a-99c036e854ec-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a073b763-1771-4f03-999a-99c036e854ec" (UID: "a073b763-1771-4f03-999a-99c036e854ec"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:14:27.117219 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.116948    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a073b763-1771-4f03-999a-99c036e854ec-local-certs\") pod \"a073b763-1771-4f03-999a-99c036e854ec\" (UID: \"a073b763-1771-4f03-999a-99c036e854ec\") "
Jul 26 16:14:27.117438 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.117417    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a073b763-1771-4f03-999a-99c036e854ec-istio-csr-ca-configmap\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:14:27.119281 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.119167    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a073b763-1771-4f03-999a-99c036e854ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "a073b763-1771-4f03-999a-99c036e854ec" (UID: "a073b763-1771-4f03-999a-99c036e854ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:14:27.119281 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.119239    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a073b763-1771-4f03-999a-99c036e854ec-kube-api-access-tvrjh" (OuterVolumeSpecName: "kube-api-access-tvrjh") pod "a073b763-1771-4f03-999a-99c036e854ec" (UID: "a073b763-1771-4f03-999a-99c036e854ec"). InnerVolumeSpecName "kube-api-access-tvrjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:14:27.119281 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.119241    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-cacerts" (OuterVolumeSpecName: "cacerts") pod "a073b763-1771-4f03-999a-99c036e854ec" (UID: "a073b763-1771-4f03-999a-99c036e854ec"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:14:27.119496 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.119396    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a073b763-1771-4f03-999a-99c036e854ec" (UID: "a073b763-1771-4f03-999a-99c036e854ec"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:14:27.119496 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.119406    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a073b763-1771-4f03-999a-99c036e854ec" (UID: "a073b763-1771-4f03-999a-99c036e854ec"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:14:27.119783 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.119762    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a073b763-1771-4f03-999a-99c036e854ec-local-certs" (OuterVolumeSpecName: "local-certs") pod "a073b763-1771-4f03-999a-99c036e854ec" (UID: "a073b763-1771-4f03-999a-99c036e854ec"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:14:27.218077 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.218001    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvrjh\" (UniqueName: \"kubernetes.io/projected/a073b763-1771-4f03-999a-99c036e854ec-kube-api-access-tvrjh\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:14:27.218077 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.218026    2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-cacerts\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:14:27.218077 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.218038    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-istio-csr-dns-cert\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:14:27.218077 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.218048    2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a073b763-1771-4f03-999a-99c036e854ec-istio-kubeconfig\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:14:27.218077 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.218056    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a073b763-1771-4f03-999a-99c036e854ec-istio-token\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:14:27.218077 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.218064    2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a073b763-1771-4f03-999a-99c036e854ec-local-certs\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:14:27.673977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.673881    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8t26j" event={"ID":"8156b810-a774-4b2a-8cb3-92003838c0a7","Type":"ContainerStarted","Data":"4a1660ef971f32266c56db0099eb5554d385eaf163da6e8200d976a9f4476167"}
Jul 26 16:14:27.673977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.673949    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8t26j"
Jul 26 16:14:27.675074 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.675047    2559 generic.go:356] "Generic (PLEG): container finished" podID="a073b763-1771-4f03-999a-99c036e854ec" containerID="381c7452db118f8790ea9a8038a97d246bd9c863e589a24cb1aed2000a60a106" exitCode=0
Jul 26 16:14:27.675213 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.675080    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"
Jul 26 16:14:27.675213 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.675109    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2" event={"ID":"a073b763-1771-4f03-999a-99c036e854ec","Type":"ContainerDied","Data":"381c7452db118f8790ea9a8038a97d246bd9c863e589a24cb1aed2000a60a106"}
Jul 26 16:14:27.675213 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.675167    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2" event={"ID":"a073b763-1771-4f03-999a-99c036e854ec","Type":"ContainerDied","Data":"9f9989c098c3fb1fec2778a3272be7d41d9207bf180d6b1f4ecea5dca5399a6e"}
Jul 26 16:14:27.675213 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.675188    2559 scope.go:117] "RemoveContainer" containerID="381c7452db118f8790ea9a8038a97d246bd9c863e589a24cb1aed2000a60a106"
Jul 26 16:14:27.684045 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.684028    2559 scope.go:117] "RemoveContainer" containerID="381c7452db118f8790ea9a8038a97d246bd9c863e589a24cb1aed2000a60a106"
Jul 26 16:14:27.684339 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:14:27.684319    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"381c7452db118f8790ea9a8038a97d246bd9c863e589a24cb1aed2000a60a106\": container with ID starting with 381c7452db118f8790ea9a8038a97d246bd9c863e589a24cb1aed2000a60a106 not found: ID does not exist" containerID="381c7452db118f8790ea9a8038a97d246bd9c863e589a24cb1aed2000a60a106"
Jul 26 16:14:27.684429 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.684345    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"381c7452db118f8790ea9a8038a97d246bd9c863e589a24cb1aed2000a60a106"} err="failed to get container status \"381c7452db118f8790ea9a8038a97d246bd9c863e589a24cb1aed2000a60a106\": rpc error: code = NotFound desc = could not find container \"381c7452db118f8790ea9a8038a97d246bd9c863e589a24cb1aed2000a60a106\": container with ID starting with 381c7452db118f8790ea9a8038a97d246bd9c863e589a24cb1aed2000a60a106 not found: ID does not exist"
Jul 26 16:14:27.689153 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.689098    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8t26j" podStartSLOduration=1.555588816 podStartE2EDuration="3.689085375s" totalImagesPullingTime="2.133496559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:14:27.688069339 +0000 UTC m=+383.222768614" watchObservedRunningTime="2026-07-26 16:14:27.689085375 +0000 UTC m=+383.223784650"
Jul 26 16:14:27.703191 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.703167    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"]
Jul 26 16:14:27.712892 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:27.712869    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xqwc2"]
Jul 26 16:14:28.953882 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:28.953853    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a073b763-1771-4f03-999a-99c036e854ec" path="/var/lib/kubelet/pods/a073b763-1771-4f03-999a-99c036e854ec/volumes"
Jul 26 16:14:31.646229 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:31.646199    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jrmqn"
Jul 26 16:14:31.648364 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:31.648333    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-mczbl"
Jul 26 16:14:58.685550 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:14:58.685522    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8t26j"
Jul 26 16:15:14.930303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:14.930265    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:15.029141 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.029097    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:15.068971 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.068939    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wz9j7"]
Jul 26 16:15:15.069286 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.069273    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a073b763-1771-4f03-999a-99c036e854ec" containerName="discovery"
Jul 26 16:15:15.069335 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.069288    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a073b763-1771-4f03-999a-99c036e854ec" containerName="discovery"
Jul 26 16:15:15.069370 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.069365    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a073b763-1771-4f03-999a-99c036e854ec" containerName="discovery"
Jul 26 16:15:15.075078 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.075056    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wz9j7"
Jul 26 16:15:15.077561 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.077534    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 26 16:15:15.078550 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.078526    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 26 16:15:15.078654 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.078563    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rv976\""
Jul 26 16:15:15.081574 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.081554    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wz9j7"]
Jul 26 16:15:15.110393 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.110367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:15.180483 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.180420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzzdb\" (UniqueName: \"kubernetes.io/projected/bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8-kube-api-access-fzzdb\") pod \"kuadrant-operator-catalog-wz9j7\" (UID: \"bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8\") " pod="kuadrant-system/kuadrant-operator-catalog-wz9j7"
Jul 26 16:15:15.281687 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.281650    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzzdb\" (UniqueName: \"kubernetes.io/projected/bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8-kube-api-access-fzzdb\") pod \"kuadrant-operator-catalog-wz9j7\" (UID: \"bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8\") " pod="kuadrant-system/kuadrant-operator-catalog-wz9j7"
Jul 26 16:15:15.289680 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.289658    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzzdb\" (UniqueName: \"kubernetes.io/projected/bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8-kube-api-access-fzzdb\") pod \"kuadrant-operator-catalog-wz9j7\" (UID: \"bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8\") " pod="kuadrant-system/kuadrant-operator-catalog-wz9j7"
Jul 26 16:15:15.387271 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.387242    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wz9j7"
Jul 26 16:15:15.434711 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.434680    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wz9j7"]
Jul 26 16:15:15.513839 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.513811    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wz9j7"]
Jul 26 16:15:15.516853 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:15:15.516824    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd3652ce_f3c7_4a74_b4ab_e7acb0dc9fd8.slice/crio-1b50c728c36c2bb1774aa361dfb563b4d892676dbc733800edb9713a80a762f6 WatchSource:0}: Error finding container 1b50c728c36c2bb1774aa361dfb563b4d892676dbc733800edb9713a80a762f6: Status 404 returned error can't find the container with id 1b50c728c36c2bb1774aa361dfb563b4d892676dbc733800edb9713a80a762f6
Jul 26 16:15:15.644591 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.644557    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8xst5"]
Jul 26 16:15:15.649895 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.649876    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8xst5"
Jul 26 16:15:15.654580 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.654552    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8xst5"]
Jul 26 16:15:15.684987 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.684908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhdlt\" (UniqueName: \"kubernetes.io/projected/179c3af6-d835-495d-903c-360effb03056-kube-api-access-fhdlt\") pod \"kuadrant-operator-catalog-8xst5\" (UID: \"179c3af6-d835-495d-903c-360effb03056\") " pod="kuadrant-system/kuadrant-operator-catalog-8xst5"
Jul 26 16:15:15.786243 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.786204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhdlt\" (UniqueName: \"kubernetes.io/projected/179c3af6-d835-495d-903c-360effb03056-kube-api-access-fhdlt\") pod \"kuadrant-operator-catalog-8xst5\" (UID: \"179c3af6-d835-495d-903c-360effb03056\") " pod="kuadrant-system/kuadrant-operator-catalog-8xst5"
Jul 26 16:15:15.796626 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.796592    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhdlt\" (UniqueName: \"kubernetes.io/projected/179c3af6-d835-495d-903c-360effb03056-kube-api-access-fhdlt\") pod \"kuadrant-operator-catalog-8xst5\" (UID: \"179c3af6-d835-495d-903c-360effb03056\") " pod="kuadrant-system/kuadrant-operator-catalog-8xst5"
Jul 26 16:15:15.887142 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.887089    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wz9j7" event={"ID":"bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8","Type":"ContainerStarted","Data":"1b50c728c36c2bb1774aa361dfb563b4d892676dbc733800edb9713a80a762f6"}
Jul 26 16:15:15.960872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:15.960802    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8xst5"
Jul 26 16:15:16.093251 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:16.093226    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8xst5"]
Jul 26 16:15:16.095729 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:15:16.095702    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod179c3af6_d835_495d_903c_360effb03056.slice/crio-a49ee933a90e68f50270018caa828d881e974f008b75b085be807b6978c786d8 WatchSource:0}: Error finding container a49ee933a90e68f50270018caa828d881e974f008b75b085be807b6978c786d8: Status 404 returned error can't find the container with id a49ee933a90e68f50270018caa828d881e974f008b75b085be807b6978c786d8
Jul 26 16:15:16.894768 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:16.894731    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8xst5" event={"ID":"179c3af6-d835-495d-903c-360effb03056","Type":"ContainerStarted","Data":"a49ee933a90e68f50270018caa828d881e974f008b75b085be807b6978c786d8"}
Jul 26 16:15:17.902740 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:17.902699    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wz9j7" event={"ID":"bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8","Type":"ContainerStarted","Data":"11f3cc42c2038a4993d0fe72b6e3a711c21b7469e6ca34be52eead0d64f5b2b0"}
Jul 26 16:15:17.903241 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:17.902769    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wz9j7" podUID="bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8" containerName="registry-server" containerID="cri-o://11f3cc42c2038a4993d0fe72b6e3a711c21b7469e6ca34be52eead0d64f5b2b0" gracePeriod=2
Jul 26 16:15:17.904481 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:17.904457    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8xst5" event={"ID":"179c3af6-d835-495d-903c-360effb03056","Type":"ContainerStarted","Data":"acad3fb84e3768574393ce52ec29c5020264a94cfa1ab53da2fff55d4a46ae02"}
Jul 26 16:15:17.919254 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:17.919160    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wz9j7" podStartSLOduration=0.763856126 podStartE2EDuration="2.919141854s" totalImagesPullingTime="2.155285728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:15:17.917010902 +0000 UTC m=+433.451710179" watchObservedRunningTime="2026-07-26 16:15:17.919141854 +0000 UTC m=+433.453841133"
Jul 26 16:15:17.933008 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:17.932959    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8xst5" podStartSLOduration=1.353678856 podStartE2EDuration="2.932943891s" totalImagesPullingTime="1.579265035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:15:17.931004138 +0000 UTC m=+433.465703414" watchObservedRunningTime="2026-07-26 16:15:17.932943891 +0000 UTC m=+433.467643190"
Jul 26 16:15:18.132461 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.132440    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wz9j7_bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8/registry-server/0.log"
Jul 26 16:15:18.134791 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.134777    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wz9j7"
Jul 26 16:15:18.206333 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.206303    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzzdb\" (UniqueName: \"kubernetes.io/projected/bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8-kube-api-access-fzzdb\") pod \"bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8\" (UID: \"bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8\") "
Jul 26 16:15:18.208470 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.208446    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8-kube-api-access-fzzdb" (OuterVolumeSpecName: "kube-api-access-fzzdb") pod "bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8" (UID: "bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8"). InnerVolumeSpecName "kube-api-access-fzzdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:15:18.307670 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.307637    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzzdb\" (UniqueName: \"kubernetes.io/projected/bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8-kube-api-access-fzzdb\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:15:18.915481 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.915454    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wz9j7_bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8/registry-server/0.log"
Jul 26 16:15:18.915927 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.915492    2559 generic.go:356] "Generic (PLEG): container finished" podID="bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8" containerID="11f3cc42c2038a4993d0fe72b6e3a711c21b7469e6ca34be52eead0d64f5b2b0" exitCode=1
Jul 26 16:15:18.915927 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.915521    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wz9j7" event={"ID":"bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8","Type":"ContainerDied","Data":"11f3cc42c2038a4993d0fe72b6e3a711c21b7469e6ca34be52eead0d64f5b2b0"}
Jul 26 16:15:18.915927 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.915565    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wz9j7"
Jul 26 16:15:18.915927 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.915594    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wz9j7" event={"ID":"bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8","Type":"ContainerDied","Data":"1b50c728c36c2bb1774aa361dfb563b4d892676dbc733800edb9713a80a762f6"}
Jul 26 16:15:18.915927 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.915614    2559 scope.go:117] "RemoveContainer" containerID="11f3cc42c2038a4993d0fe72b6e3a711c21b7469e6ca34be52eead0d64f5b2b0"
Jul 26 16:15:18.924808 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.924782    2559 scope.go:117] "RemoveContainer" containerID="11f3cc42c2038a4993d0fe72b6e3a711c21b7469e6ca34be52eead0d64f5b2b0"
Jul 26 16:15:18.925107 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:15:18.925089    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11f3cc42c2038a4993d0fe72b6e3a711c21b7469e6ca34be52eead0d64f5b2b0\": container with ID starting with 11f3cc42c2038a4993d0fe72b6e3a711c21b7469e6ca34be52eead0d64f5b2b0 not found: ID does not exist" containerID="11f3cc42c2038a4993d0fe72b6e3a711c21b7469e6ca34be52eead0d64f5b2b0"
Jul 26 16:15:18.925172 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.925113    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11f3cc42c2038a4993d0fe72b6e3a711c21b7469e6ca34be52eead0d64f5b2b0"} err="failed to get container status \"11f3cc42c2038a4993d0fe72b6e3a711c21b7469e6ca34be52eead0d64f5b2b0\": rpc error: code = NotFound desc = could not find container \"11f3cc42c2038a4993d0fe72b6e3a711c21b7469e6ca34be52eead0d64f5b2b0\": container with ID starting with 11f3cc42c2038a4993d0fe72b6e3a711c21b7469e6ca34be52eead0d64f5b2b0 not found: ID does not exist"
Jul 26 16:15:18.935113 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.935090    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wz9j7"]
Jul 26 16:15:18.937445 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.937420    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wz9j7"]
Jul 26 16:15:18.954164 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:18.954099    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8" path="/var/lib/kubelet/pods/bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8/volumes"
Jul 26 16:15:25.961104 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:25.961072    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8xst5"
Jul 26 16:15:25.961514 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:25.961141    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8xst5"
Jul 26 16:15:25.982301 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:25.982273    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8xst5"
Jul 26 16:15:26.972439 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:26.972413    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8xst5"
Jul 26 16:15:43.792610 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:43.792572    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:47.635371 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:47.635334    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:48.741426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:48.741397    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"]
Jul 26 16:15:48.741779 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:48.741733    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8" containerName="registry-server"
Jul 26 16:15:48.741779 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:48.741744    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8" containerName="registry-server"
Jul 26 16:15:48.741848 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:48.741814    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd3652ce-f3c7-4a74-b4ab-e7acb0dc9fd8" containerName="registry-server"
Jul 26 16:15:48.749863 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:48.749846    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:15:48.752872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:48.752855    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tbs87\""
Jul 26 16:15:48.760437 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:48.760417    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"]
Jul 26 16:15:48.850603 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:48.850569    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g88lq\" (UniqueName: \"kubernetes.io/projected/6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0-kube-api-access-g88lq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsr9f\" (UID: \"6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:15:48.850737 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:48.850608    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsr9f\" (UID: \"6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:15:48.951594 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:48.951564    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g88lq\" (UniqueName: \"kubernetes.io/projected/6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0-kube-api-access-g88lq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsr9f\" (UID: \"6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:15:48.951594 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:48.951598    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsr9f\" (UID: \"6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:15:48.952007 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:48.951989    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsr9f\" (UID: \"6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:15:48.959939 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:48.959920    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g88lq\" (UniqueName: \"kubernetes.io/projected/6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0-kube-api-access-g88lq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsr9f\" (UID: \"6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:15:48.976829 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:48.976804    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:49.060027 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:49.059967    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:15:49.191994 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:49.191970    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"]
Jul 26 16:15:49.197365 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:15:49.195968    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3930e7_f7e3_49e7_b28c_8eec47cbbaa0.slice/crio-a3aa7fddbb533d863e86b0d0dee679ece5bd9596ddf83b48b183fffb928c9965 WatchSource:0}: Error finding container a3aa7fddbb533d863e86b0d0dee679ece5bd9596ddf83b48b183fffb928c9965: Status 404 returned error can't find the container with id a3aa7fddbb533d863e86b0d0dee679ece5bd9596ddf83b48b183fffb928c9965
Jul 26 16:15:49.385282 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:49.385199    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:50.056659 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:50.056622    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f" event={"ID":"6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0","Type":"ContainerStarted","Data":"a3aa7fddbb533d863e86b0d0dee679ece5bd9596ddf83b48b183fffb928c9965"}
Jul 26 16:15:50.418934 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:50.418859    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:51.396705 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:51.396668    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-trqkk"]
Jul 26 16:15:51.400382 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:51.400355    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-trqkk"
Jul 26 16:15:51.402987 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:51.402966    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xvww5\""
Jul 26 16:15:51.413733 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:51.413709    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-trqkk"]
Jul 26 16:15:51.574474 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:51.574439    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-666pg\" (UniqueName: \"kubernetes.io/projected/dd4d6f54-b128-4549-9330-a4ce7a5e63fd-kube-api-access-666pg\") pod \"authorino-operator-75cc8d5cb7-trqkk\" (UID: \"dd4d6f54-b128-4549-9330-a4ce7a5e63fd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-trqkk"
Jul 26 16:15:51.675263 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:51.675172    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-666pg\" (UniqueName: \"kubernetes.io/projected/dd4d6f54-b128-4549-9330-a4ce7a5e63fd-kube-api-access-666pg\") pod \"authorino-operator-75cc8d5cb7-trqkk\" (UID: \"dd4d6f54-b128-4549-9330-a4ce7a5e63fd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-trqkk"
Jul 26 16:15:51.684601 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:51.684576    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-666pg\" (UniqueName: \"kubernetes.io/projected/dd4d6f54-b128-4549-9330-a4ce7a5e63fd-kube-api-access-666pg\") pod \"authorino-operator-75cc8d5cb7-trqkk\" (UID: \"dd4d6f54-b128-4549-9330-a4ce7a5e63fd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-trqkk"
Jul 26 16:15:51.713396 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:51.713372    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-trqkk"
Jul 26 16:15:51.856794 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:51.856760    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-trqkk"]
Jul 26 16:15:51.859220 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:15:51.859190    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd4d6f54_b128_4549_9330_a4ce7a5e63fd.slice/crio-e139bce3457a08bd14d6391b1ac7be82d1e269f87f8ca66912d176f0d1e3b3c7 WatchSource:0}: Error finding container e139bce3457a08bd14d6391b1ac7be82d1e269f87f8ca66912d176f0d1e3b3c7: Status 404 returned error can't find the container with id e139bce3457a08bd14d6391b1ac7be82d1e269f87f8ca66912d176f0d1e3b3c7
Jul 26 16:15:51.981161 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:51.981110    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:52.066736 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:52.066709    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-trqkk" event={"ID":"dd4d6f54-b128-4549-9330-a4ce7a5e63fd","Type":"ContainerStarted","Data":"e139bce3457a08bd14d6391b1ac7be82d1e269f87f8ca66912d176f0d1e3b3c7"}
Jul 26 16:15:53.014496 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:53.014461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:53.408165 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:53.408050    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"]
Jul 26 16:15:53.417811 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:53.417783    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:15:53.421686 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:53.421661    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-lvndq\""
Jul 26 16:15:53.441096 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:53.441070    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"]
Jul 26 16:15:53.593926 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:53.593880    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6zdf\" (UniqueName: \"kubernetes.io/projected/2400d31a-970f-464f-832f-c1a952259e73-kube-api-access-l6zdf\") pod \"limitador-operator-controller-manager-859d7b78bd-znncr\" (UID: \"2400d31a-970f-464f-832f-c1a952259e73\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:15:53.694944 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:53.694912    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6zdf\" (UniqueName: \"kubernetes.io/projected/2400d31a-970f-464f-832f-c1a952259e73-kube-api-access-l6zdf\") pod \"limitador-operator-controller-manager-859d7b78bd-znncr\" (UID: \"2400d31a-970f-464f-832f-c1a952259e73\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:15:53.703692 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:53.703666    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6zdf\" (UniqueName: \"kubernetes.io/projected/2400d31a-970f-464f-832f-c1a952259e73-kube-api-access-l6zdf\") pod \"limitador-operator-controller-manager-859d7b78bd-znncr\" (UID: \"2400d31a-970f-464f-832f-c1a952259e73\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:15:53.730766 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:53.730715    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:15:54.391268 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:54.391231    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:55.493792 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:55.493758    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"]
Jul 26 16:15:55.497510 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:15:55.497481    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2400d31a_970f_464f_832f_c1a952259e73.slice/crio-4c79b8e4db0d8be6349ae6b2558040a403ecf11113f6dd72e24f0c4e33bf90f0 WatchSource:0}: Error finding container 4c79b8e4db0d8be6349ae6b2558040a403ecf11113f6dd72e24f0c4e33bf90f0: Status 404 returned error can't find the container with id 4c79b8e4db0d8be6349ae6b2558040a403ecf11113f6dd72e24f0c4e33bf90f0
Jul 26 16:15:55.618512 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:55.618426    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:56.090578 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.090540    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr" event={"ID":"2400d31a-970f-464f-832f-c1a952259e73","Type":"ContainerStarted","Data":"4c79b8e4db0d8be6349ae6b2558040a403ecf11113f6dd72e24f0c4e33bf90f0"}
Jul 26 16:15:56.092056 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.092019    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-trqkk" event={"ID":"dd4d6f54-b128-4549-9330-a4ce7a5e63fd","Type":"ContainerStarted","Data":"a6306ff03ee55e78f6e2366b7ffd8e8acf4577105108e2067bed101c5c8b83c2"}
Jul 26 16:15:56.092548 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.092090    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-trqkk"
Jul 26 16:15:56.094028 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.094002    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f" event={"ID":"6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0","Type":"ContainerStarted","Data":"ddb5247d252b5040b155cda4f8dbcf9290c2acb0edee390f82e6014a3209d5c4"}
Jul 26 16:15:56.094194 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.094168    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:15:56.094461 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.094443    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgq2k"]
Jul 26 16:15:56.097926 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.097903    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgq2k"
Jul 26 16:15:56.100298 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.100278    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6wvpj\""
Jul 26 16:15:56.100505 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.100490    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 26 16:15:56.111686 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.111651    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgq2k"]
Jul 26 16:15:56.113199 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.113152    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-trqkk" podStartSLOduration=1.618820007 podStartE2EDuration="5.113135275s" totalImagesPullingTime="3.494315268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:15:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:15:56.109440863 +0000 UTC m=+471.644140141" watchObservedRunningTime="2026-07-26 16:15:56.113135275 +0000 UTC m=+471.647834546"
Jul 26 16:15:56.215257 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.215221    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptbnr\" (UniqueName: \"kubernetes.io/projected/1de5e7e5-a455-4326-b244-769090503f22-kube-api-access-ptbnr\") pod \"dns-operator-controller-manager-864dd78c4c-dgq2k\" (UID: \"1de5e7e5-a455-4326-b244-769090503f22\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgq2k"
Jul 26 16:15:56.315790 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.315753    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptbnr\" (UniqueName: \"kubernetes.io/projected/1de5e7e5-a455-4326-b244-769090503f22-kube-api-access-ptbnr\") pod \"dns-operator-controller-manager-864dd78c4c-dgq2k\" (UID: \"1de5e7e5-a455-4326-b244-769090503f22\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgq2k"
Jul 26 16:15:56.325377 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.325347    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptbnr\" (UniqueName: \"kubernetes.io/projected/1de5e7e5-a455-4326-b244-769090503f22-kube-api-access-ptbnr\") pod \"dns-operator-controller-manager-864dd78c4c-dgq2k\" (UID: \"1de5e7e5-a455-4326-b244-769090503f22\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgq2k"
Jul 26 16:15:56.409460 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.409376    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgq2k"
Jul 26 16:15:56.559807 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.559761    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f" podStartSLOduration=2.390998533 podStartE2EDuration="8.559743788s" totalImagesPullingTime="6.168745255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:15:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:15:56.158582452 +0000 UTC m=+471.693281730" watchObservedRunningTime="2026-07-26 16:15:56.559743788 +0000 UTC m=+472.094443108"
Jul 26 16:15:56.560331 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:56.560246    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgq2k"]
Jul 26 16:15:56.849511 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:15:56.849451    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de5e7e5_a455_4326_b244_769090503f22.slice/crio-eb9d433bc8eb920cf6b299734ea46efb48d34d6da32f4d4569b9e47fa93019be WatchSource:0}: Error finding container eb9d433bc8eb920cf6b299734ea46efb48d34d6da32f4d4569b9e47fa93019be: Status 404 returned error can't find the container with id eb9d433bc8eb920cf6b299734ea46efb48d34d6da32f4d4569b9e47fa93019be
Jul 26 16:15:57.101080 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:57.100986    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr" event={"ID":"2400d31a-970f-464f-832f-c1a952259e73","Type":"ContainerStarted","Data":"14f021f9923c15bb84114b29d1387367b460e642c88b2fd171f45ae9ca3d70b4"}
Jul 26 16:15:57.101255 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:57.101172    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:15:57.102288 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:57.102260    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgq2k" event={"ID":"1de5e7e5-a455-4326-b244-769090503f22","Type":"ContainerStarted","Data":"eb9d433bc8eb920cf6b299734ea46efb48d34d6da32f4d4569b9e47fa93019be"}
Jul 26 16:15:57.118913 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:57.118854    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr" podStartSLOduration=2.7213167780000003 podStartE2EDuration="4.118837426s" totalImagesPullingTime="1.397520648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:15:57.118114923 +0000 UTC m=+472.652814199" watchObservedRunningTime="2026-07-26 16:15:57.118837426 +0000 UTC m=+472.653536702"
Jul 26 16:15:58.197370 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.197311    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:58.250148 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.250102    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp"]
Jul 26 16:15:58.253678 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.253655    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp"
Jul 26 16:15:58.255906 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.255881    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 26 16:15:58.256016 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.255958    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5kmdp\""
Jul 26 16:15:58.256094 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.256076    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 26 16:15:58.260239 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.260216    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp"]
Jul 26 16:15:58.279201 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.279149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:58.388206 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.388164    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:15:58.433558 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.433530    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2mq5\" (UniqueName: \"kubernetes.io/projected/cd65ffc6-a847-47ba-8250-33b5dd136bc7-kube-api-access-s2mq5\") pod \"kuadrant-console-plugin-66b5774985-b6ggp\" (UID: \"cd65ffc6-a847-47ba-8250-33b5dd136bc7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp"
Jul 26 16:15:58.433701 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.433569    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd65ffc6-a847-47ba-8250-33b5dd136bc7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-b6ggp\" (UID: \"cd65ffc6-a847-47ba-8250-33b5dd136bc7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp"
Jul 26 16:15:58.433701 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.433588    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd65ffc6-a847-47ba-8250-33b5dd136bc7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-b6ggp\" (UID: \"cd65ffc6-a847-47ba-8250-33b5dd136bc7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp"
Jul 26 16:15:58.534546 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.534471    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2mq5\" (UniqueName: \"kubernetes.io/projected/cd65ffc6-a847-47ba-8250-33b5dd136bc7-kube-api-access-s2mq5\") pod \"kuadrant-console-plugin-66b5774985-b6ggp\" (UID: \"cd65ffc6-a847-47ba-8250-33b5dd136bc7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp"
Jul 26 16:15:58.534546 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.534514    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd65ffc6-a847-47ba-8250-33b5dd136bc7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-b6ggp\" (UID: \"cd65ffc6-a847-47ba-8250-33b5dd136bc7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp"
Jul 26 16:15:58.534546 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.534530    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd65ffc6-a847-47ba-8250-33b5dd136bc7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-b6ggp\" (UID: \"cd65ffc6-a847-47ba-8250-33b5dd136bc7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp"
Jul 26 16:15:58.535067 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.535047    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd65ffc6-a847-47ba-8250-33b5dd136bc7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-b6ggp\" (UID: \"cd65ffc6-a847-47ba-8250-33b5dd136bc7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp"
Jul 26 16:15:58.536810 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.536787    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd65ffc6-a847-47ba-8250-33b5dd136bc7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-b6ggp\" (UID: \"cd65ffc6-a847-47ba-8250-33b5dd136bc7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp"
Jul 26 16:15:58.543021 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.543000    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2mq5\" (UniqueName: \"kubernetes.io/projected/cd65ffc6-a847-47ba-8250-33b5dd136bc7-kube-api-access-s2mq5\") pod \"kuadrant-console-plugin-66b5774985-b6ggp\" (UID: \"cd65ffc6-a847-47ba-8250-33b5dd136bc7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp"
Jul 26 16:15:58.564841 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:58.564821    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp"
Jul 26 16:15:59.001710 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:59.001685    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp"]
Jul 26 16:15:59.003210 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:15:59.003176    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd65ffc6_a847_47ba_8250_33b5dd136bc7.slice/crio-c62b9ed89f9af942215e4df90d158f5f92de83def53ffd126cab972808cc5c1e WatchSource:0}: Error finding container c62b9ed89f9af942215e4df90d158f5f92de83def53ffd126cab972808cc5c1e: Status 404 returned error can't find the container with id c62b9ed89f9af942215e4df90d158f5f92de83def53ffd126cab972808cc5c1e
Jul 26 16:15:59.113258 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:59.113227    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgq2k" event={"ID":"1de5e7e5-a455-4326-b244-769090503f22","Type":"ContainerStarted","Data":"4291fb0cf771e80e6d59cd3b4b8832f06eedf435574de7211110c4690436ab53"}
Jul 26 16:15:59.113466 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:59.113406    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgq2k"
Jul 26 16:15:59.114427 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:59.114405    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp" event={"ID":"cd65ffc6-a847-47ba-8250-33b5dd136bc7","Type":"ContainerStarted","Data":"c62b9ed89f9af942215e4df90d158f5f92de83def53ffd126cab972808cc5c1e"}
Jul 26 16:15:59.151948 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:15:59.151869    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgq2k" podStartSLOduration=1.065889119 podStartE2EDuration="3.151855057s" totalImagesPullingTime="2.085965938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:15:59.149215917 +0000 UTC m=+474.683915192" watchObservedRunningTime="2026-07-26 16:15:59.151855057 +0000 UTC m=+474.686554376"
Jul 26 16:16:01.952026 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:01.951991    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:02.052616 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:02.052577    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:07.104624 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:07.104591    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:16:07.104982 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:07.104668    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-trqkk"
Jul 26 16:16:08.110370 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.110338    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:16:08.262840 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.262806    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:08.368047 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.367971    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:08.929382 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.929347    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"]
Jul 26 16:16:08.929632 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.929597    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f" podUID="6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0" containerName="manager" containerID="cri-o://ddb5247d252b5040b155cda4f8dbcf9290c2acb0edee390f82e6014a3209d5c4" gracePeriod=2
Jul 26 16:16:08.934727 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.934690    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"]
Jul 26 16:16:08.957683 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.957628    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"]
Jul 26 16:16:08.957821 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.957701    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"]
Jul 26 16:16:08.957979 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.957943    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr" podUID="2400d31a-970f-464f-832f-c1a952259e73" containerName="manager" containerID="cri-o://14f021f9923c15bb84114b29d1387367b460e642c88b2fd171f45ae9ca3d70b4" gracePeriod=2
Jul 26 16:16:08.958272 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.958251    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0" containerName="manager"
Jul 26 16:16:08.958363 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.958274    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0" containerName="manager"
Jul 26 16:16:08.958508 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.958367    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0" containerName="manager"
Jul 26 16:16:08.962106 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.961850    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"
Jul 26 16:16:08.964357 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.964329    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"]
Jul 26 16:16:08.970427 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.970375    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"]
Jul 26 16:16:08.978298 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.978275    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdzn4"]
Jul 26 16:16:08.978787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.978759    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2400d31a-970f-464f-832f-c1a952259e73" containerName="manager"
Jul 26 16:16:08.978787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.978778    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2400d31a-970f-464f-832f-c1a952259e73" containerName="manager"
Jul 26 16:16:08.978976 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.978872    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2400d31a-970f-464f-832f-c1a952259e73" containerName="manager"
Jul 26 16:16:08.982167 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.982148    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdzn4"
Jul 26 16:16:08.990574 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:08.990549    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdzn4"]
Jul 26 16:16:08.993917 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:16:08.993886    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-znncr\" is forbidden: User \"system:node:ip-10-0-131-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-99.ec2.internal' and this object" podUID="2400d31a-970f-464f-832f-c1a952259e73" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:16:09.023498 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:09.023469    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj25m\" (UniqueName: \"kubernetes.io/projected/666e33ce-b441-4eca-a978-7527a1222328-kube-api-access-dj25m\") pod \"limitador-operator-controller-manager-859d7b78bd-vdzn4\" (UID: \"666e33ce-b441-4eca-a978-7527a1222328\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdzn4"
Jul 26 16:16:09.023626 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:09.023514    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42cf2013-146a-4202-a718-0b8a9b25f271-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bmrwz\" (UID: \"42cf2013-146a-4202-a718-0b8a9b25f271\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"
Jul 26 16:16:09.023626 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:09.023548    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f575c\" (UniqueName: \"kubernetes.io/projected/42cf2013-146a-4202-a718-0b8a9b25f271-kube-api-access-f575c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bmrwz\" (UID: \"42cf2013-146a-4202-a718-0b8a9b25f271\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"
Jul 26 16:16:09.024492 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:16:09.024457    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-znncr\" is forbidden: User \"system:node:ip-10-0-131-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-99.ec2.internal' and this object" podUID="2400d31a-970f-464f-832f-c1a952259e73" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:16:09.124561 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:09.124523    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj25m\" (UniqueName: \"kubernetes.io/projected/666e33ce-b441-4eca-a978-7527a1222328-kube-api-access-dj25m\") pod \"limitador-operator-controller-manager-859d7b78bd-vdzn4\" (UID: \"666e33ce-b441-4eca-a978-7527a1222328\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdzn4"
Jul 26 16:16:09.125011 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:09.124572    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42cf2013-146a-4202-a718-0b8a9b25f271-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bmrwz\" (UID: \"42cf2013-146a-4202-a718-0b8a9b25f271\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"
Jul 26 16:16:09.125011 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:09.124598    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f575c\" (UniqueName: \"kubernetes.io/projected/42cf2013-146a-4202-a718-0b8a9b25f271-kube-api-access-f575c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bmrwz\" (UID: \"42cf2013-146a-4202-a718-0b8a9b25f271\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"
Jul 26 16:16:09.125011 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:09.124945    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42cf2013-146a-4202-a718-0b8a9b25f271-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bmrwz\" (UID: \"42cf2013-146a-4202-a718-0b8a9b25f271\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"
Jul 26 16:16:09.149497 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:09.149470    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj25m\" (UniqueName: \"kubernetes.io/projected/666e33ce-b441-4eca-a978-7527a1222328-kube-api-access-dj25m\") pod \"limitador-operator-controller-manager-859d7b78bd-vdzn4\" (UID: \"666e33ce-b441-4eca-a978-7527a1222328\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdzn4"
Jul 26 16:16:09.149497 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:09.149493    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f575c\" (UniqueName: \"kubernetes.io/projected/42cf2013-146a-4202-a718-0b8a9b25f271-kube-api-access-f575c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bmrwz\" (UID: \"42cf2013-146a-4202-a718-0b8a9b25f271\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"
Jul 26 16:16:09.358567 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:09.358531    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"
Jul 26 16:16:09.366101 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:09.366076    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdzn4"
Jul 26 16:16:10.122359 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:10.122330    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgq2k"
Jul 26 16:16:10.126867 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:16:10.126836    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-znncr\" is forbidden: User \"system:node:ip-10-0-131-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-99.ec2.internal' and this object" podUID="2400d31a-970f-464f-832f-c1a952259e73" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:16:11.218517 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:11.218464    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:11.312495 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:11.312461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:13.639855 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:13.639813    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:13.737439 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:13.737211    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:14.566551 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:14.566493    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:14.664695 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:14.664646    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:14.764934 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:14.764898    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:15.308330 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:15.308296    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:19.397894 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:19.397843    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:19.499966 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:19.499925    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:22.637607 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.637578    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:16:22.639751 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:16:22.639714    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-znncr\" is forbidden: User \"system:node:ip-10-0-131-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-99.ec2.internal' and this object" podUID="2400d31a-970f-464f-832f-c1a952259e73" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:16:22.646859 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.646837    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:16:22.648750 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:16:22.648724    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bsr9f\" is forbidden: User \"system:node:ip-10-0-131-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-99.ec2.internal' and this object" podUID="6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:16:22.649357 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.649336    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdzn4"]
Jul 26 16:16:22.650528 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:16:22.650502    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-znncr\" is forbidden: User \"system:node:ip-10-0-131-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-99.ec2.internal' and this object" podUID="2400d31a-970f-464f-832f-c1a952259e73" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:16:22.651375 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:16:22.651277    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666e33ce_b441_4eca_a978_7527a1222328.slice/crio-a6805ead1c999e67187ad7dbd7ef3fb42e566c6debac1eac3fb466b098191486 WatchSource:0}: Error finding container a6805ead1c999e67187ad7dbd7ef3fb42e566c6debac1eac3fb466b098191486: Status 404 returned error can't find the container with id a6805ead1c999e67187ad7dbd7ef3fb42e566c6debac1eac3fb466b098191486
Jul 26 16:16:22.663334 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.663314    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"]
Jul 26 16:16:22.665975 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:16:22.665947    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42cf2013_146a_4202_a718_0b8a9b25f271.slice/crio-4847117404d97e627a7bb6a0cfb674400c2658f705d344aa99469ddcf07f9ec6 WatchSource:0}: Error finding container 4847117404d97e627a7bb6a0cfb674400c2658f705d344aa99469ddcf07f9ec6: Status 404 returned error can't find the container with id 4847117404d97e627a7bb6a0cfb674400c2658f705d344aa99469ddcf07f9ec6
Jul 26 16:16:22.750783 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.750753    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0-extensions-socket-volume\") pod \"6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0\" (UID: \"6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0\") "
Jul 26 16:16:22.750956 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.750823    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6zdf\" (UniqueName: \"kubernetes.io/projected/2400d31a-970f-464f-832f-c1a952259e73-kube-api-access-l6zdf\") pod \"2400d31a-970f-464f-832f-c1a952259e73\" (UID: \"2400d31a-970f-464f-832f-c1a952259e73\") "
Jul 26 16:16:22.750956 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.750910    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g88lq\" (UniqueName: \"kubernetes.io/projected/6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0-kube-api-access-g88lq\") pod \"6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0\" (UID: \"6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0\") "
Jul 26 16:16:22.751217 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.751191    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0" (UID: "6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:16:22.753144 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.753096    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0-kube-api-access-g88lq" (OuterVolumeSpecName: "kube-api-access-g88lq") pod "6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0" (UID: "6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0"). InnerVolumeSpecName "kube-api-access-g88lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:16:22.753279 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.753260    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2400d31a-970f-464f-832f-c1a952259e73-kube-api-access-l6zdf" (OuterVolumeSpecName: "kube-api-access-l6zdf") pod "2400d31a-970f-464f-832f-c1a952259e73" (UID: "2400d31a-970f-464f-832f-c1a952259e73"). InnerVolumeSpecName "kube-api-access-l6zdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:16:22.852152 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.852113    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g88lq\" (UniqueName: \"kubernetes.io/projected/6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0-kube-api-access-g88lq\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:16:22.852152 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.852151    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0-extensions-socket-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:16:22.852321 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.852162    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6zdf\" (UniqueName: \"kubernetes.io/projected/2400d31a-970f-464f-832f-c1a952259e73-kube-api-access-l6zdf\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:16:22.956614 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.956542    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2400d31a-970f-464f-832f-c1a952259e73" path="/var/lib/kubelet/pods/2400d31a-970f-464f-832f-c1a952259e73/volumes"
Jul 26 16:16:22.956883 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:22.956870    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0" path="/var/lib/kubelet/pods/6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0/volumes"
Jul 26 16:16:23.248375 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.248302    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdzn4" event={"ID":"666e33ce-b441-4eca-a978-7527a1222328","Type":"ContainerStarted","Data":"6d9e76531ee17758eee1ab59fbb4c57cf25a6b5e55de860f74be36a4fc97321a"}
Jul 26 16:16:23.248375 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.248350    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdzn4" event={"ID":"666e33ce-b441-4eca-a978-7527a1222328","Type":"ContainerStarted","Data":"a6805ead1c999e67187ad7dbd7ef3fb42e566c6debac1eac3fb466b098191486"}
Jul 26 16:16:23.248572 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.248479    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdzn4"
Jul 26 16:16:23.250051 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.250028    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz" event={"ID":"42cf2013-146a-4202-a718-0b8a9b25f271","Type":"ContainerStarted","Data":"1b34514a325a684e13b06f6eabe9e597feddc6c9925e065cc96b51174a9f719d"}
Jul 26 16:16:23.250198 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.250065    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz" event={"ID":"42cf2013-146a-4202-a718-0b8a9b25f271","Type":"ContainerStarted","Data":"4847117404d97e627a7bb6a0cfb674400c2658f705d344aa99469ddcf07f9ec6"}
Jul 26 16:16:23.250198 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.250084    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"
Jul 26 16:16:23.251262 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.251239    2559 generic.go:356] "Generic (PLEG): container finished" podID="6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0" containerID="ddb5247d252b5040b155cda4f8dbcf9290c2acb0edee390f82e6014a3209d5c4" exitCode=0
Jul 26 16:16:23.251368 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.251278    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:16:23.251368 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.251329    2559 scope.go:117] "RemoveContainer" containerID="ddb5247d252b5040b155cda4f8dbcf9290c2acb0edee390f82e6014a3209d5c4"
Jul 26 16:16:23.252607 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.252580    2559 generic.go:356] "Generic (PLEG): container finished" podID="2400d31a-970f-464f-832f-c1a952259e73" containerID="14f021f9923c15bb84114b29d1387367b460e642c88b2fd171f45ae9ca3d70b4" exitCode=0
Jul 26 16:16:23.252730 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.252616    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:16:23.254357 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.254334    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp" event={"ID":"cd65ffc6-a847-47ba-8250-33b5dd136bc7","Type":"ContainerStarted","Data":"74b1c30f37e2cbd849e5981c612741e878de3c5058decfaf3bebbcd7072a6caa"}
Jul 26 16:16:23.259916 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.259898    2559 scope.go:117] "RemoveContainer" containerID="ddb5247d252b5040b155cda4f8dbcf9290c2acb0edee390f82e6014a3209d5c4"
Jul 26 16:16:23.260155 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:16:23.260116    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddb5247d252b5040b155cda4f8dbcf9290c2acb0edee390f82e6014a3209d5c4\": container with ID starting with ddb5247d252b5040b155cda4f8dbcf9290c2acb0edee390f82e6014a3209d5c4 not found: ID does not exist" containerID="ddb5247d252b5040b155cda4f8dbcf9290c2acb0edee390f82e6014a3209d5c4"
Jul 26 16:16:23.260245 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.260159    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddb5247d252b5040b155cda4f8dbcf9290c2acb0edee390f82e6014a3209d5c4"} err="failed to get container status \"ddb5247d252b5040b155cda4f8dbcf9290c2acb0edee390f82e6014a3209d5c4\": rpc error: code = NotFound desc = could not find container \"ddb5247d252b5040b155cda4f8dbcf9290c2acb0edee390f82e6014a3209d5c4\": container with ID starting with ddb5247d252b5040b155cda4f8dbcf9290c2acb0edee390f82e6014a3209d5c4 not found: ID does not exist"
Jul 26 16:16:23.260245 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.260174    2559 scope.go:117] "RemoveContainer" containerID="14f021f9923c15bb84114b29d1387367b460e642c88b2fd171f45ae9ca3d70b4"
Jul 26 16:16:23.265378 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.265338    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdzn4" podStartSLOduration=15.265326072 podStartE2EDuration="15.265326072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:16:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:16:23.264346141 +0000 UTC m=+498.799045417" watchObservedRunningTime="2026-07-26 16:16:23.265326072 +0000 UTC m=+498.800025325"
Jul 26 16:16:23.267904 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.267885    2559 scope.go:117] "RemoveContainer" containerID="14f021f9923c15bb84114b29d1387367b460e642c88b2fd171f45ae9ca3d70b4"
Jul 26 16:16:23.268139 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:16:23.268107    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14f021f9923c15bb84114b29d1387367b460e642c88b2fd171f45ae9ca3d70b4\": container with ID starting with 14f021f9923c15bb84114b29d1387367b460e642c88b2fd171f45ae9ca3d70b4 not found: ID does not exist" containerID="14f021f9923c15bb84114b29d1387367b460e642c88b2fd171f45ae9ca3d70b4"
Jul 26 16:16:23.268183 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.268152    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f021f9923c15bb84114b29d1387367b460e642c88b2fd171f45ae9ca3d70b4"} err="failed to get container status \"14f021f9923c15bb84114b29d1387367b460e642c88b2fd171f45ae9ca3d70b4\": rpc error: code = NotFound desc = could not find container \"14f021f9923c15bb84114b29d1387367b460e642c88b2fd171f45ae9ca3d70b4\": container with ID starting with 14f021f9923c15bb84114b29d1387367b460e642c88b2fd171f45ae9ca3d70b4 not found: ID does not exist"
Jul 26 16:16:23.280970 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.280929    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz" podStartSLOduration=15.280917776999999 podStartE2EDuration="15.280917777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:16:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:16:23.280004846 +0000 UTC m=+498.814704122" watchObservedRunningTime="2026-07-26 16:16:23.280917777 +0000 UTC m=+498.815617118"
Jul 26 16:16:23.294775 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:23.294741    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b6ggp" podStartSLOduration=1.75461439 podStartE2EDuration="25.294729517s" totalImagesPullingTime="23.540115127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:16:23.293680079 +0000 UTC m=+498.828379357" watchObservedRunningTime="2026-07-26 16:16:23.294729517 +0000 UTC m=+498.829428810"
Jul 26 16:16:23.295688 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:16:23.295666    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-znncr\" is forbidden: User \"system:node:ip-10-0-131-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-99.ec2.internal' and this object" podUID="2400d31a-970f-464f-832f-c1a952259e73" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:16:23.297328 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:16:23.297307    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bsr9f\" is forbidden: User \"system:node:ip-10-0-131-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-99.ec2.internal' and this object" podUID="6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:16:24.214105 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:24.214071    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:24.952603 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:16:24.952564    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bsr9f\" is forbidden: User \"system:node:ip-10-0-131-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-99.ec2.internal' and this object" podUID="6a3930e7-f7e3-49e7-b28c-8eec47cbbaa0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsr9f"
Jul 26 16:16:24.954415 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:16:24.954392    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-znncr\" is forbidden: User \"system:node:ip-10-0-131-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-99.ec2.internal' and this object" podUID="2400d31a-970f-464f-832f-c1a952259e73" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znncr"
Jul 26 16:16:25.350094 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:25.350019    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:25.450765 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:25.450733    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:25.508517 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:25.508494    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:27.227942 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:27.227914    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"]
Jul 26 16:16:27.228365 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:27.228082    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz" podUID="42cf2013-146a-4202-a718-0b8a9b25f271" containerName="manager" containerID="cri-o://1b34514a325a684e13b06f6eabe9e597feddc6c9925e065cc96b51174a9f719d" gracePeriod=10
Jul 26 16:16:27.229885 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:27.229862    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"
Jul 26 16:16:28.023203 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.023176    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"
Jul 26 16:16:28.095508 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.095481    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42cf2013-146a-4202-a718-0b8a9b25f271-extensions-socket-volume\") pod \"42cf2013-146a-4202-a718-0b8a9b25f271\" (UID: \"42cf2013-146a-4202-a718-0b8a9b25f271\") "
Jul 26 16:16:28.095641 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.095582    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f575c\" (UniqueName: \"kubernetes.io/projected/42cf2013-146a-4202-a718-0b8a9b25f271-kube-api-access-f575c\") pod \"42cf2013-146a-4202-a718-0b8a9b25f271\" (UID: \"42cf2013-146a-4202-a718-0b8a9b25f271\") "
Jul 26 16:16:28.095935 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.095875    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42cf2013-146a-4202-a718-0b8a9b25f271-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "42cf2013-146a-4202-a718-0b8a9b25f271" (UID: "42cf2013-146a-4202-a718-0b8a9b25f271"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:16:28.097476 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.097453    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42cf2013-146a-4202-a718-0b8a9b25f271-kube-api-access-f575c" (OuterVolumeSpecName: "kube-api-access-f575c") pod "42cf2013-146a-4202-a718-0b8a9b25f271" (UID: "42cf2013-146a-4202-a718-0b8a9b25f271"). InnerVolumeSpecName "kube-api-access-f575c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:16:28.197054 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.197012    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42cf2013-146a-4202-a718-0b8a9b25f271-extensions-socket-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:16:28.197054 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.197047    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f575c\" (UniqueName: \"kubernetes.io/projected/42cf2013-146a-4202-a718-0b8a9b25f271-kube-api-access-f575c\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:16:28.283606 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.283571    2559 generic.go:356] "Generic (PLEG): container finished" podID="42cf2013-146a-4202-a718-0b8a9b25f271" containerID="1b34514a325a684e13b06f6eabe9e597feddc6c9925e065cc96b51174a9f719d" exitCode=0
Jul 26 16:16:28.283977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.283618    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"
Jul 26 16:16:28.283977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.283654    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz" event={"ID":"42cf2013-146a-4202-a718-0b8a9b25f271","Type":"ContainerDied","Data":"1b34514a325a684e13b06f6eabe9e597feddc6c9925e065cc96b51174a9f719d"}
Jul 26 16:16:28.283977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.283708    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz" event={"ID":"42cf2013-146a-4202-a718-0b8a9b25f271","Type":"ContainerDied","Data":"4847117404d97e627a7bb6a0cfb674400c2658f705d344aa99469ddcf07f9ec6"}
Jul 26 16:16:28.283977 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.283731    2559 scope.go:117] "RemoveContainer" containerID="1b34514a325a684e13b06f6eabe9e597feddc6c9925e065cc96b51174a9f719d"
Jul 26 16:16:28.292801 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.292786    2559 scope.go:117] "RemoveContainer" containerID="1b34514a325a684e13b06f6eabe9e597feddc6c9925e065cc96b51174a9f719d"
Jul 26 16:16:28.293058 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:16:28.293037    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b34514a325a684e13b06f6eabe9e597feddc6c9925e065cc96b51174a9f719d\": container with ID starting with 1b34514a325a684e13b06f6eabe9e597feddc6c9925e065cc96b51174a9f719d not found: ID does not exist" containerID="1b34514a325a684e13b06f6eabe9e597feddc6c9925e065cc96b51174a9f719d"
Jul 26 16:16:28.293108 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.293065    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b34514a325a684e13b06f6eabe9e597feddc6c9925e065cc96b51174a9f719d"} err="failed to get container status \"1b34514a325a684e13b06f6eabe9e597feddc6c9925e065cc96b51174a9f719d\": rpc error: code = NotFound desc = could not find container \"1b34514a325a684e13b06f6eabe9e597feddc6c9925e065cc96b51174a9f719d\": container with ID starting with 1b34514a325a684e13b06f6eabe9e597feddc6c9925e065cc96b51174a9f719d not found: ID does not exist"
Jul 26 16:16:28.305951 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.305930    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"]
Jul 26 16:16:28.312001 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.311981    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bmrwz"]
Jul 26 16:16:28.954968 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:28.954934    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42cf2013-146a-4202-a718-0b8a9b25f271" path="/var/lib/kubelet/pods/42cf2013-146a-4202-a718-0b8a9b25f271/volumes"
Jul 26 16:16:29.804680 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:29.804648    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:29.867837 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:29.867806    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:30.397999 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:30.397962    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:30.499389 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:30.499354    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:33.796811 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:33.796772    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:33.896991 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:33.896954    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:34.263653 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:34.263622    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vdzn4"
Jul 26 16:16:36.194622 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:36.194587    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:36.293595 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:36.293540    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:43.515503 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.515470    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"]
Jul 26 16:16:43.516186 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.515989    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42cf2013-146a-4202-a718-0b8a9b25f271" containerName="manager"
Jul 26 16:16:43.516186 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.516003    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="42cf2013-146a-4202-a718-0b8a9b25f271" containerName="manager"
Jul 26 16:16:43.516186 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.516081    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="42cf2013-146a-4202-a718-0b8a9b25f271" containerName="manager"
Jul 26 16:16:43.536746 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.536710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:43.591118 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.591090    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"]
Jul 26 16:16:43.591252 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.591209    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.593633 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.593615    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7hhg9\""
Jul 26 16:16:43.593633 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.593620    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 26 16:16:43.726265 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.726229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.726265 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.726268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r776j\" (UniqueName: \"kubernetes.io/projected/c9bb9915-63d0-4798-805e-c3351f4a529a-kube-api-access-r776j\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.726449 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.726291    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9bb9915-63d0-4798-805e-c3351f4a529a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.726449 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.726366    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9bb9915-63d0-4798-805e-c3351f4a529a-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.726449 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.726397    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.726449 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.726415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.726449 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.726442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.726632 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.726461    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.726632 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.726542    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9bb9915-63d0-4798-805e-c3351f4a529a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.827705 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.827637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.827705 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.827676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9bb9915-63d0-4798-805e-c3351f4a529a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.827904 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.827709    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.827904 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.827726    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r776j\" (UniqueName: \"kubernetes.io/projected/c9bb9915-63d0-4798-805e-c3351f4a529a-kube-api-access-r776j\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.827904 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.827749    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9bb9915-63d0-4798-805e-c3351f4a529a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.827904 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.827780    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9bb9915-63d0-4798-805e-c3351f4a529a-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.827904 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.827831    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.827904 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.827870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.828246 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.827920    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.828246 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.828098    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.828327 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.828245    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.828327 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.828286    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.828453 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.828437    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9bb9915-63d0-4798-805e-c3351f4a529a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.828506 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.828437    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.830062 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.830042    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9bb9915-63d0-4798-805e-c3351f4a529a-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.830318 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.830296    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9bb9915-63d0-4798-805e-c3351f4a529a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.835315 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.835292    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9bb9915-63d0-4798-805e-c3351f4a529a-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.835399 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.835335    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r776j\" (UniqueName: \"kubernetes.io/projected/c9bb9915-63d0-4798-805e-c3351f4a529a-kube-api-access-r776j\") pod \"maas-default-gateway-openshift-default-5ccb968c66-85dpz\" (UID: \"c9bb9915-63d0-4798-805e-c3351f4a529a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:43.843616 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.843592    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:43.902089 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:43.902067    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:44.035936 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:44.035911    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"]
Jul 26 16:16:44.037563 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:16:44.037541    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9bb9915_63d0_4798_805e_c3351f4a529a.slice/crio-77f8ec757f56dddf82c3e1973bee3eecd818d8c6f711d6578b001792a3910b31 WatchSource:0}: Error finding container 77f8ec757f56dddf82c3e1973bee3eecd818d8c6f711d6578b001792a3910b31: Status 404 returned error can't find the container with id 77f8ec757f56dddf82c3e1973bee3eecd818d8c6f711d6578b001792a3910b31
Jul 26 16:16:44.359772 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:44.359735    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz" event={"ID":"c9bb9915-63d0-4798-805e-c3351f4a529a","Type":"ContainerStarted","Data":"77f8ec757f56dddf82c3e1973bee3eecd818d8c6f711d6578b001792a3910b31"}
Jul 26 16:16:46.865227 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:46.865185    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:16:46.865536 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:46.865275    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:16:46.865536 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:46.865307    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:16:47.380657 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:47.380623    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz" event={"ID":"c9bb9915-63d0-4798-805e-c3351f4a529a","Type":"ContainerStarted","Data":"8781127c5c7099c1065f8975be37a02b7ec9f38550d371c27158b0fb733942e7"}
Jul 26 16:16:47.402435 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:47.402387    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz" podStartSLOduration=1.577141579 podStartE2EDuration="4.4023716s" totalImagesPullingTime="2.825230021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:16:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:16:47.400140255 +0000 UTC m=+522.934839521" watchObservedRunningTime="2026-07-26 16:16:47.4023716 +0000 UTC m=+522.937070879"
Jul 26 16:16:47.902221 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:47.902190    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:47.906792 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:47.906767    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:48.385350 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.385320    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:48.386157 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.386139    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:16:48.405468 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.405437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:48.412796 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.410077    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"]
Jul 26 16:16:48.415343 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.415321    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"
Jul 26 16:16:48.418721 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.418696    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 26 16:16:48.423154 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.423110    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"]
Jul 26 16:16:48.466151 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.466102    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqvwl\" (UniqueName: \"kubernetes.io/projected/0fda85f7-3208-47ea-9c76-644e6906ce2b-kube-api-access-dqvwl\") pod \"limitador-limitador-64c94fd64f-jrbpv\" (UID: \"0fda85f7-3208-47ea-9c76-644e6906ce2b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"
Jul 26 16:16:48.466310 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.466235    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0fda85f7-3208-47ea-9c76-644e6906ce2b-config-file\") pod \"limitador-limitador-64c94fd64f-jrbpv\" (UID: \"0fda85f7-3208-47ea-9c76-644e6906ce2b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"
Jul 26 16:16:48.511225 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.511188    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"]
Jul 26 16:16:48.518397 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.518361    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:48.566663 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.566633    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqvwl\" (UniqueName: \"kubernetes.io/projected/0fda85f7-3208-47ea-9c76-644e6906ce2b-kube-api-access-dqvwl\") pod \"limitador-limitador-64c94fd64f-jrbpv\" (UID: \"0fda85f7-3208-47ea-9c76-644e6906ce2b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"
Jul 26 16:16:48.566825 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.566688    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0fda85f7-3208-47ea-9c76-644e6906ce2b-config-file\") pod \"limitador-limitador-64c94fd64f-jrbpv\" (UID: \"0fda85f7-3208-47ea-9c76-644e6906ce2b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"
Jul 26 16:16:48.567296 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.567279    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0fda85f7-3208-47ea-9c76-644e6906ce2b-config-file\") pod \"limitador-limitador-64c94fd64f-jrbpv\" (UID: \"0fda85f7-3208-47ea-9c76-644e6906ce2b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"
Jul 26 16:16:48.574315 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.574293    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqvwl\" (UniqueName: \"kubernetes.io/projected/0fda85f7-3208-47ea-9c76-644e6906ce2b-kube-api-access-dqvwl\") pod \"limitador-limitador-64c94fd64f-jrbpv\" (UID: \"0fda85f7-3208-47ea-9c76-644e6906ce2b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"
Jul 26 16:16:48.617587 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.617548    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:48.730843 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.730809    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"
Jul 26 16:16:48.861383 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:48.861356    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"]
Jul 26 16:16:48.863384 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:16:48.863359    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fda85f7_3208_47ea_9c76_644e6906ce2b.slice/crio-51c49b744998d933dc8a3528551c7385d118b0d2be4a36b7370e1b02b52f2567 WatchSource:0}: Error finding container 51c49b744998d933dc8a3528551c7385d118b0d2be4a36b7370e1b02b52f2567: Status 404 returned error can't find the container with id 51c49b744998d933dc8a3528551c7385d118b0d2be4a36b7370e1b02b52f2567
Jul 26 16:16:49.232052 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:49.232013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:49.293794 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:49.293765    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:49.310738 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:49.310709    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-fprpt"]
Jul 26 16:16:49.315480 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:49.315462    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fprpt"
Jul 26 16:16:49.318058 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:49.318034    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-krgkv\""
Jul 26 16:16:49.320203 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:49.320180    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fprpt"]
Jul 26 16:16:49.373469 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:49.373444    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s42mz\" (UniqueName: \"kubernetes.io/projected/d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd-kube-api-access-s42mz\") pod \"authorino-75d556bd77-fprpt\" (UID: \"d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd\") " pod="kuadrant-system/authorino-75d556bd77-fprpt"
Jul 26 16:16:49.391041 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:49.391012    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv" event={"ID":"0fda85f7-3208-47ea-9c76-644e6906ce2b","Type":"ContainerStarted","Data":"51c49b744998d933dc8a3528551c7385d118b0d2be4a36b7370e1b02b52f2567"}
Jul 26 16:16:49.474616 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:49.474583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s42mz\" (UniqueName: \"kubernetes.io/projected/d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd-kube-api-access-s42mz\") pod \"authorino-75d556bd77-fprpt\" (UID: \"d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd\") " pod="kuadrant-system/authorino-75d556bd77-fprpt"
Jul 26 16:16:49.482638 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:49.482583    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s42mz\" (UniqueName: \"kubernetes.io/projected/d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd-kube-api-access-s42mz\") pod \"authorino-75d556bd77-fprpt\" (UID: \"d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd\") " pod="kuadrant-system/authorino-75d556bd77-fprpt"
Jul 26 16:16:49.625192 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:49.624897    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fprpt"
Jul 26 16:16:49.809156 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:49.809080    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fprpt"]
Jul 26 16:16:50.400620 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:50.400545    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fprpt" event={"ID":"d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd","Type":"ContainerStarted","Data":"fa3aeab8a5401aad861bc6ea17bd01e680375e50102a61c0a204a39e90996dcb"}
Jul 26 16:16:51.357612 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:51.357571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:16:54.423745 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:54.423705    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fprpt" event={"ID":"d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd","Type":"ContainerStarted","Data":"83d6e98fd5cf9e41a9e939356ae0b1b405484efad5b99709974984774291ddf2"}
Jul 26 16:16:54.425181 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:54.425155    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv" event={"ID":"0fda85f7-3208-47ea-9c76-644e6906ce2b","Type":"ContainerStarted","Data":"703630d682be53142df457503101f62f0a6c6eb0b013cf04b1b2b40c6f5c8093"}
Jul 26 16:16:54.425292 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:54.425249    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"
Jul 26 16:16:54.446993 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:54.446955    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-fprpt" podStartSLOduration=1.658304835 podStartE2EDuration="5.446942472s" totalImagesPullingTime="3.788637637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:16:54.445351276 +0000 UTC m=+529.980050552" watchObservedRunningTime="2026-07-26 16:16:54.446942472 +0000 UTC m=+529.981641725"
Jul 26 16:16:54.473183 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:16:54.473120    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv" podStartSLOduration=1.745292599 podStartE2EDuration="6.473103049s" totalImagesPullingTime="4.72781045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:16:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:16:54.470979601 +0000 UTC m=+530.005678877" watchObservedRunningTime="2026-07-26 16:16:54.473103049 +0000 UTC m=+530.007802323"
Jul 26 16:17:05.431978 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:05.431898    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"
Jul 26 16:17:05.611429 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:05.611393    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"]
Jul 26 16:17:05.611612 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:05.611588    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv" podUID="0fda85f7-3208-47ea-9c76-644e6906ce2b" containerName="limitador" containerID="cri-o://703630d682be53142df457503101f62f0a6c6eb0b013cf04b1b2b40c6f5c8093" gracePeriod=30
Jul 26 16:17:06.163154 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.163113    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"
Jul 26 16:17:06.217302 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.217273    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqvwl\" (UniqueName: \"kubernetes.io/projected/0fda85f7-3208-47ea-9c76-644e6906ce2b-kube-api-access-dqvwl\") pod \"0fda85f7-3208-47ea-9c76-644e6906ce2b\" (UID: \"0fda85f7-3208-47ea-9c76-644e6906ce2b\") "
Jul 26 16:17:06.217438 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.217355    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0fda85f7-3208-47ea-9c76-644e6906ce2b-config-file\") pod \"0fda85f7-3208-47ea-9c76-644e6906ce2b\" (UID: \"0fda85f7-3208-47ea-9c76-644e6906ce2b\") "
Jul 26 16:17:06.217692 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.217669    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fda85f7-3208-47ea-9c76-644e6906ce2b-config-file" (OuterVolumeSpecName: "config-file") pod "0fda85f7-3208-47ea-9c76-644e6906ce2b" (UID: "0fda85f7-3208-47ea-9c76-644e6906ce2b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:17:06.219373 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.219354    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fda85f7-3208-47ea-9c76-644e6906ce2b-kube-api-access-dqvwl" (OuterVolumeSpecName: "kube-api-access-dqvwl") pod "0fda85f7-3208-47ea-9c76-644e6906ce2b" (UID: "0fda85f7-3208-47ea-9c76-644e6906ce2b"). InnerVolumeSpecName "kube-api-access-dqvwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:17:06.318297 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.318261    2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0fda85f7-3208-47ea-9c76-644e6906ce2b-config-file\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:17:06.318297 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.318290    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqvwl\" (UniqueName: \"kubernetes.io/projected/0fda85f7-3208-47ea-9c76-644e6906ce2b-kube-api-access-dqvwl\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:17:06.483367 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.483283    2559 generic.go:356] "Generic (PLEG): container finished" podID="0fda85f7-3208-47ea-9c76-644e6906ce2b" containerID="703630d682be53142df457503101f62f0a6c6eb0b013cf04b1b2b40c6f5c8093" exitCode=0
Jul 26 16:17:06.483367 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.483322    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"
Jul 26 16:17:06.483778 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.483359    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv" event={"ID":"0fda85f7-3208-47ea-9c76-644e6906ce2b","Type":"ContainerDied","Data":"703630d682be53142df457503101f62f0a6c6eb0b013cf04b1b2b40c6f5c8093"}
Jul 26 16:17:06.483778 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.483410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jrbpv" event={"ID":"0fda85f7-3208-47ea-9c76-644e6906ce2b","Type":"ContainerDied","Data":"51c49b744998d933dc8a3528551c7385d118b0d2be4a36b7370e1b02b52f2567"}
Jul 26 16:17:06.483778 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.483433    2559 scope.go:117] "RemoveContainer" containerID="703630d682be53142df457503101f62f0a6c6eb0b013cf04b1b2b40c6f5c8093"
Jul 26 16:17:06.492827 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.492811    2559 scope.go:117] "RemoveContainer" containerID="703630d682be53142df457503101f62f0a6c6eb0b013cf04b1b2b40c6f5c8093"
Jul 26 16:17:06.493067 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:17:06.493042    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"703630d682be53142df457503101f62f0a6c6eb0b013cf04b1b2b40c6f5c8093\": container with ID starting with 703630d682be53142df457503101f62f0a6c6eb0b013cf04b1b2b40c6f5c8093 not found: ID does not exist" containerID="703630d682be53142df457503101f62f0a6c6eb0b013cf04b1b2b40c6f5c8093"
Jul 26 16:17:06.493118 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.493076    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"703630d682be53142df457503101f62f0a6c6eb0b013cf04b1b2b40c6f5c8093"} err="failed to get container status \"703630d682be53142df457503101f62f0a6c6eb0b013cf04b1b2b40c6f5c8093\": rpc error: code = NotFound desc = could not find container \"703630d682be53142df457503101f62f0a6c6eb0b013cf04b1b2b40c6f5c8093\": container with ID starting with 703630d682be53142df457503101f62f0a6c6eb0b013cf04b1b2b40c6f5c8093 not found: ID does not exist"
Jul 26 16:17:06.506564 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.506538    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"]
Jul 26 16:17:06.508135 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.508102    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jrbpv"]
Jul 26 16:17:06.954690 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:06.954659    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fda85f7-3208-47ea-9c76-644e6906ce2b" path="/var/lib/kubelet/pods/0fda85f7-3208-47ea-9c76-644e6906ce2b/volumes"
Jul 26 16:17:09.751559 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:09.751522    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:17:09.852848 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:09.852816    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:17:10.221387 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.221355    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v"]
Jul 26 16:17:10.221778 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.221761    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fda85f7-3208-47ea-9c76-644e6906ce2b" containerName="limitador"
Jul 26 16:17:10.221778 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.221778    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fda85f7-3208-47ea-9c76-644e6906ce2b" containerName="limitador"
Jul 26 16:17:10.221930 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.221849    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fda85f7-3208-47ea-9c76-644e6906ce2b" containerName="limitador"
Jul 26 16:17:10.226377 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.226356    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v"
Jul 26 16:17:10.228960 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.228940    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 26 16:17:10.229190 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.229175    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 26 16:17:10.229837 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.229819    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-vx7lj\""
Jul 26 16:17:10.229930 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.229827    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:17:10.233270 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.233248    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v"]
Jul 26 16:17:10.251426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.251400    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:17:10.353019 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.352972    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n64kz\" (UniqueName: \"kubernetes.io/projected/b24e3e6b-baa1-4910-9471-c7333b38d00e-kube-api-access-n64kz\") pod \"postgres-69fb4594cf-s7v4v\" (UID: \"b24e3e6b-baa1-4910-9471-c7333b38d00e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v"
Jul 26 16:17:10.353213 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.353065    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b24e3e6b-baa1-4910-9471-c7333b38d00e-data\") pod \"postgres-69fb4594cf-s7v4v\" (UID: \"b24e3e6b-baa1-4910-9471-c7333b38d00e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v"
Jul 26 16:17:10.453823 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.453782    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b24e3e6b-baa1-4910-9471-c7333b38d00e-data\") pod \"postgres-69fb4594cf-s7v4v\" (UID: \"b24e3e6b-baa1-4910-9471-c7333b38d00e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v"
Jul 26 16:17:10.453993 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.453894    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n64kz\" (UniqueName: \"kubernetes.io/projected/b24e3e6b-baa1-4910-9471-c7333b38d00e-kube-api-access-n64kz\") pod \"postgres-69fb4594cf-s7v4v\" (UID: \"b24e3e6b-baa1-4910-9471-c7333b38d00e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v"
Jul 26 16:17:10.454169 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.454149    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b24e3e6b-baa1-4910-9471-c7333b38d00e-data\") pod \"postgres-69fb4594cf-s7v4v\" (UID: \"b24e3e6b-baa1-4910-9471-c7333b38d00e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v"
Jul 26 16:17:10.462742 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.462715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n64kz\" (UniqueName: \"kubernetes.io/projected/b24e3e6b-baa1-4910-9471-c7333b38d00e-kube-api-access-n64kz\") pod \"postgres-69fb4594cf-s7v4v\" (UID: \"b24e3e6b-baa1-4910-9471-c7333b38d00e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v"
Jul 26 16:17:10.538162 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.538064    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v"
Jul 26 16:17:10.669014 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:10.668991    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v"]
Jul 26 16:17:10.671569 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:17:10.671547    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24e3e6b_baa1_4910_9471_c7333b38d00e.slice/crio-29785f4e90f657627e6c6361fd78e66a455611df7b2853c349d7828cc0cec56b WatchSource:0}: Error finding container 29785f4e90f657627e6c6361fd78e66a455611df7b2853c349d7828cc0cec56b: Status 404 returned error can't find the container with id 29785f4e90f657627e6c6361fd78e66a455611df7b2853c349d7828cc0cec56b
Jul 26 16:17:11.515415 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:11.515375    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v" event={"ID":"b24e3e6b-baa1-4910-9471-c7333b38d00e","Type":"ContainerStarted","Data":"29785f4e90f657627e6c6361fd78e66a455611df7b2853c349d7828cc0cec56b"}
Jul 26 16:17:16.543606 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:16.543571    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v" event={"ID":"b24e3e6b-baa1-4910-9471-c7333b38d00e","Type":"ContainerStarted","Data":"5e86274db2dbb431e7f9d95e14bc8bab6a74c04ac1cad0ae3d966e8405dbdee6"}
Jul 26 16:17:16.544159 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:16.543690    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v"
Jul 26 16:17:16.559556 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:16.559500    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v" podStartSLOduration=1.750397703 podStartE2EDuration="6.559485713s" totalImagesPullingTime="4.80908801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:17:16.557780465 +0000 UTC m=+552.092479766" watchObservedRunningTime="2026-07-26 16:17:16.559485713 +0000 UTC m=+552.094184988"
Jul 26 16:17:22.576186 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:22.576156    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s7v4v"
Jul 26 16:17:22.892619 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:22.892511    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:17:23.112192 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.112162    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nxllj"]
Jul 26 16:17:23.206152 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.206100    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nxllj"]
Jul 26 16:17:23.206318 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.206231    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nxllj"
Jul 26 16:17:23.230460 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.230431    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:17:23.272586 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.272559    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbk9t\" (UniqueName: \"kubernetes.io/projected/2b6bd085-f29b-4dc0-a09d-012bd9d8aa13-kube-api-access-fbk9t\") pod \"authorino-5d4b67c446-nxllj\" (UID: \"2b6bd085-f29b-4dc0-a09d-012bd9d8aa13\") " pod="kuadrant-system/authorino-5d4b67c446-nxllj"
Jul 26 16:17:23.322067 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.322033    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nxllj"]
Jul 26 16:17:23.322295 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:17:23.322277    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-fbk9t], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-nxllj" podUID="2b6bd085-f29b-4dc0-a09d-012bd9d8aa13"
Jul 26 16:17:23.347916 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.347887    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-hvhx6"]
Jul 26 16:17:23.373443 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.373411    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-hvhx6"]
Jul 26 16:17:23.373443 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.373416    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbk9t\" (UniqueName: \"kubernetes.io/projected/2b6bd085-f29b-4dc0-a09d-012bd9d8aa13-kube-api-access-fbk9t\") pod \"authorino-5d4b67c446-nxllj\" (UID: \"2b6bd085-f29b-4dc0-a09d-012bd9d8aa13\") " pod="kuadrant-system/authorino-5d4b67c446-nxllj"
Jul 26 16:17:23.373656 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.373557    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-hvhx6"
Jul 26 16:17:23.388345 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.388324    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 26 16:17:23.390774 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.390754    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbk9t\" (UniqueName: \"kubernetes.io/projected/2b6bd085-f29b-4dc0-a09d-012bd9d8aa13-kube-api-access-fbk9t\") pod \"authorino-5d4b67c446-nxllj\" (UID: \"2b6bd085-f29b-4dc0-a09d-012bd9d8aa13\") " pod="kuadrant-system/authorino-5d4b67c446-nxllj"
Jul 26 16:17:23.391401 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.391382    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-hvhx6"]
Jul 26 16:17:23.391689 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:17:23.391666    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bxvp6 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-bxvp6 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-hvhx6" podUID="2ecbcce8-eb59-4f14-9892-9929c34377fd"
Jul 26 16:17:23.420349 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.420325    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c78f66b7b-9whv4"]
Jul 26 16:17:23.438053 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.438028    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c78f66b7b-9whv4"]
Jul 26 16:17:23.438233 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.438191    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c78f66b7b-9whv4"
Jul 26 16:17:23.474844 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.474774    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ecbcce8-eb59-4f14-9892-9929c34377fd-tls-cert\") pod \"authorino-76877994-hvhx6\" (UID: \"2ecbcce8-eb59-4f14-9892-9929c34377fd\") " pod="kuadrant-system/authorino-76877994-hvhx6"
Jul 26 16:17:23.474844 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.474836    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxvp6\" (UniqueName: \"kubernetes.io/projected/2ecbcce8-eb59-4f14-9892-9929c34377fd-kube-api-access-bxvp6\") pod \"authorino-76877994-hvhx6\" (UID: \"2ecbcce8-eb59-4f14-9892-9929c34377fd\") " pod="kuadrant-system/authorino-76877994-hvhx6"
Jul 26 16:17:23.575404 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.575374    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ecbcce8-eb59-4f14-9892-9929c34377fd-tls-cert\") pod \"authorino-76877994-hvhx6\" (UID: \"2ecbcce8-eb59-4f14-9892-9929c34377fd\") " pod="kuadrant-system/authorino-76877994-hvhx6"
Jul 26 16:17:23.575583 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.575422    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c266646-b6b8-42a2-b81a-3cecbf7ccdb5-tls-cert\") pod \"authorino-c78f66b7b-9whv4\" (UID: \"1c266646-b6b8-42a2-b81a-3cecbf7ccdb5\") " pod="kuadrant-system/authorino-c78f66b7b-9whv4"
Jul 26 16:17:23.575583 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.575450    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p4x7\" (UniqueName: \"kubernetes.io/projected/1c266646-b6b8-42a2-b81a-3cecbf7ccdb5-kube-api-access-6p4x7\") pod \"authorino-c78f66b7b-9whv4\" (UID: \"1c266646-b6b8-42a2-b81a-3cecbf7ccdb5\") " pod="kuadrant-system/authorino-c78f66b7b-9whv4"
Jul 26 16:17:23.575583 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.575479    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxvp6\" (UniqueName: \"kubernetes.io/projected/2ecbcce8-eb59-4f14-9892-9929c34377fd-kube-api-access-bxvp6\") pod \"authorino-76877994-hvhx6\" (UID: \"2ecbcce8-eb59-4f14-9892-9929c34377fd\") " pod="kuadrant-system/authorino-76877994-hvhx6"
Jul 26 16:17:23.576272 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.576248    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-hvhx6"
Jul 26 16:17:23.576674 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.576251    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nxllj"
Jul 26 16:17:23.578063 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.578032    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ecbcce8-eb59-4f14-9892-9929c34377fd-tls-cert\") pod \"authorino-76877994-hvhx6\" (UID: \"2ecbcce8-eb59-4f14-9892-9929c34377fd\") " pod="kuadrant-system/authorino-76877994-hvhx6"
Jul 26 16:17:23.584065 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.584043    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxvp6\" (UniqueName: \"kubernetes.io/projected/2ecbcce8-eb59-4f14-9892-9929c34377fd-kube-api-access-bxvp6\") pod \"authorino-76877994-hvhx6\" (UID: \"2ecbcce8-eb59-4f14-9892-9929c34377fd\") " pod="kuadrant-system/authorino-76877994-hvhx6"
Jul 26 16:17:23.618538 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.618510    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-hvhx6"
Jul 26 16:17:23.630551 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.630529    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nxllj"
Jul 26 16:17:23.676455 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.676428    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ecbcce8-eb59-4f14-9892-9929c34377fd-tls-cert\") pod \"2ecbcce8-eb59-4f14-9892-9929c34377fd\" (UID: \"2ecbcce8-eb59-4f14-9892-9929c34377fd\") "
Jul 26 16:17:23.676564 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.676533    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxvp6\" (UniqueName: \"kubernetes.io/projected/2ecbcce8-eb59-4f14-9892-9929c34377fd-kube-api-access-bxvp6\") pod \"2ecbcce8-eb59-4f14-9892-9929c34377fd\" (UID: \"2ecbcce8-eb59-4f14-9892-9929c34377fd\") "
Jul 26 16:17:23.676691 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.676674    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c266646-b6b8-42a2-b81a-3cecbf7ccdb5-tls-cert\") pod \"authorino-c78f66b7b-9whv4\" (UID: \"1c266646-b6b8-42a2-b81a-3cecbf7ccdb5\") " pod="kuadrant-system/authorino-c78f66b7b-9whv4"
Jul 26 16:17:23.676733 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.676712    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p4x7\" (UniqueName: \"kubernetes.io/projected/1c266646-b6b8-42a2-b81a-3cecbf7ccdb5-kube-api-access-6p4x7\") pod \"authorino-c78f66b7b-9whv4\" (UID: \"1c266646-b6b8-42a2-b81a-3cecbf7ccdb5\") " pod="kuadrant-system/authorino-c78f66b7b-9whv4"
Jul 26 16:17:23.678661 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.678635    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ecbcce8-eb59-4f14-9892-9929c34377fd-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2ecbcce8-eb59-4f14-9892-9929c34377fd" (UID: "2ecbcce8-eb59-4f14-9892-9929c34377fd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:17:23.678800 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.678686    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ecbcce8-eb59-4f14-9892-9929c34377fd-kube-api-access-bxvp6" (OuterVolumeSpecName: "kube-api-access-bxvp6") pod "2ecbcce8-eb59-4f14-9892-9929c34377fd" (UID: "2ecbcce8-eb59-4f14-9892-9929c34377fd"). InnerVolumeSpecName "kube-api-access-bxvp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:17:23.679065 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.679043    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c266646-b6b8-42a2-b81a-3cecbf7ccdb5-tls-cert\") pod \"authorino-c78f66b7b-9whv4\" (UID: \"1c266646-b6b8-42a2-b81a-3cecbf7ccdb5\") " pod="kuadrant-system/authorino-c78f66b7b-9whv4"
Jul 26 16:17:23.684847 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.684823    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p4x7\" (UniqueName: \"kubernetes.io/projected/1c266646-b6b8-42a2-b81a-3cecbf7ccdb5-kube-api-access-6p4x7\") pod \"authorino-c78f66b7b-9whv4\" (UID: \"1c266646-b6b8-42a2-b81a-3cecbf7ccdb5\") " pod="kuadrant-system/authorino-c78f66b7b-9whv4"
Jul 26 16:17:23.748638 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.748567    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c78f66b7b-9whv4"
Jul 26 16:17:23.777415 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.777393    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbk9t\" (UniqueName: \"kubernetes.io/projected/2b6bd085-f29b-4dc0-a09d-012bd9d8aa13-kube-api-access-fbk9t\") pod \"2b6bd085-f29b-4dc0-a09d-012bd9d8aa13\" (UID: \"2b6bd085-f29b-4dc0-a09d-012bd9d8aa13\") "
Jul 26 16:17:23.777668 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.777650    2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ecbcce8-eb59-4f14-9892-9929c34377fd-tls-cert\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:17:23.777731 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.777675    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxvp6\" (UniqueName: \"kubernetes.io/projected/2ecbcce8-eb59-4f14-9892-9929c34377fd-kube-api-access-bxvp6\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:17:23.779382 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.779356    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b6bd085-f29b-4dc0-a09d-012bd9d8aa13-kube-api-access-fbk9t" (OuterVolumeSpecName: "kube-api-access-fbk9t") pod "2b6bd085-f29b-4dc0-a09d-012bd9d8aa13" (UID: "2b6bd085-f29b-4dc0-a09d-012bd9d8aa13"). InnerVolumeSpecName "kube-api-access-fbk9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:17:23.878738 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.878706    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbk9t\" (UniqueName: \"kubernetes.io/projected/2b6bd085-f29b-4dc0-a09d-012bd9d8aa13-kube-api-access-fbk9t\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:17:23.897369 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:23.897342    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c78f66b7b-9whv4"]
Jul 26 16:17:23.899418 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:17:23.899391    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c266646_b6b8_42a2_b81a_3cecbf7ccdb5.slice/crio-fe55c05a24468f71cb05d9e7ad891c782e5a52c17909e0ae613c7180327fa82a WatchSource:0}: Error finding container fe55c05a24468f71cb05d9e7ad891c782e5a52c17909e0ae613c7180327fa82a: Status 404 returned error can't find the container with id fe55c05a24468f71cb05d9e7ad891c782e5a52c17909e0ae613c7180327fa82a
Jul 26 16:17:24.582959 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.582874    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-hvhx6"
Jul 26 16:17:24.582959 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.582915    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c78f66b7b-9whv4" event={"ID":"1c266646-b6b8-42a2-b81a-3cecbf7ccdb5","Type":"ContainerStarted","Data":"f49159bb5b3c03bb29763127786c17904185dfbdd73a7b3ebe86f9a5e16d1275"}
Jul 26 16:17:24.583397 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.582961    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c78f66b7b-9whv4" event={"ID":"1c266646-b6b8-42a2-b81a-3cecbf7ccdb5","Type":"ContainerStarted","Data":"fe55c05a24468f71cb05d9e7ad891c782e5a52c17909e0ae613c7180327fa82a"}
Jul 26 16:17:24.583397 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.583118    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nxllj"
Jul 26 16:17:24.597577 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.597537    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c78f66b7b-9whv4" podStartSLOduration=1.230127259 podStartE2EDuration="1.597523542s" totalImagesPullingTime="367.396283ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:17:24.59734479 +0000 UTC m=+560.132044062" watchObservedRunningTime="2026-07-26 16:17:24.597523542 +0000 UTC m=+560.132222817"
Jul 26 16:17:24.622945 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.622920    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fprpt"]
Jul 26 16:17:24.623102 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.623082    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-fprpt" podUID="d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd" containerName="authorino" containerID="cri-o://83d6e98fd5cf9e41a9e939356ae0b1b405484efad5b99709974984774291ddf2" gracePeriod=30
Jul 26 16:17:24.630041 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.630015    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nxllj"]
Jul 26 16:17:24.635539 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.635502    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nxllj"]
Jul 26 16:17:24.655676 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.655649    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-hvhx6"]
Jul 26 16:17:24.657249 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.657225    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-hvhx6"]
Jul 26 16:17:24.876436 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.876413    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fprpt"
Jul 26 16:17:24.957844 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.957802    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b6bd085-f29b-4dc0-a09d-012bd9d8aa13" path="/var/lib/kubelet/pods/2b6bd085-f29b-4dc0-a09d-012bd9d8aa13/volumes"
Jul 26 16:17:24.958167 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.958146    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ecbcce8-eb59-4f14-9892-9929c34377fd" path="/var/lib/kubelet/pods/2ecbcce8-eb59-4f14-9892-9929c34377fd/volumes"
Jul 26 16:17:24.990263 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.990230    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s42mz\" (UniqueName: \"kubernetes.io/projected/d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd-kube-api-access-s42mz\") pod \"d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd\" (UID: \"d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd\") "
Jul 26 16:17:24.992286 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:24.992263    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd-kube-api-access-s42mz" (OuterVolumeSpecName: "kube-api-access-s42mz") pod "d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd" (UID: "d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd"). InnerVolumeSpecName "kube-api-access-s42mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:17:25.090809 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:25.090778    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s42mz\" (UniqueName: \"kubernetes.io/projected/d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd-kube-api-access-s42mz\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:17:25.591432 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:25.591395    2559 generic.go:356] "Generic (PLEG): container finished" podID="d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd" containerID="83d6e98fd5cf9e41a9e939356ae0b1b405484efad5b99709974984774291ddf2" exitCode=0
Jul 26 16:17:25.591432 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:25.591435    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fprpt"
Jul 26 16:17:25.591973 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:25.591482    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fprpt" event={"ID":"d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd","Type":"ContainerDied","Data":"83d6e98fd5cf9e41a9e939356ae0b1b405484efad5b99709974984774291ddf2"}
Jul 26 16:17:25.591973 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:25.591529    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fprpt" event={"ID":"d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd","Type":"ContainerDied","Data":"fa3aeab8a5401aad861bc6ea17bd01e680375e50102a61c0a204a39e90996dcb"}
Jul 26 16:17:25.591973 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:25.591550    2559 scope.go:117] "RemoveContainer" containerID="83d6e98fd5cf9e41a9e939356ae0b1b405484efad5b99709974984774291ddf2"
Jul 26 16:17:25.600059 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:25.600042    2559 scope.go:117] "RemoveContainer" containerID="83d6e98fd5cf9e41a9e939356ae0b1b405484efad5b99709974984774291ddf2"
Jul 26 16:17:25.600332 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:17:25.600314    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83d6e98fd5cf9e41a9e939356ae0b1b405484efad5b99709974984774291ddf2\": container with ID starting with 83d6e98fd5cf9e41a9e939356ae0b1b405484efad5b99709974984774291ddf2 not found: ID does not exist" containerID="83d6e98fd5cf9e41a9e939356ae0b1b405484efad5b99709974984774291ddf2"
Jul 26 16:17:25.600384 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:25.600339    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83d6e98fd5cf9e41a9e939356ae0b1b405484efad5b99709974984774291ddf2"} err="failed to get container status \"83d6e98fd5cf9e41a9e939356ae0b1b405484efad5b99709974984774291ddf2\": rpc error: code = NotFound desc = could not find container \"83d6e98fd5cf9e41a9e939356ae0b1b405484efad5b99709974984774291ddf2\": container with ID starting with 83d6e98fd5cf9e41a9e939356ae0b1b405484efad5b99709974984774291ddf2 not found: ID does not exist"
Jul 26 16:17:25.612482 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:25.612458    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fprpt"]
Jul 26 16:17:25.617023 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:25.617002    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fprpt"]
Jul 26 16:17:26.955030 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:26.954992    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd" path="/var/lib/kubelet/pods/d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd/volumes"
Jul 26 16:17:29.406253 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.406221    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:17:29.495945 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.495907    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:17:29.590089 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.590033    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:17:29.594087 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.594065    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5656c79bb6-c5txp"]
Jul 26 16:17:29.594478 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.594465    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd" containerName="authorino"
Jul 26 16:17:29.594520 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.594480    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd" containerName="authorino"
Jul 26 16:17:29.594555 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.594550    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d30a05d7-f99e-4be3-b3ab-cc9bf03d03cd" containerName="authorino"
Jul 26 16:17:29.597660 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.597642    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5656c79bb6-c5txp"
Jul 26 16:17:29.604300 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.604274    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 26 16:17:29.604300 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.604295    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gqw2f\""
Jul 26 16:17:29.605971 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.605952    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 26 16:17:29.608031 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.608006    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5656c79bb6-c5txp"]
Jul 26 16:17:29.727682 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.727653    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnjp2\" (UniqueName: \"kubernetes.io/projected/cc362c51-5d88-4426-9501-f01f196ed00d-kube-api-access-wnjp2\") pod \"maas-controller-5656c79bb6-c5txp\" (UID: \"cc362c51-5d88-4426-9501-f01f196ed00d\") " pod="opendatahub/maas-controller-5656c79bb6-c5txp"
Jul 26 16:17:29.727825 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.727707    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc362c51-5d88-4426-9501-f01f196ed00d-webhook-cert\") pod \"maas-controller-5656c79bb6-c5txp\" (UID: \"cc362c51-5d88-4426-9501-f01f196ed00d\") " pod="opendatahub/maas-controller-5656c79bb6-c5txp"
Jul 26 16:17:29.829015 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.828989    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc362c51-5d88-4426-9501-f01f196ed00d-webhook-cert\") pod \"maas-controller-5656c79bb6-c5txp\" (UID: \"cc362c51-5d88-4426-9501-f01f196ed00d\") " pod="opendatahub/maas-controller-5656c79bb6-c5txp"
Jul 26 16:17:29.829153 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.829049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnjp2\" (UniqueName: \"kubernetes.io/projected/cc362c51-5d88-4426-9501-f01f196ed00d-kube-api-access-wnjp2\") pod \"maas-controller-5656c79bb6-c5txp\" (UID: \"cc362c51-5d88-4426-9501-f01f196ed00d\") " pod="opendatahub/maas-controller-5656c79bb6-c5txp"
Jul 26 16:17:29.831326 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.831306    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc362c51-5d88-4426-9501-f01f196ed00d-webhook-cert\") pod \"maas-controller-5656c79bb6-c5txp\" (UID: \"cc362c51-5d88-4426-9501-f01f196ed00d\") " pod="opendatahub/maas-controller-5656c79bb6-c5txp"
Jul 26 16:17:29.837911 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.837888    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnjp2\" (UniqueName: \"kubernetes.io/projected/cc362c51-5d88-4426-9501-f01f196ed00d-kube-api-access-wnjp2\") pod \"maas-controller-5656c79bb6-c5txp\" (UID: \"cc362c51-5d88-4426-9501-f01f196ed00d\") " pod="opendatahub/maas-controller-5656c79bb6-c5txp"
Jul 26 16:17:29.915268 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:29.915236    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5656c79bb6-c5txp"
Jul 26 16:17:30.047026 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:30.047001    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5656c79bb6-c5txp"]
Jul 26 16:17:30.048981 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:17:30.048953    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc362c51_5d88_4426_9501_f01f196ed00d.slice/crio-cc51ff95688e412d20f29518a24944ad75b3b8803e57b8034644165fa0fd5484 WatchSource:0}: Error finding container cc51ff95688e412d20f29518a24944ad75b3b8803e57b8034644165fa0fd5484: Status 404 returned error can't find the container with id cc51ff95688e412d20f29518a24944ad75b3b8803e57b8034644165fa0fd5484
Jul 26 16:17:30.618279 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:30.618241    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5656c79bb6-c5txp" event={"ID":"cc362c51-5d88-4426-9501-f01f196ed00d","Type":"ContainerStarted","Data":"cc51ff95688e412d20f29518a24944ad75b3b8803e57b8034644165fa0fd5484"}
Jul 26 16:17:32.404303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:32.404259    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:17:32.499879 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:32.499795    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:17:32.630201 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:32.630168    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5656c79bb6-c5txp" event={"ID":"cc362c51-5d88-4426-9501-f01f196ed00d","Type":"ContainerStarted","Data":"3679990f31acef16b7ee6a725c1e74de30d193e458b2d12a84f218fc8ac8cb5e"}
Jul 26 16:17:32.630361 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:32.630253    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5656c79bb6-c5txp"
Jul 26 16:17:32.650700 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:32.650655    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5656c79bb6-c5txp" podStartSLOduration=1.45180909 podStartE2EDuration="3.650642717s" totalImagesPullingTime="2.198833627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:17:32.64838846 +0000 UTC m=+568.183087734" watchObservedRunningTime="2026-07-26 16:17:32.650642717 +0000 UTC m=+568.185342034"
Jul 26 16:17:43.636653 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:17:43.636626    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5656c79bb6-c5txp"
Jul 26 16:18:04.916332 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:04.916306    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:18:04.927510 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:04.927487    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:18:05.567001 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:05.566962    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:18:05.664183 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:05.664147    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:18:06.129938 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.129906    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:18:06.399415 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.399331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:18:06.660598 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.660511    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:18:06.737740 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.737712    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:18:06.762011 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.761981    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc"]
Jul 26 16:18:06.770980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.770956    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc"
Jul 26 16:18:06.776958 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.776931    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 26 16:18:06.779615 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.779592    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc"]
Jul 26 16:18:06.797639 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.797612    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-tzt22"]
Jul 26 16:18:06.801648 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.801628    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-tzt22"
Jul 26 16:18:06.804544 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.804517    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hjr66\""
Jul 26 16:18:06.815600 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.815573    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-tzt22"]
Jul 26 16:18:06.836118 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.836090    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d021cdfb-bbff-4e0a-9493-28c7e8483e2b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-tnfmc\" (UID: \"d021cdfb-bbff-4e0a-9493-28c7e8483e2b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc"
Jul 26 16:18:06.836288 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.836263    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pp6p\" (UniqueName: \"kubernetes.io/projected/d021cdfb-bbff-4e0a-9493-28c7e8483e2b-kube-api-access-9pp6p\") pod \"payload-pre-processing-687dbb6cf6-tnfmc\" (UID: \"d021cdfb-bbff-4e0a-9493-28c7e8483e2b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc"
Jul 26 16:18:06.937551 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.937516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pp6p\" (UniqueName: \"kubernetes.io/projected/d021cdfb-bbff-4e0a-9493-28c7e8483e2b-kube-api-access-9pp6p\") pod \"payload-pre-processing-687dbb6cf6-tnfmc\" (UID: \"d021cdfb-bbff-4e0a-9493-28c7e8483e2b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc"
Jul 26 16:18:06.937746 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.937588    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d021cdfb-bbff-4e0a-9493-28c7e8483e2b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-tnfmc\" (UID: \"d021cdfb-bbff-4e0a-9493-28c7e8483e2b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc"
Jul 26 16:18:06.937746 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.937630    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d62e39a9-9c8e-4d8f-b329-7c47fb0daccc-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-tzt22\" (UID: \"d62e39a9-9c8e-4d8f-b329-7c47fb0daccc\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tzt22"
Jul 26 16:18:06.937746 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.937668    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-994kj\" (UniqueName: \"kubernetes.io/projected/d62e39a9-9c8e-4d8f-b329-7c47fb0daccc-kube-api-access-994kj\") pod \"payload-processing-5cc6cd444b-tzt22\" (UID: \"d62e39a9-9c8e-4d8f-b329-7c47fb0daccc\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tzt22"
Jul 26 16:18:06.938326 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.938308    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d021cdfb-bbff-4e0a-9493-28c7e8483e2b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-tnfmc\" (UID: \"d021cdfb-bbff-4e0a-9493-28c7e8483e2b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc"
Jul 26 16:18:06.945942 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:06.945918    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pp6p\" (UniqueName: \"kubernetes.io/projected/d021cdfb-bbff-4e0a-9493-28c7e8483e2b-kube-api-access-9pp6p\") pod \"payload-pre-processing-687dbb6cf6-tnfmc\" (UID: \"d021cdfb-bbff-4e0a-9493-28c7e8483e2b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc"
Jul 26 16:18:07.038903 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:07.038867    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d62e39a9-9c8e-4d8f-b329-7c47fb0daccc-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-tzt22\" (UID: \"d62e39a9-9c8e-4d8f-b329-7c47fb0daccc\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tzt22"
Jul 26 16:18:07.039085 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:07.038914    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-994kj\" (UniqueName: \"kubernetes.io/projected/d62e39a9-9c8e-4d8f-b329-7c47fb0daccc-kube-api-access-994kj\") pod \"payload-processing-5cc6cd444b-tzt22\" (UID: \"d62e39a9-9c8e-4d8f-b329-7c47fb0daccc\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tzt22"
Jul 26 16:18:07.039624 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:07.039605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d62e39a9-9c8e-4d8f-b329-7c47fb0daccc-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-tzt22\" (UID: \"d62e39a9-9c8e-4d8f-b329-7c47fb0daccc\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tzt22"
Jul 26 16:18:07.046392 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:07.046370    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-994kj\" (UniqueName: \"kubernetes.io/projected/d62e39a9-9c8e-4d8f-b329-7c47fb0daccc-kube-api-access-994kj\") pod \"payload-processing-5cc6cd444b-tzt22\" (UID: \"d62e39a9-9c8e-4d8f-b329-7c47fb0daccc\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tzt22"
Jul 26 16:18:07.083199 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:07.083181    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc"
Jul 26 16:18:07.112667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:07.112636    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-tzt22"
Jul 26 16:18:07.453195 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:07.452732    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc"]
Jul 26 16:18:07.458695 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:18:07.458651    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd021cdfb_bbff_4e0a_9493_28c7e8483e2b.slice/crio-dd2e7a9c32c767bbe3e32ac208d10813b5ca94e988cc6d8843ce68aba825c9b8 WatchSource:0}: Error finding container dd2e7a9c32c767bbe3e32ac208d10813b5ca94e988cc6d8843ce68aba825c9b8: Status 404 returned error can't find the container with id dd2e7a9c32c767bbe3e32ac208d10813b5ca94e988cc6d8843ce68aba825c9b8
Jul 26 16:18:07.496551 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:07.496527    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-tzt22"]
Jul 26 16:18:07.498754 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:18:07.498732    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62e39a9_9c8e_4d8f_b329_7c47fb0daccc.slice/crio-ca4b8a2d1804c35955e31565df79dd78da8158d3228091322cce67b3edcfc2be WatchSource:0}: Error finding container ca4b8a2d1804c35955e31565df79dd78da8158d3228091322cce67b3edcfc2be: Status 404 returned error can't find the container with id ca4b8a2d1804c35955e31565df79dd78da8158d3228091322cce67b3edcfc2be
Jul 26 16:18:07.799590 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:07.799486    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc" event={"ID":"d021cdfb-bbff-4e0a-9493-28c7e8483e2b","Type":"ContainerStarted","Data":"dd2e7a9c32c767bbe3e32ac208d10813b5ca94e988cc6d8843ce68aba825c9b8"}
Jul 26 16:18:07.800739 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:07.800713    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-tzt22" event={"ID":"d62e39a9-9c8e-4d8f-b329-7c47fb0daccc","Type":"ContainerStarted","Data":"ca4b8a2d1804c35955e31565df79dd78da8158d3228091322cce67b3edcfc2be"}
Jul 26 16:18:10.824637 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:10.824600    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc" event={"ID":"d021cdfb-bbff-4e0a-9493-28c7e8483e2b","Type":"ContainerStarted","Data":"2be728287704dbe904f345281eb53b05ffc26fc10cea8ab127d64c80d03fff79"}
Jul 26 16:18:10.825066 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:10.824769    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc"
Jul 26 16:18:10.826175 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:10.826151    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-tzt22" event={"ID":"d62e39a9-9c8e-4d8f-b329-7c47fb0daccc","Type":"ContainerStarted","Data":"ac08e632cd7287e5ff58dd747d0e50661da3e131def10fc89efc0aadaa7ad5ac"}
Jul 26 16:18:10.826277 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:10.826202    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-tzt22"
Jul 26 16:18:10.856146 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:10.842841    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc" podStartSLOduration=1.618417255 podStartE2EDuration="4.84282315s" totalImagesPullingTime="3.224405895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:18:10.839789173 +0000 UTC m=+606.374488449" watchObservedRunningTime="2026-07-26 16:18:10.84282315 +0000 UTC m=+606.377522427"
Jul 26 16:18:14.848623 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:14.848588    2559 generic.go:356] "Generic (PLEG): container finished" podID="c9bb9915-63d0-4798-805e-c3351f4a529a" containerID="8781127c5c7099c1065f8975be37a02b7ec9f38550d371c27158b0fb733942e7" exitCode=0
Jul 26 16:18:14.849193 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:14.848650    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz" event={"ID":"c9bb9915-63d0-4798-805e-c3351f4a529a","Type":"ContainerDied","Data":"8781127c5c7099c1065f8975be37a02b7ec9f38550d371c27158b0fb733942e7"}
Jul 26 16:18:14.849193 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:14.849177    2559 scope.go:117] "RemoveContainer" containerID="8781127c5c7099c1065f8975be37a02b7ec9f38550d371c27158b0fb733942e7"
Jul 26 16:18:14.850176 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:14.850146    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:18:14.850253 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:14.850216    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:18:14.850299 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:14.850254    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:18:14.869533 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:14.869487    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-tzt22" podStartSLOduration=5.678487142 podStartE2EDuration="8.869467865s" totalImagesPullingTime="3.190980723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:18:10.86006429 +0000 UTC m=+606.394763567" watchObservedRunningTime="2026-07-26 16:18:14.869467865 +0000 UTC m=+610.404167140"
Jul 26 16:18:15.737683 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:15.737644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:18:15.859096 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:15.859049    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz" event={"ID":"c9bb9915-63d0-4798-805e-c3351f4a529a","Type":"ContainerStarted","Data":"43bf09d26623872ef6e1cad77f906845bf9dbcb910c8746705f422cacf8a2b5e"}
Jul 26 16:18:15.902294 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:15.902261    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:18:15.903220 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:15.903198    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-85dpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 26 16:18:15.903335 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:15.903242    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz" podUID="c9bb9915-63d0-4798-805e-c3351f4a529a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 26 16:18:16.804291 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:16.804261    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:18:16.903093 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:16.903058    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-85dpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 26 16:18:16.903466 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:16.903111    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz" podUID="c9bb9915-63d0-4798-805e-c3351f4a529a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 26 16:18:17.055264 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:17.055171    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:18:17.903295 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:17.903259    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-85dpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 26 16:18:17.903696 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:17.903322    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz" podUID="c9bb9915-63d0-4798-805e-c3351f4a529a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 26 16:18:18.385250 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:18.385215    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:18:18.902712 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:18.902676    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-85dpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 26 16:18:18.902893 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:18.902731    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz" podUID="c9bb9915-63d0-4798-805e-c3351f4a529a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 26 16:18:19.906462 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:19.906426    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:18:19.907337 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:19.907315    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-85dpz"
Jul 26 16:18:21.833520 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:21.833482    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-tzt22"
Jul 26 16:18:21.833939 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:21.833593    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-tnfmc"
Jul 26 16:18:26.740768 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.740735    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"]
Jul 26 16:18:26.746009 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.745985    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.748321 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.748296    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e506d497-3cea-46e4-8e67-8408b0f3ecb7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.748455 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.748342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e506d497-3cea-46e4-8e67-8408b0f3ecb7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.748455 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.748406    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e506d497-3cea-46e4-8e67-8408b0f3ecb7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.748455 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.748430    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e506d497-3cea-46e4-8e67-8408b0f3ecb7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.748641 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.748460    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e506d497-3cea-46e4-8e67-8408b0f3ecb7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.748641 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.748556    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 26 16:18:26.748641 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.748595    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc9sb\" (UniqueName: \"kubernetes.io/projected/e506d497-3cea-46e4-8e67-8408b0f3ecb7-kube-api-access-kc9sb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.749907 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.749884    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 26 16:18:26.750662 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.750642    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 26 16:18:26.750793 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.750773    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hhbrk\""
Jul 26 16:18:26.752469 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.752445    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"]
Jul 26 16:18:26.766859 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.766829    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:18:26.848966 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.848933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e506d497-3cea-46e4-8e67-8408b0f3ecb7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.848966 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.848965    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e506d497-3cea-46e4-8e67-8408b0f3ecb7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.849215 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.848980    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e506d497-3cea-46e4-8e67-8408b0f3ecb7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.849215 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.849003    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc9sb\" (UniqueName: \"kubernetes.io/projected/e506d497-3cea-46e4-8e67-8408b0f3ecb7-kube-api-access-kc9sb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.849215 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.849054    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e506d497-3cea-46e4-8e67-8408b0f3ecb7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.849215 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.849075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e506d497-3cea-46e4-8e67-8408b0f3ecb7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.849433 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.849408    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e506d497-3cea-46e4-8e67-8408b0f3ecb7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.849493 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.849419    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e506d497-3cea-46e4-8e67-8408b0f3ecb7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.849493 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.849464    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e506d497-3cea-46e4-8e67-8408b0f3ecb7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.851337 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.851316    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e506d497-3cea-46e4-8e67-8408b0f3ecb7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.851432 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.851417    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e506d497-3cea-46e4-8e67-8408b0f3ecb7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:26.856344 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:26.856323    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc9sb\" (UniqueName: \"kubernetes.io/projected/e506d497-3cea-46e4-8e67-8408b0f3ecb7-kube-api-access-kc9sb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb\" (UID: \"e506d497-3cea-46e4-8e67-8408b0f3ecb7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:27.058576 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:27.058497    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:27.195979 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:27.195956    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"]
Jul 26 16:18:27.198020 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:18:27.197993    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode506d497_3cea_46e4_8e67_8408b0f3ecb7.slice/crio-0c194e9635fc139ec6df297bd06f776f39b8a691f0616e39d4402ec7a9c9a091 WatchSource:0}: Error finding container 0c194e9635fc139ec6df297bd06f776f39b8a691f0616e39d4402ec7a9c9a091: Status 404 returned error can't find the container with id 0c194e9635fc139ec6df297bd06f776f39b8a691f0616e39d4402ec7a9c9a091
Jul 26 16:18:27.923035 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:27.923006    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb" event={"ID":"e506d497-3cea-46e4-8e67-8408b0f3ecb7","Type":"ContainerStarted","Data":"0c194e9635fc139ec6df297bd06f776f39b8a691f0616e39d4402ec7a9c9a091"}
Jul 26 16:18:28.929481 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:28.929445    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb" event={"ID":"e506d497-3cea-46e4-8e67-8408b0f3ecb7","Type":"ContainerStarted","Data":"9136c1bff63395b8594cee385e29054f61cad16bb8e0787da8dd38d4c6fe0732"}
Jul 26 16:18:28.945336 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:28.945289    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb" podStartSLOduration=1.838730694 podStartE2EDuration="2.945272234s" totalImagesPullingTime="1.10654154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:18:28.94524887 +0000 UTC m=+624.479948146" watchObservedRunningTime="2026-07-26 16:18:28.945272234 +0000 UTC m=+624.479971509"
Jul 26 16:18:37.058795 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:37.058753    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:37.059258 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:37.058811    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:37.072044 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:37.072024    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:37.984449 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:37.984413    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb"
Jul 26 16:18:40.169810 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:40.169775    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:18:54.172242 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:54.172209    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:18:57.956286 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:57.956258    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"]
Jul 26 16:18:57.963042 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:57.963020    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:57.966688 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:57.966493    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 26 16:18:57.968549 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:57.968524    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"]
Jul 26 16:18:57.972858 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:57.972831    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:18:58.130331 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.130292    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p9mp\" (UniqueName: \"kubernetes.io/projected/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-kube-api-access-7p9mp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.130331 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.130331    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.130590 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.130472    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.130590 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.130515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.130663 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.130615    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.130712 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.130663    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.231179 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.231068    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p9mp\" (UniqueName: \"kubernetes.io/projected/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-kube-api-access-7p9mp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.231179 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.231104    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.231418 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.231198    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.231418 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.231257    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.231418 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.231336    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.231418 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.231371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.231777 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.231746    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.231777 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.231746    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.231934 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.231811    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.233411 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.233381    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.233697 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.233680    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.239233 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.239216    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p9mp\" (UniqueName: \"kubernetes.io/projected/5d359aca-d52c-4ec3-82d3-a8a220c1f49e-kube-api-access-7p9mp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph\" (UID: \"5d359aca-d52c-4ec3-82d3-a8a220c1f49e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.276314 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.276291    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:18:58.409674 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.409650    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"]
Jul 26 16:18:58.411508 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:18:58.411479    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d359aca_d52c_4ec3_82d3_a8a220c1f49e.slice/crio-49d150f3415fb00046219bf1bba1b25ab92fe88d5b144dfe66f1fe324f6c740d WatchSource:0}: Error finding container 49d150f3415fb00046219bf1bba1b25ab92fe88d5b144dfe66f1fe324f6c740d: Status 404 returned error can't find the container with id 49d150f3415fb00046219bf1bba1b25ab92fe88d5b144dfe66f1fe324f6c740d
Jul 26 16:18:58.413212 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:58.413189    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 16:18:59.081409 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:59.081374    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph" event={"ID":"5d359aca-d52c-4ec3-82d3-a8a220c1f49e","Type":"ContainerStarted","Data":"13217f7d213eb7e1534a73bf1f9241c2625a779aa67af8836fd373888d35b728"}
Jul 26 16:18:59.081765 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:59.081449    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph" event={"ID":"5d359aca-d52c-4ec3-82d3-a8a220c1f49e","Type":"ContainerStarted","Data":"49d150f3415fb00046219bf1bba1b25ab92fe88d5b144dfe66f1fe324f6c740d"}
Jul 26 16:18:59.100311 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:18:59.100262    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph" podStartSLOduration=1.908424733 podStartE2EDuration="2.100247829s" totalImagesPullingTime="191.823096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:18:59.097359524 +0000 UTC m=+654.632058809" watchObservedRunningTime="2026-07-26 16:18:59.100247829 +0000 UTC m=+654.634947104"
Jul 26 16:19:04.441679 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:19:04.441611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:19:06.091286 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:19:06.091246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:19:08.276669 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:19:08.276634    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:19:08.277099 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:19:08.276695    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:19:08.289969 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:19:08.289946    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:19:09.143604 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:19:09.143577    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph"
Jul 26 16:19:16.867950 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:19:16.867919    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:19:30.912163 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:19:30.912106    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:19:30.964793 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:19:30.964755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:20:39.227267 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:20:39.227227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:20:56.759258 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:20:56.759224    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:21:01.679408 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:01.679376    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c78f66b7b-9whv4"]
Jul 26 16:21:01.679840 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:01.679558    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c78f66b7b-9whv4" podUID="1c266646-b6b8-42a2-b81a-3cecbf7ccdb5" containerName="authorino" containerID="cri-o://f49159bb5b3c03bb29763127786c17904185dfbdd73a7b3ebe86f9a5e16d1275" gracePeriod=30
Jul 26 16:21:01.933846 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:01.933827    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c78f66b7b-9whv4"
Jul 26 16:21:02.001941 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.001909    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c266646-b6b8-42a2-b81a-3cecbf7ccdb5-tls-cert\") pod \"1c266646-b6b8-42a2-b81a-3cecbf7ccdb5\" (UID: \"1c266646-b6b8-42a2-b81a-3cecbf7ccdb5\") "
Jul 26 16:21:02.002099 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.001958    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p4x7\" (UniqueName: \"kubernetes.io/projected/1c266646-b6b8-42a2-b81a-3cecbf7ccdb5-kube-api-access-6p4x7\") pod \"1c266646-b6b8-42a2-b81a-3cecbf7ccdb5\" (UID: \"1c266646-b6b8-42a2-b81a-3cecbf7ccdb5\") "
Jul 26 16:21:02.003857 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.003829    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c266646-b6b8-42a2-b81a-3cecbf7ccdb5-kube-api-access-6p4x7" (OuterVolumeSpecName: "kube-api-access-6p4x7") pod "1c266646-b6b8-42a2-b81a-3cecbf7ccdb5" (UID: "1c266646-b6b8-42a2-b81a-3cecbf7ccdb5"). InnerVolumeSpecName "kube-api-access-6p4x7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:21:02.012493 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.012472    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c266646-b6b8-42a2-b81a-3cecbf7ccdb5-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1c266646-b6b8-42a2-b81a-3cecbf7ccdb5" (UID: "1c266646-b6b8-42a2-b81a-3cecbf7ccdb5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:21:02.103366 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.103335    2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c266646-b6b8-42a2-b81a-3cecbf7ccdb5-tls-cert\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:21:02.103366 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.103361    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p4x7\" (UniqueName: \"kubernetes.io/projected/1c266646-b6b8-42a2-b81a-3cecbf7ccdb5-kube-api-access-6p4x7\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:21:02.191962 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.191874    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:21:02.284164 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.284109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:21:02.709951 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.709922    2559 generic.go:356] "Generic (PLEG): container finished" podID="1c266646-b6b8-42a2-b81a-3cecbf7ccdb5" containerID="f49159bb5b3c03bb29763127786c17904185dfbdd73a7b3ebe86f9a5e16d1275" exitCode=0
Jul 26 16:21:02.710438 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.709964    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c78f66b7b-9whv4"
Jul 26 16:21:02.710438 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.710013    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c78f66b7b-9whv4" event={"ID":"1c266646-b6b8-42a2-b81a-3cecbf7ccdb5","Type":"ContainerDied","Data":"f49159bb5b3c03bb29763127786c17904185dfbdd73a7b3ebe86f9a5e16d1275"}
Jul 26 16:21:02.710438 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.710055    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c78f66b7b-9whv4" event={"ID":"1c266646-b6b8-42a2-b81a-3cecbf7ccdb5","Type":"ContainerDied","Data":"fe55c05a24468f71cb05d9e7ad891c782e5a52c17909e0ae613c7180327fa82a"}
Jul 26 16:21:02.710438 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.710076    2559 scope.go:117] "RemoveContainer" containerID="f49159bb5b3c03bb29763127786c17904185dfbdd73a7b3ebe86f9a5e16d1275"
Jul 26 16:21:02.719874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.719856    2559 scope.go:117] "RemoveContainer" containerID="f49159bb5b3c03bb29763127786c17904185dfbdd73a7b3ebe86f9a5e16d1275"
Jul 26 16:21:02.720100 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:21:02.720079    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f49159bb5b3c03bb29763127786c17904185dfbdd73a7b3ebe86f9a5e16d1275\": container with ID starting with f49159bb5b3c03bb29763127786c17904185dfbdd73a7b3ebe86f9a5e16d1275 not found: ID does not exist" containerID="f49159bb5b3c03bb29763127786c17904185dfbdd73a7b3ebe86f9a5e16d1275"
Jul 26 16:21:02.720183 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.720108    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49159bb5b3c03bb29763127786c17904185dfbdd73a7b3ebe86f9a5e16d1275"} err="failed to get container status \"f49159bb5b3c03bb29763127786c17904185dfbdd73a7b3ebe86f9a5e16d1275\": rpc error: code = NotFound desc = could not find container \"f49159bb5b3c03bb29763127786c17904185dfbdd73a7b3ebe86f9a5e16d1275\": container with ID starting with f49159bb5b3c03bb29763127786c17904185dfbdd73a7b3ebe86f9a5e16d1275 not found: ID does not exist"
Jul 26 16:21:02.730733 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.730709    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c78f66b7b-9whv4"]
Jul 26 16:21:02.744462 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.744436    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c78f66b7b-9whv4"]
Jul 26 16:21:02.955420 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:02.955384    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c266646-b6b8-42a2-b81a-3cecbf7ccdb5" path="/var/lib/kubelet/pods/1c266646-b6b8-42a2-b81a-3cecbf7ccdb5/volumes"
Jul 26 16:21:03.294386 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:03.294274    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:21:03.388873 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:03.388838    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:21:38.497280 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:38.497196    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:21:51.239547 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.239514    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5656c79bb6-c5txp"]
Jul 26 16:21:51.239951 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.239704    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5656c79bb6-c5txp" podUID="cc362c51-5d88-4426-9501-f01f196ed00d" containerName="manager" containerID="cri-o://3679990f31acef16b7ee6a725c1e74de30d193e458b2d12a84f218fc8ac8cb5e" gracePeriod=30
Jul 26 16:21:51.494431 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.494376    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5656c79bb6-c5txp"
Jul 26 16:21:51.527181 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.527156    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc362c51-5d88-4426-9501-f01f196ed00d-webhook-cert\") pod \"cc362c51-5d88-4426-9501-f01f196ed00d\" (UID: \"cc362c51-5d88-4426-9501-f01f196ed00d\") "
Jul 26 16:21:51.527341 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.527236    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnjp2\" (UniqueName: \"kubernetes.io/projected/cc362c51-5d88-4426-9501-f01f196ed00d-kube-api-access-wnjp2\") pod \"cc362c51-5d88-4426-9501-f01f196ed00d\" (UID: \"cc362c51-5d88-4426-9501-f01f196ed00d\") "
Jul 26 16:21:51.529316 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.529285    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc362c51-5d88-4426-9501-f01f196ed00d-kube-api-access-wnjp2" (OuterVolumeSpecName: "kube-api-access-wnjp2") pod "cc362c51-5d88-4426-9501-f01f196ed00d" (UID: "cc362c51-5d88-4426-9501-f01f196ed00d"). InnerVolumeSpecName "kube-api-access-wnjp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:21:51.529316 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.529284    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc362c51-5d88-4426-9501-f01f196ed00d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cc362c51-5d88-4426-9501-f01f196ed00d" (UID: "cc362c51-5d88-4426-9501-f01f196ed00d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:21:51.628479 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.628450    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc362c51-5d88-4426-9501-f01f196ed00d-webhook-cert\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:21:51.628479 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.628475    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnjp2\" (UniqueName: \"kubernetes.io/projected/cc362c51-5d88-4426-9501-f01f196ed00d-kube-api-access-wnjp2\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:21:51.949460 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.949434    2559 generic.go:356] "Generic (PLEG): container finished" podID="cc362c51-5d88-4426-9501-f01f196ed00d" containerID="3679990f31acef16b7ee6a725c1e74de30d193e458b2d12a84f218fc8ac8cb5e" exitCode=0
Jul 26 16:21:51.949619 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.949461    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5656c79bb6-c5txp"
Jul 26 16:21:51.949619 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.949507    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5656c79bb6-c5txp" event={"ID":"cc362c51-5d88-4426-9501-f01f196ed00d","Type":"ContainerDied","Data":"3679990f31acef16b7ee6a725c1e74de30d193e458b2d12a84f218fc8ac8cb5e"}
Jul 26 16:21:51.949619 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.949545    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5656c79bb6-c5txp" event={"ID":"cc362c51-5d88-4426-9501-f01f196ed00d","Type":"ContainerDied","Data":"cc51ff95688e412d20f29518a24944ad75b3b8803e57b8034644165fa0fd5484"}
Jul 26 16:21:51.949619 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.949569    2559 scope.go:117] "RemoveContainer" containerID="3679990f31acef16b7ee6a725c1e74de30d193e458b2d12a84f218fc8ac8cb5e"
Jul 26 16:21:51.959150 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.959108    2559 scope.go:117] "RemoveContainer" containerID="3679990f31acef16b7ee6a725c1e74de30d193e458b2d12a84f218fc8ac8cb5e"
Jul 26 16:21:51.959400 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:21:51.959382    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3679990f31acef16b7ee6a725c1e74de30d193e458b2d12a84f218fc8ac8cb5e\": container with ID starting with 3679990f31acef16b7ee6a725c1e74de30d193e458b2d12a84f218fc8ac8cb5e not found: ID does not exist" containerID="3679990f31acef16b7ee6a725c1e74de30d193e458b2d12a84f218fc8ac8cb5e"
Jul 26 16:21:51.959448 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.959409    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3679990f31acef16b7ee6a725c1e74de30d193e458b2d12a84f218fc8ac8cb5e"} err="failed to get container status \"3679990f31acef16b7ee6a725c1e74de30d193e458b2d12a84f218fc8ac8cb5e\": rpc error: code = NotFound desc = could not find container \"3679990f31acef16b7ee6a725c1e74de30d193e458b2d12a84f218fc8ac8cb5e\": container with ID starting with 3679990f31acef16b7ee6a725c1e74de30d193e458b2d12a84f218fc8ac8cb5e not found: ID does not exist"
Jul 26 16:21:51.969544 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.969523    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5656c79bb6-c5txp"]
Jul 26 16:21:51.972061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:51.972042    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5656c79bb6-c5txp"]
Jul 26 16:21:52.955564 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:21:52.955529    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc362c51-5d88-4426-9501-f01f196ed00d" path="/var/lib/kubelet/pods/cc362c51-5d88-4426-9501-f01f196ed00d/volumes"
Jul 26 16:22:40.370793 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:22:40.370735    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:22:40.463887 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:22:40.463860    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:23:04.948439 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:04.948352    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:23:04.967678 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:04.967646    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:23:09.683034 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:09.683001    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:23:10.928260 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:10.928217    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:23:19.525242 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:19.525198    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:23:46.346875 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:46.346839    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:23:46.456796 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:46.456766    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:23:46.564945 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:46.564887    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:23:52.300019 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:52.299983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:23:52.355882 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:52.355852    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:23:52.461481 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:52.461451    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:23:52.618468 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:52.618382    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:23:52.716771 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:52.716736    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:23:58.392739 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:58.392707    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:23:58.456914 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:23:58.456880    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:27:29.899697 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:27:29.899584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:27:29.954503 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:27:29.954470    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:27:33.730369 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:27:33.730321    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:27:33.831940 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:27:33.831910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:27:48.131985 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:27:48.131949    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:28:04.989508 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:28:04.989479    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:28:04.997454 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:28:04.997431    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:30:00.142673 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:00.142629    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751390-fxss5"]
Jul 26 16:30:00.143314 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:00.143287    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc362c51-5d88-4426-9501-f01f196ed00d" containerName="manager"
Jul 26 16:30:00.143314 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:00.143307    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc362c51-5d88-4426-9501-f01f196ed00d" containerName="manager"
Jul 26 16:30:00.143444 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:00.143336    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c266646-b6b8-42a2-b81a-3cecbf7ccdb5" containerName="authorino"
Jul 26 16:30:00.143444 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:00.143344    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c266646-b6b8-42a2-b81a-3cecbf7ccdb5" containerName="authorino"
Jul 26 16:30:00.143547 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:00.143455    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc362c51-5d88-4426-9501-f01f196ed00d" containerName="manager"
Jul 26 16:30:00.143547 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:00.143471    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c266646-b6b8-42a2-b81a-3cecbf7ccdb5" containerName="authorino"
Jul 26 16:30:00.146599 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:00.146577    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-fxss5"
Jul 26 16:30:00.148765 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:00.148743    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2xlcn\""
Jul 26 16:30:00.152322 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:00.152299    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751390-fxss5"]
Jul 26 16:30:00.158108 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:00.158088    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-fxss5"
Jul 26 16:30:00.291221 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:00.291188    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751390-fxss5"]
Jul 26 16:30:00.293924 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:30:00.293896    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ff82f3_aaee_4f6f_b1fa_b8d28fc58147.slice/crio-06d4d4d42a195c59fa4db42b120ef33f53507fa41f20fd9333abf94787b20c81 WatchSource:0}: Error finding container 06d4d4d42a195c59fa4db42b120ef33f53507fa41f20fd9333abf94787b20c81: Status 404 returned error can't find the container with id 06d4d4d42a195c59fa4db42b120ef33f53507fa41f20fd9333abf94787b20c81
Jul 26 16:30:00.295769 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:00.295745    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 16:30:00.344871 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:00.344837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-fxss5" event={"ID":"40ff82f3-aaee-4f6f-b1fa-b8d28fc58147","Type":"ContainerStarted","Data":"06d4d4d42a195c59fa4db42b120ef33f53507fa41f20fd9333abf94787b20c81"}
Jul 26 16:30:04.365894 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:04.365862    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-fxss5" event={"ID":"40ff82f3-aaee-4f6f-b1fa-b8d28fc58147","Type":"ContainerStarted","Data":"f919b6cac49fc9ea466ca37889c5b3a72c55adaedfbdace6789fc307bbd1654f"}
Jul 26 16:30:04.381846 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:04.381796    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-fxss5" podStartSLOduration=0.796033216 podStartE2EDuration="4.381780654s" totalImagesPullingTime="3.585747438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:30:04.380345392 +0000 UTC m=+1319.915044666" watchObservedRunningTime="2026-07-26 16:30:04.381780654 +0000 UTC m=+1319.916479928"
Jul 26 16:30:05.371940 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:05.371902    2559 generic.go:356] "Generic (PLEG): container finished" podID="40ff82f3-aaee-4f6f-b1fa-b8d28fc58147" containerID="f919b6cac49fc9ea466ca37889c5b3a72c55adaedfbdace6789fc307bbd1654f" exitCode=0
Jul 26 16:30:05.372403 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:05.371988    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-fxss5" event={"ID":"40ff82f3-aaee-4f6f-b1fa-b8d28fc58147","Type":"ContainerDied","Data":"f919b6cac49fc9ea466ca37889c5b3a72c55adaedfbdace6789fc307bbd1654f"}
Jul 26 16:30:06.517440 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:06.517418    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-fxss5"
Jul 26 16:30:07.382737 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:07.382659    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-fxss5"
Jul 26 16:30:07.382879 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:07.382660    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-fxss5" event={"ID":"40ff82f3-aaee-4f6f-b1fa-b8d28fc58147","Type":"ContainerDied","Data":"06d4d4d42a195c59fa4db42b120ef33f53507fa41f20fd9333abf94787b20c81"}
Jul 26 16:30:07.382879 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:07.382794    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06d4d4d42a195c59fa4db42b120ef33f53507fa41f20fd9333abf94787b20c81"
Jul 26 16:30:27.307682 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:27.307608    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:30:28.497758 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:30:28.497724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:31:28.781022 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:31:28.780991    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:31:34.073952 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:31:34.073910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:32:02.524827 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:32:02.524746    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:32:03.772197 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:32:03.772168    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:32:53.585180 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:32:53.585141    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:33:05.022863 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:33:05.022834    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:33:05.035755 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:33:05.035719    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:35:10.210969 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:10.210938    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:34.309935 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:34.309894    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:38.634617 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:38.634575    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:38.761393 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:38.761362    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:39.281735 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:39.281700    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:45.359732 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:45.359701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:45.453211 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:45.453176    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:45.578508 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:45.578479    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:45.885223 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:45.885194    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:46.006263 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:46.006234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:48.637696 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:48.637668    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:48.748645 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:48.748604    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:48.879596 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:48.879564    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:49.001297 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:49.001268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:49.556595 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:49.556564    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:49.741311 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:49.741279    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:35:49.938185 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:49.938153    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"]
Jul 26 16:35:49.938563 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:49.938549    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ff82f3-aaee-4f6f-b1fa-b8d28fc58147" containerName="cleanup"
Jul 26 16:35:49.938610 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:49.938565    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ff82f3-aaee-4f6f-b1fa-b8d28fc58147" containerName="cleanup"
Jul 26 16:35:49.938656 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:49.938626    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ff82f3-aaee-4f6f-b1fa-b8d28fc58147" containerName="cleanup"
Jul 26 16:35:49.941605 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:49.941589    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"
Jul 26 16:35:49.948501 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:49.948239    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c6b781f9-dockercfg-wj5w5\""
Jul 26 16:35:49.948501 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:49.948460    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c6b781f9\""
Jul 26 16:35:49.962501 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:49.962476    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"]
Jul 26 16:35:49.965820 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:49.965805    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"
Jul 26 16:35:49.974041 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:49.974019    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"]
Jul 26 16:35:49.993011 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:49.992990    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"]
Jul 26 16:35:50.089694 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.089658    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a42eec1-bb46-4e69-b8f5-08416e05d0c7-plugins-config-volume\") pod \"payload-processing-e2e-ait-c6b781f9-5567869564-98fd7\" (UID: \"5a42eec1-bb46-4e69-b8f5-08416e05d0c7\") " pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"
Jul 26 16:35:50.089694 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.089695    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7w86\" (UniqueName: \"kubernetes.io/projected/6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba-kube-api-access-q7w86\") pod \"payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm\" (UID: \"6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"
Jul 26 16:35:50.089942 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.089865    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2j2z\" (UniqueName: \"kubernetes.io/projected/5a42eec1-bb46-4e69-b8f5-08416e05d0c7-kube-api-access-v2j2z\") pod \"payload-processing-e2e-ait-c6b781f9-5567869564-98fd7\" (UID: \"5a42eec1-bb46-4e69-b8f5-08416e05d0c7\") " pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"
Jul 26 16:35:50.089942 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.089908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm\" (UID: \"6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"
Jul 26 16:35:50.190598 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.190526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2j2z\" (UniqueName: \"kubernetes.io/projected/5a42eec1-bb46-4e69-b8f5-08416e05d0c7-kube-api-access-v2j2z\") pod \"payload-processing-e2e-ait-c6b781f9-5567869564-98fd7\" (UID: \"5a42eec1-bb46-4e69-b8f5-08416e05d0c7\") " pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"
Jul 26 16:35:50.190598 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.190562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm\" (UID: \"6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"
Jul 26 16:35:50.190598 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.190585    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a42eec1-bb46-4e69-b8f5-08416e05d0c7-plugins-config-volume\") pod \"payload-processing-e2e-ait-c6b781f9-5567869564-98fd7\" (UID: \"5a42eec1-bb46-4e69-b8f5-08416e05d0c7\") " pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"
Jul 26 16:35:50.190901 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.190608    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7w86\" (UniqueName: \"kubernetes.io/projected/6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba-kube-api-access-q7w86\") pod \"payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm\" (UID: \"6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"
Jul 26 16:35:50.191230 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.191210    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm\" (UID: \"6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"
Jul 26 16:35:50.191360 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.191340    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a42eec1-bb46-4e69-b8f5-08416e05d0c7-plugins-config-volume\") pod \"payload-processing-e2e-ait-c6b781f9-5567869564-98fd7\" (UID: \"5a42eec1-bb46-4e69-b8f5-08416e05d0c7\") " pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"
Jul 26 16:35:50.213149 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.213110    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7w86\" (UniqueName: \"kubernetes.io/projected/6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba-kube-api-access-q7w86\") pod \"payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm\" (UID: \"6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"
Jul 26 16:35:50.214520 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.214499    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2j2z\" (UniqueName: \"kubernetes.io/projected/5a42eec1-bb46-4e69-b8f5-08416e05d0c7-kube-api-access-v2j2z\") pod \"payload-processing-e2e-ait-c6b781f9-5567869564-98fd7\" (UID: \"5a42eec1-bb46-4e69-b8f5-08416e05d0c7\") " pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"
Jul 26 16:35:50.251954 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.251933    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"
Jul 26 16:35:50.276100 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.276081    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"
Jul 26 16:35:50.611954 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.611928    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"]
Jul 26 16:35:50.614250 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:35:50.614216    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a42eec1_bb46_4e69_b8f5_08416e05d0c7.slice/crio-4fc7084a5639d3ba4a6489e6c0cadc5aa48c80125e4177e89bc3b9b1f3df00a3 WatchSource:0}: Error finding container 4fc7084a5639d3ba4a6489e6c0cadc5aa48c80125e4177e89bc3b9b1f3df00a3: Status 404 returned error can't find the container with id 4fc7084a5639d3ba4a6489e6c0cadc5aa48c80125e4177e89bc3b9b1f3df00a3
Jul 26 16:35:50.635509 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:50.635484    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"]
Jul 26 16:35:50.636562 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:35:50.636534    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6467fd4e_b3dc_4cfb_8cb5_c6d9959269ba.slice/crio-2fce7bf0de6760367c023f97c31648f09dc3f79e7bf4ca5aa2d4245da309abab WatchSource:0}: Error finding container 2fce7bf0de6760367c023f97c31648f09dc3f79e7bf4ca5aa2d4245da309abab: Status 404 returned error can't find the container with id 2fce7bf0de6760367c023f97c31648f09dc3f79e7bf4ca5aa2d4245da309abab
Jul 26 16:35:51.066782 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:51.066721    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm" event={"ID":"6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba","Type":"ContainerStarted","Data":"c8329a9b447b2e23b0fb647b7880afec7546fe01f0d1a6bdd7b7b183ca7a5f77"}
Jul 26 16:35:51.067259 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:51.066789    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"
Jul 26 16:35:51.067259 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:51.066816    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm" event={"ID":"6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba","Type":"ContainerStarted","Data":"2fce7bf0de6760367c023f97c31648f09dc3f79e7bf4ca5aa2d4245da309abab"}
Jul 26 16:35:51.068280 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:51.068256    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7" event={"ID":"5a42eec1-bb46-4e69-b8f5-08416e05d0c7","Type":"ContainerStarted","Data":"6f2bf01af8bebef23e59b6abd99988c11a2cd0e59d653641efc1ae6020546402"}
Jul 26 16:35:51.068400 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:51.068300    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7" event={"ID":"5a42eec1-bb46-4e69-b8f5-08416e05d0c7","Type":"ContainerStarted","Data":"4fc7084a5639d3ba4a6489e6c0cadc5aa48c80125e4177e89bc3b9b1f3df00a3"}
Jul 26 16:35:51.068400 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:51.068334    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"
Jul 26 16:35:51.085674 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:51.085623    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm" podStartSLOduration=2.085604509 podStartE2EDuration="2.085604509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:35:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:35:51.084575826 +0000 UTC m=+1666.619275104" watchObservedRunningTime="2026-07-26 16:35:51.085604509 +0000 UTC m=+1666.620303787"
Jul 26 16:35:51.101778 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:35:51.101738    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7" podStartSLOduration=2.101725601 podStartE2EDuration="2.101725601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:35:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:35:51.09977381 +0000 UTC m=+1666.634473085" watchObservedRunningTime="2026-07-26 16:35:51.101725601 +0000 UTC m=+1666.636424922"
Jul 26 16:36:02.074561 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:02.074519    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm" podUID="6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.55:9004: connect: connection refused"
Jul 26 16:36:02.074920 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:02.074736    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"
Jul 26 16:36:12.074295 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:12.074266    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"
Jul 26 16:36:14.064771 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:14.064740    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b"]
Jul 26 16:36:14.068377 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:14.068361    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b"
Jul 26 16:36:14.070834 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:14.070813    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2xlcn\""
Jul 26 16:36:14.075110 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:14.075086    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b"]
Jul 26 16:36:14.184526 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:14.184498    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b\" (UID: \"3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b"
Jul 26 16:36:14.284933 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:14.284907    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b\" (UID: \"3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b"
Jul 26 16:36:14.285550 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:14.285526    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b\" (UID: \"3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b"
Jul 26 16:36:14.345544 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:14.345490    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:14.380139 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:14.380102    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b"
Jul 26 16:36:14.718025 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:14.718003    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b"]
Jul 26 16:36:14.720031 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:36:14.719995    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3025de91_0e77_4bf2_a0bd_4c8ef1aa7c6e.slice/crio-24300350e1a33743d27f89acb05d10a71f24153017179ca297531497b33d4a35 WatchSource:0}: Error finding container 24300350e1a33743d27f89acb05d10a71f24153017179ca297531497b33d4a35: Status 404 returned error can't find the container with id 24300350e1a33743d27f89acb05d10a71f24153017179ca297531497b33d4a35
Jul 26 16:36:15.189639 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:15.189610    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b" event={"ID":"3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e","Type":"ContainerStarted","Data":"e23d85e32bbf17ba0aacb52f2a2c5a740bb230446ea6b706c62defd10cb2d710"}
Jul 26 16:36:15.189985 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:15.189656    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b" event={"ID":"3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e","Type":"ContainerStarted","Data":"24300350e1a33743d27f89acb05d10a71f24153017179ca297531497b33d4a35"}
Jul 26 16:36:15.205860 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:15.205817    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b" podStartSLOduration=1.205802991 podStartE2EDuration="1.205802991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:36:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:36:15.204045337 +0000 UTC m=+1690.738744612" watchObservedRunningTime="2026-07-26 16:36:15.205802991 +0000 UTC m=+1690.740502271"
Jul 26 16:36:16.196530 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:16.196491    2559 generic.go:356] "Generic (PLEG): container finished" podID="3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e" containerID="e23d85e32bbf17ba0aacb52f2a2c5a740bb230446ea6b706c62defd10cb2d710" exitCode=0
Jul 26 16:36:16.196966 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:16.196583    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b" event={"ID":"3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e","Type":"ContainerDied","Data":"e23d85e32bbf17ba0aacb52f2a2c5a740bb230446ea6b706c62defd10cb2d710"}
Jul 26 16:36:17.339275 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:17.339250    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b"
Jul 26 16:36:17.414017 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:17.413988    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e-maas-api-service-ca\") pod \"3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e\" (UID: \"3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e\") "
Jul 26 16:36:17.414354 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:17.414332    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e" (UID: "3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:36:17.515628 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:17.515535    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e-maas-api-service-ca\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:36:18.208033 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:18.208007    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b"
Jul 26 16:36:18.208033 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:18.208024    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b" event={"ID":"3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e","Type":"ContainerDied","Data":"24300350e1a33743d27f89acb05d10a71f24153017179ca297531497b33d4a35"}
Jul 26 16:36:18.208329 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:18.208067    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24300350e1a33743d27f89acb05d10a71f24153017179ca297531497b33d4a35"
Jul 26 16:36:24.636819 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:24.636789    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:24.700553 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:24.700518    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"]
Jul 26 16:36:24.700785 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:24.700762    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7" podUID="5a42eec1-bb46-4e69-b8f5-08416e05d0c7" containerName="payload-processing" containerID="cri-o://6f2bf01af8bebef23e59b6abd99988c11a2cd0e59d653641efc1ae6020546402" gracePeriod=30
Jul 26 16:36:24.709312 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:24.709282    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"]
Jul 26 16:36:24.709550 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:24.709506    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm" podUID="6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba" containerName="payload-pre-processing" containerID="cri-o://c8329a9b447b2e23b0fb647b7880afec7546fe01f0d1a6bdd7b7b183ca7a5f77" gracePeriod=30
Jul 26 16:36:24.765969 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:24.765929    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:24.987597 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:24.987570    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:24.992497 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:24.992478    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"
Jul 26 16:36:24.995603 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:24.995586    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"
Jul 26 16:36:25.076634 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.076604    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2j2z\" (UniqueName: \"kubernetes.io/projected/5a42eec1-bb46-4e69-b8f5-08416e05d0c7-kube-api-access-v2j2z\") pod \"5a42eec1-bb46-4e69-b8f5-08416e05d0c7\" (UID: \"5a42eec1-bb46-4e69-b8f5-08416e05d0c7\") "
Jul 26 16:36:25.076777 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.076668    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba-plugins-config-volume\") pod \"6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba\" (UID: \"6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba\") "
Jul 26 16:36:25.076777 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.076755    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7w86\" (UniqueName: \"kubernetes.io/projected/6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba-kube-api-access-q7w86\") pod \"6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba\" (UID: \"6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba\") "
Jul 26 16:36:25.076894 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.076777    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a42eec1-bb46-4e69-b8f5-08416e05d0c7-plugins-config-volume\") pod \"5a42eec1-bb46-4e69-b8f5-08416e05d0c7\" (UID: \"5a42eec1-bb46-4e69-b8f5-08416e05d0c7\") "
Jul 26 16:36:25.077071 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.077037    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba" (UID: "6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:36:25.077255 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.077177    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a42eec1-bb46-4e69-b8f5-08416e05d0c7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5a42eec1-bb46-4e69-b8f5-08416e05d0c7" (UID: "5a42eec1-bb46-4e69-b8f5-08416e05d0c7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:36:25.078650 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.078628    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a42eec1-bb46-4e69-b8f5-08416e05d0c7-kube-api-access-v2j2z" (OuterVolumeSpecName: "kube-api-access-v2j2z") pod "5a42eec1-bb46-4e69-b8f5-08416e05d0c7" (UID: "5a42eec1-bb46-4e69-b8f5-08416e05d0c7"). InnerVolumeSpecName "kube-api-access-v2j2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:36:25.078848 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.078828    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba-kube-api-access-q7w86" (OuterVolumeSpecName: "kube-api-access-q7w86") pod "6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba" (UID: "6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba"). InnerVolumeSpecName "kube-api-access-q7w86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:36:25.178347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.178280    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7w86\" (UniqueName: \"kubernetes.io/projected/6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba-kube-api-access-q7w86\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:36:25.178347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.178305    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a42eec1-bb46-4e69-b8f5-08416e05d0c7-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:36:25.178347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.178314    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2j2z\" (UniqueName: \"kubernetes.io/projected/5a42eec1-bb46-4e69-b8f5-08416e05d0c7-kube-api-access-v2j2z\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:36:25.178347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.178323    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:36:25.243216 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.243183    2559 generic.go:356] "Generic (PLEG): container finished" podID="6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba" containerID="c8329a9b447b2e23b0fb647b7880afec7546fe01f0d1a6bdd7b7b183ca7a5f77" exitCode=0
Jul 26 16:36:25.243338 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.243225    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"
Jul 26 16:36:25.243338 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.243270    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm" event={"ID":"6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba","Type":"ContainerDied","Data":"c8329a9b447b2e23b0fb647b7880afec7546fe01f0d1a6bdd7b7b183ca7a5f77"}
Jul 26 16:36:25.243338 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.243317    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm" event={"ID":"6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba","Type":"ContainerDied","Data":"2fce7bf0de6760367c023f97c31648f09dc3f79e7bf4ca5aa2d4245da309abab"}
Jul 26 16:36:25.243488 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.243343    2559 scope.go:117] "RemoveContainer" containerID="c8329a9b447b2e23b0fb647b7880afec7546fe01f0d1a6bdd7b7b183ca7a5f77"
Jul 26 16:36:25.244639 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.244616    2559 generic.go:356] "Generic (PLEG): container finished" podID="5a42eec1-bb46-4e69-b8f5-08416e05d0c7" containerID="6f2bf01af8bebef23e59b6abd99988c11a2cd0e59d653641efc1ae6020546402" exitCode=0
Jul 26 16:36:25.244759 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.244656    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"
Jul 26 16:36:25.244759 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.244677    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7" event={"ID":"5a42eec1-bb46-4e69-b8f5-08416e05d0c7","Type":"ContainerDied","Data":"6f2bf01af8bebef23e59b6abd99988c11a2cd0e59d653641efc1ae6020546402"}
Jul 26 16:36:25.244759 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.244720    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7" event={"ID":"5a42eec1-bb46-4e69-b8f5-08416e05d0c7","Type":"ContainerDied","Data":"4fc7084a5639d3ba4a6489e6c0cadc5aa48c80125e4177e89bc3b9b1f3df00a3"}
Jul 26 16:36:25.253599 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.253581    2559 scope.go:117] "RemoveContainer" containerID="c8329a9b447b2e23b0fb647b7880afec7546fe01f0d1a6bdd7b7b183ca7a5f77"
Jul 26 16:36:25.253903 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:36:25.253885    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8329a9b447b2e23b0fb647b7880afec7546fe01f0d1a6bdd7b7b183ca7a5f77\": container with ID starting with c8329a9b447b2e23b0fb647b7880afec7546fe01f0d1a6bdd7b7b183ca7a5f77 not found: ID does not exist" containerID="c8329a9b447b2e23b0fb647b7880afec7546fe01f0d1a6bdd7b7b183ca7a5f77"
Jul 26 16:36:25.253968 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.253911    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8329a9b447b2e23b0fb647b7880afec7546fe01f0d1a6bdd7b7b183ca7a5f77"} err="failed to get container status \"c8329a9b447b2e23b0fb647b7880afec7546fe01f0d1a6bdd7b7b183ca7a5f77\": rpc error: code = NotFound desc = could not find container \"c8329a9b447b2e23b0fb647b7880afec7546fe01f0d1a6bdd7b7b183ca7a5f77\": container with ID starting with c8329a9b447b2e23b0fb647b7880afec7546fe01f0d1a6bdd7b7b183ca7a5f77 not found: ID does not exist"
Jul 26 16:36:25.253968 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.253929    2559 scope.go:117] "RemoveContainer" containerID="6f2bf01af8bebef23e59b6abd99988c11a2cd0e59d653641efc1ae6020546402"
Jul 26 16:36:25.262136 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.262111    2559 scope.go:117] "RemoveContainer" containerID="6f2bf01af8bebef23e59b6abd99988c11a2cd0e59d653641efc1ae6020546402"
Jul 26 16:36:25.262371 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:36:25.262351    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f2bf01af8bebef23e59b6abd99988c11a2cd0e59d653641efc1ae6020546402\": container with ID starting with 6f2bf01af8bebef23e59b6abd99988c11a2cd0e59d653641efc1ae6020546402 not found: ID does not exist" containerID="6f2bf01af8bebef23e59b6abd99988c11a2cd0e59d653641efc1ae6020546402"
Jul 26 16:36:25.262441 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.262382    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2bf01af8bebef23e59b6abd99988c11a2cd0e59d653641efc1ae6020546402"} err="failed to get container status \"6f2bf01af8bebef23e59b6abd99988c11a2cd0e59d653641efc1ae6020546402\": rpc error: code = NotFound desc = could not find container \"6f2bf01af8bebef23e59b6abd99988c11a2cd0e59d653641efc1ae6020546402\": container with ID starting with 6f2bf01af8bebef23e59b6abd99988c11a2cd0e59d653641efc1ae6020546402 not found: ID does not exist"
Jul 26 16:36:25.267803 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.267780    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"]
Jul 26 16:36:25.271663 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.271644    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c6b781f9-b5c9f896-7fppm"]
Jul 26 16:36:25.285414 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.285392    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"]
Jul 26 16:36:25.287696 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:25.287676    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c6b781f9-5567869564-98fd7"]
Jul 26 16:36:26.955528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:26.955500    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a42eec1-bb46-4e69-b8f5-08416e05d0c7" path="/var/lib/kubelet/pods/5a42eec1-bb46-4e69-b8f5-08416e05d0c7/volumes"
Jul 26 16:36:26.955872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:26.955831    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba" path="/var/lib/kubelet/pods/6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba/volumes"
Jul 26 16:36:29.152888 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:29.152852    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b"]
Jul 26 16:36:29.156378 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:29.156350    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6b781f9-9fg6b"]
Jul 26 16:36:29.165889 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:29.165864    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:29.333994 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:29.333968    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:29.692963 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:29.692906    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:29.909974 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:29.909942    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:30.061600 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:30.061482    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:30.146934 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:30.146900    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:30.479724 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:30.479696    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:30.752091 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:30.752013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:30.898376 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:30.898346    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:30.955598 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:30.955565    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e" path="/var/lib/kubelet/pods/3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e/volumes"
Jul 26 16:36:32.945317 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:32.945280    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:33.037447 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.037418    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"]
Jul 26 16:36:33.037993 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.037978    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba" containerName="payload-pre-processing"
Jul 26 16:36:33.038062 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.037996    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba" containerName="payload-pre-processing"
Jul 26 16:36:33.038062 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.038017    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e" containerName="revoke-keys"
Jul 26 16:36:33.038062 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.038026    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e" containerName="revoke-keys"
Jul 26 16:36:33.038062 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.038043    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a42eec1-bb46-4e69-b8f5-08416e05d0c7" containerName="payload-processing"
Jul 26 16:36:33.038062 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.038053    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a42eec1-bb46-4e69-b8f5-08416e05d0c7" containerName="payload-processing"
Jul 26 16:36:33.038317 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.038178    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6467fd4e-b3dc-4cfb-8cb5-c6d9959269ba" containerName="payload-pre-processing"
Jul 26 16:36:33.038317 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.038190    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3025de91-0e77-4bf2-a0bd-4c8ef1aa7c6e" containerName="revoke-keys"
Jul 26 16:36:33.038317 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.038203    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a42eec1-bb46-4e69-b8f5-08416e05d0c7" containerName="payload-processing"
Jul 26 16:36:33.043365 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.043345    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:36:33.048374 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.048356    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-6f5d066a-serving-cert\""
Jul 26 16:36:33.048644 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.048584    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c6ndf\""
Jul 26 16:36:33.054644 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.052573    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"]
Jul 26 16:36:33.080610 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.080580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:33.156617 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.156591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzsxq\" (UniqueName: \"kubernetes.io/projected/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-kube-api-access-vzsxq\") pod \"maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm\" (UID: \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:36:33.156785 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.156633    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-openshift-service-ca\") pod \"maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm\" (UID: \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:36:33.156785 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.156665    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-maas-api-tls\") pod \"maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm\" (UID: \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:36:33.184408 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.184382    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:33.257970 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.257887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzsxq\" (UniqueName: \"kubernetes.io/projected/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-kube-api-access-vzsxq\") pod \"maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm\" (UID: \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:36:33.257970 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.257942    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-openshift-service-ca\") pod \"maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm\" (UID: \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:36:33.258218 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.258012    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-maas-api-tls\") pod \"maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm\" (UID: \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:36:33.258646 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.258623    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-openshift-service-ca\") pod \"maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm\" (UID: \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:36:33.260386 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.260360    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-maas-api-tls\") pod \"maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm\" (UID: \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:36:33.267825 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.267805    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzsxq\" (UniqueName: \"kubernetes.io/projected/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-kube-api-access-vzsxq\") pod \"maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm\" (UID: \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:36:33.363626 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.363592    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:36:33.603495 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.603415    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:33.695331 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.695303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:36:33.708878 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.708859    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"]
Jul 26 16:36:33.714347 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:36:33.714318    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec240a7_125a_4f92_86e9_334b3e2d1d0a.slice/crio-2b2bac8004e6c8c96b5940b40cca751eea2ec74ff4bd4ca42f6731152679350c WatchSource:0}: Error finding container 2b2bac8004e6c8c96b5940b40cca751eea2ec74ff4bd4ca42f6731152679350c: Status 404 returned error can't find the container with id 2b2bac8004e6c8c96b5940b40cca751eea2ec74ff4bd4ca42f6731152679350c
Jul 26 16:36:33.715254 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.715231    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 16:36:33.741659 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.741634    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"]
Jul 26 16:36:33.746455 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.746439    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"
Jul 26 16:36:33.748917 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.748897    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-6f5d066a\""
Jul 26 16:36:33.749024 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.748946    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-6f5d066a-dockercfg-s58lc\""
Jul 26 16:36:33.755450 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.755430    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"]
Jul 26 16:36:33.790438 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.790414    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"]
Jul 26 16:36:33.793808 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.793792    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"
Jul 26 16:36:33.805039 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.805017    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"]
Jul 26 16:36:33.863726 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.863648    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/821b0448-49f6-4b40-a6f2-fefa3198369d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55\" (UID: \"821b0448-49f6-4b40-a6f2-fefa3198369d\") " pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"
Jul 26 16:36:33.863726 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.863705    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs8kx\" (UniqueName: \"kubernetes.io/projected/821b0448-49f6-4b40-a6f2-fefa3198369d-kube-api-access-xs8kx\") pod \"payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55\" (UID: \"821b0448-49f6-4b40-a6f2-fefa3198369d\") " pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"
Jul 26 16:36:33.965023 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.964990    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/821b0448-49f6-4b40-a6f2-fefa3198369d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55\" (UID: \"821b0448-49f6-4b40-a6f2-fefa3198369d\") " pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"
Jul 26 16:36:33.965466 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.965048    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg9hq\" (UniqueName: \"kubernetes.io/projected/d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb-kube-api-access-hg9hq\") pod \"payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm\" (UID: \"d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"
Jul 26 16:36:33.965466 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.965101    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs8kx\" (UniqueName: \"kubernetes.io/projected/821b0448-49f6-4b40-a6f2-fefa3198369d-kube-api-access-xs8kx\") pod \"payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55\" (UID: \"821b0448-49f6-4b40-a6f2-fefa3198369d\") " pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"
Jul 26 16:36:33.965466 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.965165    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm\" (UID: \"d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"
Jul 26 16:36:33.965728 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.965709    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/821b0448-49f6-4b40-a6f2-fefa3198369d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55\" (UID: \"821b0448-49f6-4b40-a6f2-fefa3198369d\") " pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"
Jul 26 16:36:33.973867 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:33.973845    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs8kx\" (UniqueName: \"kubernetes.io/projected/821b0448-49f6-4b40-a6f2-fefa3198369d-kube-api-access-xs8kx\") pod \"payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55\" (UID: \"821b0448-49f6-4b40-a6f2-fefa3198369d\") " pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"
Jul 26 16:36:34.058545 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:34.058516    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"
Jul 26 16:36:34.065807 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:34.065777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg9hq\" (UniqueName: \"kubernetes.io/projected/d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb-kube-api-access-hg9hq\") pod \"payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm\" (UID: \"d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"
Jul 26 16:36:34.066045 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:34.065986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm\" (UID: \"d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"
Jul 26 16:36:34.066609 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:34.066591    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm\" (UID: \"d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"
Jul 26 16:36:34.075446 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:34.075424    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg9hq\" (UniqueName: \"kubernetes.io/projected/d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb-kube-api-access-hg9hq\") pod \"payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm\" (UID: \"d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"
Jul 26 16:36:34.103397 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:34.103372    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"
Jul 26 16:36:34.256536 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:34.256507    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"]
Jul 26 16:36:34.257367 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:36:34.257337    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a3dab9_1fab_4c6b_9482_fe2ac1fa2adb.slice/crio-050bc3c2ae5db54c8f27a7270ef75756dbee38818183cb6c41724bdc610ac9ac WatchSource:0}: Error finding container 050bc3c2ae5db54c8f27a7270ef75756dbee38818183cb6c41724bdc610ac9ac: Status 404 returned error can't find the container with id 050bc3c2ae5db54c8f27a7270ef75756dbee38818183cb6c41724bdc610ac9ac
Jul 26 16:36:34.295606 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:34.295575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm" event={"ID":"9ec240a7-125a-4f92-86e9-334b3e2d1d0a","Type":"ContainerStarted","Data":"2b2bac8004e6c8c96b5940b40cca751eea2ec74ff4bd4ca42f6731152679350c"}
Jul 26 16:36:34.296877 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:34.296855    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm" event={"ID":"d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb","Type":"ContainerStarted","Data":"050bc3c2ae5db54c8f27a7270ef75756dbee38818183cb6c41724bdc610ac9ac"}
Jul 26 16:36:34.408708 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:34.408640    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"]
Jul 26 16:36:34.410850 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:36:34.410821    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821b0448_49f6_4b40_a6f2_fefa3198369d.slice/crio-559d9bd0dbf2b85bb5615ab8cefced43af5710f7bcacb212107e3bc982f3049b WatchSource:0}: Error finding container 559d9bd0dbf2b85bb5615ab8cefced43af5710f7bcacb212107e3bc982f3049b: Status 404 returned error can't find the container with id 559d9bd0dbf2b85bb5615ab8cefced43af5710f7bcacb212107e3bc982f3049b
Jul 26 16:36:35.303627 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:35.303596    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm" event={"ID":"d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb","Type":"ContainerStarted","Data":"83a142c2d166a43db615da3c2f884e2ff47853a4089a5be4def7441469d066ba"}
Jul 26 16:36:35.304056 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:35.303666    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"
Jul 26 16:36:35.305273 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:35.305244    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55" event={"ID":"821b0448-49f6-4b40-a6f2-fefa3198369d","Type":"ContainerStarted","Data":"71520b79e00183886acc7f4035222c73b23dc30b447e8c960b2774eb59543110"}
Jul 26 16:36:35.305398 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:35.305297    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55" event={"ID":"821b0448-49f6-4b40-a6f2-fefa3198369d","Type":"ContainerStarted","Data":"559d9bd0dbf2b85bb5615ab8cefced43af5710f7bcacb212107e3bc982f3049b"}
Jul 26 16:36:35.305398 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:35.305330    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"
Jul 26 16:36:35.306663 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:35.306643    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm" event={"ID":"9ec240a7-125a-4f92-86e9-334b3e2d1d0a","Type":"ContainerStarted","Data":"7ea67896ad5b842d72fcb709c9f06b05cc873e5275356052dc98e99429fc0a7c"}
Jul 26 16:36:35.306766 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:35.306750    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:36:35.320673 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:35.320634    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm" podStartSLOduration=2.320620796 podStartE2EDuration="2.320620796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:36:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:36:35.319974739 +0000 UTC m=+1710.854674015" watchObservedRunningTime="2026-07-26 16:36:35.320620796 +0000 UTC m=+1710.855320070"
Jul 26 16:36:35.336415 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:35.336343    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55" podStartSLOduration=2.336330419 podStartE2EDuration="2.336330419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:36:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:36:35.33435942 +0000 UTC m=+1710.869058694" watchObservedRunningTime="2026-07-26 16:36:35.336330419 +0000 UTC m=+1710.871029694"
Jul 26 16:36:35.352719 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:35.352682    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm" podStartSLOduration=0.989093083 podStartE2EDuration="2.352670845s" totalImagesPullingTime="1.363577762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:36:35.352299858 +0000 UTC m=+1710.886999132" watchObservedRunningTime="2026-07-26 16:36:35.352670845 +0000 UTC m=+1710.887370120"
Jul 26 16:36:41.318870 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:41.318841    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:36:46.314347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:46.314315    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"
Jul 26 16:36:46.314813 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:46.314696    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"
Jul 26 16:36:50.425570 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:36:50.425535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:13.506775 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:13.506743    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"]
Jul 26 16:37:13.507459 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:13.507413    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm" podUID="9ec240a7-125a-4f92-86e9-334b3e2d1d0a" containerName="maas-api" containerID="cri-o://7ea67896ad5b842d72fcb709c9f06b05cc873e5275356052dc98e99429fc0a7c" gracePeriod=30
Jul 26 16:37:13.529295 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:13.529272    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:13.571302 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:13.571272    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"]
Jul 26 16:37:13.571568 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:13.571520    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55" podUID="821b0448-49f6-4b40-a6f2-fefa3198369d" containerName="payload-processing" containerID="cri-o://71520b79e00183886acc7f4035222c73b23dc30b447e8c960b2774eb59543110" gracePeriod=30
Jul 26 16:37:13.577741 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:13.577712    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"]
Jul 26 16:37:13.577967 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:13.577942    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm" podUID="d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb" containerName="payload-pre-processing" containerID="cri-o://83a142c2d166a43db615da3c2f884e2ff47853a4089a5be4def7441469d066ba" gracePeriod=30
Jul 26 16:37:13.614348 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:13.614321    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:13.684918 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:13.684625    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:13.877891 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:13.877858    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:37:13.886011 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:13.885989    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"
Jul 26 16:37:13.889055 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:13.889035    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"
Jul 26 16:37:14.001095 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.001055    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs8kx\" (UniqueName: \"kubernetes.io/projected/821b0448-49f6-4b40-a6f2-fefa3198369d-kube-api-access-xs8kx\") pod \"821b0448-49f6-4b40-a6f2-fefa3198369d\" (UID: \"821b0448-49f6-4b40-a6f2-fefa3198369d\") "
Jul 26 16:37:14.001274 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.001120    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-maas-api-tls\") pod \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\" (UID: \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\") "
Jul 26 16:37:14.001274 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.001206    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-openshift-service-ca\") pod \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\" (UID: \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\") "
Jul 26 16:37:14.001274 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.001262    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hg9hq\" (UniqueName: \"kubernetes.io/projected/d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb-kube-api-access-hg9hq\") pod \"d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb\" (UID: \"d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb\") "
Jul 26 16:37:14.001446 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.001295    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb-plugins-config-volume\") pod \"d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb\" (UID: \"d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb\") "
Jul 26 16:37:14.001446 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.001325    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzsxq\" (UniqueName: \"kubernetes.io/projected/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-kube-api-access-vzsxq\") pod \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\" (UID: \"9ec240a7-125a-4f92-86e9-334b3e2d1d0a\") "
Jul 26 16:37:14.001446 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.001368    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/821b0448-49f6-4b40-a6f2-fefa3198369d-plugins-config-volume\") pod \"821b0448-49f6-4b40-a6f2-fefa3198369d\" (UID: \"821b0448-49f6-4b40-a6f2-fefa3198369d\") "
Jul 26 16:37:14.001641 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.001612    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9ec240a7-125a-4f92-86e9-334b3e2d1d0a" (UID: "9ec240a7-125a-4f92-86e9-334b3e2d1d0a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:37:14.001700 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.001680    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb" (UID: "d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:37:14.001755 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.001700    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-openshift-service-ca\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:37:14.002002 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.001975    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/821b0448-49f6-4b40-a6f2-fefa3198369d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "821b0448-49f6-4b40-a6f2-fefa3198369d" (UID: "821b0448-49f6-4b40-a6f2-fefa3198369d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:37:14.003414 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.003385    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb-kube-api-access-hg9hq" (OuterVolumeSpecName: "kube-api-access-hg9hq") pod "d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb" (UID: "d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb"). InnerVolumeSpecName "kube-api-access-hg9hq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:37:14.003511 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.003424    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/821b0448-49f6-4b40-a6f2-fefa3198369d-kube-api-access-xs8kx" (OuterVolumeSpecName: "kube-api-access-xs8kx") pod "821b0448-49f6-4b40-a6f2-fefa3198369d" (UID: "821b0448-49f6-4b40-a6f2-fefa3198369d"). InnerVolumeSpecName "kube-api-access-xs8kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:37:14.003511 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.003437    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9ec240a7-125a-4f92-86e9-334b3e2d1d0a" (UID: "9ec240a7-125a-4f92-86e9-334b3e2d1d0a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:37:14.003876 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.003856    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-kube-api-access-vzsxq" (OuterVolumeSpecName: "kube-api-access-vzsxq") pod "9ec240a7-125a-4f92-86e9-334b3e2d1d0a" (UID: "9ec240a7-125a-4f92-86e9-334b3e2d1d0a"). InnerVolumeSpecName "kube-api-access-vzsxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:37:14.102228 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.102121    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:37:14.102228 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.102175    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzsxq\" (UniqueName: \"kubernetes.io/projected/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-kube-api-access-vzsxq\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:37:14.102228 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.102185    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/821b0448-49f6-4b40-a6f2-fefa3198369d-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:37:14.102228 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.102193    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs8kx\" (UniqueName: \"kubernetes.io/projected/821b0448-49f6-4b40-a6f2-fefa3198369d-kube-api-access-xs8kx\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:37:14.102228 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.102203    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ec240a7-125a-4f92-86e9-334b3e2d1d0a-maas-api-tls\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:37:14.102228 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.102212    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg9hq\" (UniqueName: \"kubernetes.io/projected/d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb-kube-api-access-hg9hq\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:37:14.513236 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.513205    2559 generic.go:356] "Generic (PLEG): container finished" podID="9ec240a7-125a-4f92-86e9-334b3e2d1d0a" containerID="7ea67896ad5b842d72fcb709c9f06b05cc873e5275356052dc98e99429fc0a7c" exitCode=0
Jul 26 16:37:14.513686 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.513248    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"
Jul 26 16:37:14.513686 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.513287    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm" event={"ID":"9ec240a7-125a-4f92-86e9-334b3e2d1d0a","Type":"ContainerDied","Data":"7ea67896ad5b842d72fcb709c9f06b05cc873e5275356052dc98e99429fc0a7c"}
Jul 26 16:37:14.513686 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.513335    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm" event={"ID":"9ec240a7-125a-4f92-86e9-334b3e2d1d0a","Type":"ContainerDied","Data":"2b2bac8004e6c8c96b5940b40cca751eea2ec74ff4bd4ca42f6731152679350c"}
Jul 26 16:37:14.513686 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.513353    2559 scope.go:117] "RemoveContainer" containerID="7ea67896ad5b842d72fcb709c9f06b05cc873e5275356052dc98e99429fc0a7c"
Jul 26 16:37:14.514872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.514715    2559 generic.go:356] "Generic (PLEG): container finished" podID="d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb" containerID="83a142c2d166a43db615da3c2f884e2ff47853a4089a5be4def7441469d066ba" exitCode=0
Jul 26 16:37:14.514872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.514744    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"
Jul 26 16:37:14.514872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.514794    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm" event={"ID":"d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb","Type":"ContainerDied","Data":"83a142c2d166a43db615da3c2f884e2ff47853a4089a5be4def7441469d066ba"}
Jul 26 16:37:14.514872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.514861    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm" event={"ID":"d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb","Type":"ContainerDied","Data":"050bc3c2ae5db54c8f27a7270ef75756dbee38818183cb6c41724bdc610ac9ac"}
Jul 26 16:37:14.516504 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.516349    2559 generic.go:356] "Generic (PLEG): container finished" podID="821b0448-49f6-4b40-a6f2-fefa3198369d" containerID="71520b79e00183886acc7f4035222c73b23dc30b447e8c960b2774eb59543110" exitCode=0
Jul 26 16:37:14.516504 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.516396    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"
Jul 26 16:37:14.516504 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.516435    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55" event={"ID":"821b0448-49f6-4b40-a6f2-fefa3198369d","Type":"ContainerDied","Data":"71520b79e00183886acc7f4035222c73b23dc30b447e8c960b2774eb59543110"}
Jul 26 16:37:14.516504 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.516477    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55" event={"ID":"821b0448-49f6-4b40-a6f2-fefa3198369d","Type":"ContainerDied","Data":"559d9bd0dbf2b85bb5615ab8cefced43af5710f7bcacb212107e3bc982f3049b"}
Jul 26 16:37:14.537284 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.537254    2559 scope.go:117] "RemoveContainer" containerID="7ea67896ad5b842d72fcb709c9f06b05cc873e5275356052dc98e99429fc0a7c"
Jul 26 16:37:14.537585 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:37:14.537565    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ea67896ad5b842d72fcb709c9f06b05cc873e5275356052dc98e99429fc0a7c\": container with ID starting with 7ea67896ad5b842d72fcb709c9f06b05cc873e5275356052dc98e99429fc0a7c not found: ID does not exist" containerID="7ea67896ad5b842d72fcb709c9f06b05cc873e5275356052dc98e99429fc0a7c"
Jul 26 16:37:14.537661 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.537592    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ea67896ad5b842d72fcb709c9f06b05cc873e5275356052dc98e99429fc0a7c"} err="failed to get container status \"7ea67896ad5b842d72fcb709c9f06b05cc873e5275356052dc98e99429fc0a7c\": rpc error: code = NotFound desc = could not find container \"7ea67896ad5b842d72fcb709c9f06b05cc873e5275356052dc98e99429fc0a7c\": container with ID starting with 7ea67896ad5b842d72fcb709c9f06b05cc873e5275356052dc98e99429fc0a7c not found: ID does not exist"
Jul 26 16:37:14.537661 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.537614    2559 scope.go:117] "RemoveContainer" containerID="83a142c2d166a43db615da3c2f884e2ff47853a4089a5be4def7441469d066ba"
Jul 26 16:37:14.545196 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.545179    2559 scope.go:117] "RemoveContainer" containerID="83a142c2d166a43db615da3c2f884e2ff47853a4089a5be4def7441469d066ba"
Jul 26 16:37:14.545411 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:37:14.545394    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83a142c2d166a43db615da3c2f884e2ff47853a4089a5be4def7441469d066ba\": container with ID starting with 83a142c2d166a43db615da3c2f884e2ff47853a4089a5be4def7441469d066ba not found: ID does not exist" containerID="83a142c2d166a43db615da3c2f884e2ff47853a4089a5be4def7441469d066ba"
Jul 26 16:37:14.545460 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.545416    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83a142c2d166a43db615da3c2f884e2ff47853a4089a5be4def7441469d066ba"} err="failed to get container status \"83a142c2d166a43db615da3c2f884e2ff47853a4089a5be4def7441469d066ba\": rpc error: code = NotFound desc = could not find container \"83a142c2d166a43db615da3c2f884e2ff47853a4089a5be4def7441469d066ba\": container with ID starting with 83a142c2d166a43db615da3c2f884e2ff47853a4089a5be4def7441469d066ba not found: ID does not exist"
Jul 26 16:37:14.545460 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.545434    2559 scope.go:117] "RemoveContainer" containerID="71520b79e00183886acc7f4035222c73b23dc30b447e8c960b2774eb59543110"
Jul 26 16:37:14.550726 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.550706    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"]
Jul 26 16:37:14.553414 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.553396    2559 scope.go:117] "RemoveContainer" containerID="71520b79e00183886acc7f4035222c73b23dc30b447e8c960b2774eb59543110"
Jul 26 16:37:14.553681 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:37:14.553663    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71520b79e00183886acc7f4035222c73b23dc30b447e8c960b2774eb59543110\": container with ID starting with 71520b79e00183886acc7f4035222c73b23dc30b447e8c960b2774eb59543110 not found: ID does not exist" containerID="71520b79e00183886acc7f4035222c73b23dc30b447e8c960b2774eb59543110"
Jul 26 16:37:14.553757 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.553686    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71520b79e00183886acc7f4035222c73b23dc30b447e8c960b2774eb59543110"} err="failed to get container status \"71520b79e00183886acc7f4035222c73b23dc30b447e8c960b2774eb59543110\": rpc error: code = NotFound desc = could not find container \"71520b79e00183886acc7f4035222c73b23dc30b447e8c960b2774eb59543110\": container with ID starting with 71520b79e00183886acc7f4035222c73b23dc30b447e8c960b2774eb59543110 not found: ID does not exist"
Jul 26 16:37:14.554497 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.554473    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6f5d066a-75df885c59-m7zsm"]
Jul 26 16:37:14.564180 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.564160    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"]
Jul 26 16:37:14.567941 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.567923    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-6f5d066a-7746bf6d84-4dbtm"]
Jul 26 16:37:14.577803 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.577784    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"]
Jul 26 16:37:14.582169 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.582150    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-6f5d066a-676f57cc89-zzf55"]
Jul 26 16:37:14.958855 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.958825    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="821b0448-49f6-4b40-a6f2-fefa3198369d" path="/var/lib/kubelet/pods/821b0448-49f6-4b40-a6f2-fefa3198369d/volumes"
Jul 26 16:37:14.959232 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.959219    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec240a7-125a-4f92-86e9-334b3e2d1d0a" path="/var/lib/kubelet/pods/9ec240a7-125a-4f92-86e9-334b3e2d1d0a/volumes"
Jul 26 16:37:14.959573 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:14.959561    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb" path="/var/lib/kubelet/pods/d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb/volumes"
Jul 26 16:37:18.129084 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:18.129044    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:18.279916 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:18.279884    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:18.652548 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:18.652516    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:18.756444 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:18.756415    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:19.069510 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:19.069473    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:19.244284 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:19.244251    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:21.038704 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.038669    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:21.120911 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.120879    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"]
Jul 26 16:37:21.121354 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.121334    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="821b0448-49f6-4b40-a6f2-fefa3198369d" containerName="payload-processing"
Jul 26 16:37:21.121443 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.121356    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="821b0448-49f6-4b40-a6f2-fefa3198369d" containerName="payload-processing"
Jul 26 16:37:21.121443 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.121384    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb" containerName="payload-pre-processing"
Jul 26 16:37:21.121443 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.121391    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb" containerName="payload-pre-processing"
Jul 26 16:37:21.121443 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.121413    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec240a7-125a-4f92-86e9-334b3e2d1d0a" containerName="maas-api"
Jul 26 16:37:21.121443 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.121423    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec240a7-125a-4f92-86e9-334b3e2d1d0a" containerName="maas-api"
Jul 26 16:37:21.121693 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.121528    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="821b0448-49f6-4b40-a6f2-fefa3198369d" containerName="payload-processing"
Jul 26 16:37:21.121693 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.121545    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec240a7-125a-4f92-86e9-334b3e2d1d0a" containerName="maas-api"
Jul 26 16:37:21.121693 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.121554    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a3dab9-1fab-4c6b-9482-fe2ac1fa2adb" containerName="payload-pre-processing"
Jul 26 16:37:21.123224 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.123197    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:21.124769 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.124751    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:21.130036 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.130014    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c6ndf\""
Jul 26 16:37:21.130156 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.130093    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9f8fd10f-serving-cert\""
Jul 26 16:37:21.139902 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.139870    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"]
Jul 26 16:37:21.193615 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.193582    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:21.262622 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.262582    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/368dfd0b-6787-42d0-af9b-d9757ef09611-maas-api-tls\") pod \"maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l\" (UID: \"368dfd0b-6787-42d0-af9b-d9757ef09611\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:21.262791 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.262726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/368dfd0b-6787-42d0-af9b-d9757ef09611-openshift-service-ca\") pod \"maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l\" (UID: \"368dfd0b-6787-42d0-af9b-d9757ef09611\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:21.262791 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.262755    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56tc6\" (UniqueName: \"kubernetes.io/projected/368dfd0b-6787-42d0-af9b-d9757ef09611-kube-api-access-56tc6\") pod \"maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l\" (UID: \"368dfd0b-6787-42d0-af9b-d9757ef09611\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:21.363285 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.363203    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/368dfd0b-6787-42d0-af9b-d9757ef09611-openshift-service-ca\") pod \"maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l\" (UID: \"368dfd0b-6787-42d0-af9b-d9757ef09611\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:21.363285 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.363242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tc6\" (UniqueName: \"kubernetes.io/projected/368dfd0b-6787-42d0-af9b-d9757ef09611-kube-api-access-56tc6\") pod \"maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l\" (UID: \"368dfd0b-6787-42d0-af9b-d9757ef09611\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:21.363471 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.363300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/368dfd0b-6787-42d0-af9b-d9757ef09611-maas-api-tls\") pod \"maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l\" (UID: \"368dfd0b-6787-42d0-af9b-d9757ef09611\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:21.363471 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:37:21.363439    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-serving-cert: secret "maas-api-e2e-ait-9f8fd10f-serving-cert" not found
Jul 26 16:37:21.363562 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:37:21.363503    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/368dfd0b-6787-42d0-af9b-d9757ef09611-maas-api-tls podName:368dfd0b-6787-42d0-af9b-d9757ef09611 nodeName:}" failed. No retries permitted until 2026-07-26 16:37:21.863482986 +0000 UTC m=+1757.398182239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/368dfd0b-6787-42d0-af9b-d9757ef09611-maas-api-tls") pod "maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l" (UID: "368dfd0b-6787-42d0-af9b-d9757ef09611") : secret "maas-api-e2e-ait-9f8fd10f-serving-cert" not found
Jul 26 16:37:21.363836 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.363816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/368dfd0b-6787-42d0-af9b-d9757ef09611-openshift-service-ca\") pod \"maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l\" (UID: \"368dfd0b-6787-42d0-af9b-d9757ef09611\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:21.372676 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.372649    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56tc6\" (UniqueName: \"kubernetes.io/projected/368dfd0b-6787-42d0-af9b-d9757ef09611-kube-api-access-56tc6\") pod \"maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l\" (UID: \"368dfd0b-6787-42d0-af9b-d9757ef09611\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:21.627452 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.627381    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:21.721219 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.721185    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:21.755102 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.755073    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"]
Jul 26 16:37:21.758430 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.758414    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"
Jul 26 16:37:21.760773 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.760750    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9f8fd10f\""
Jul 26 16:37:21.760901 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.760750    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9f8fd10f-dockercfg-p948b\""
Jul 26 16:37:21.770563 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.770542    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"]
Jul 26 16:37:21.816321 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.816291    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"]
Jul 26 16:37:21.819726 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.819711    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"
Jul 26 16:37:21.830624 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.830604    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"]
Jul 26 16:37:21.869048 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.869023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9e42506-7789-4b17-9b6c-bece0f981772-plugins-config-volume\") pod \"payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz\" (UID: \"a9e42506-7789-4b17-9b6c-bece0f981772\") " pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"
Jul 26 16:37:21.869226 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.869082    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/368dfd0b-6787-42d0-af9b-d9757ef09611-maas-api-tls\") pod \"maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l\" (UID: \"368dfd0b-6787-42d0-af9b-d9757ef09611\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:21.869226 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.869143    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gndkt\" (UniqueName: \"kubernetes.io/projected/a9e42506-7789-4b17-9b6c-bece0f981772-kube-api-access-gndkt\") pod \"payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz\" (UID: \"a9e42506-7789-4b17-9b6c-bece0f981772\") " pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"
Jul 26 16:37:21.871424 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.871403    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/368dfd0b-6787-42d0-af9b-d9757ef09611-maas-api-tls\") pod \"maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l\" (UID: \"368dfd0b-6787-42d0-af9b-d9757ef09611\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:21.969779 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.969751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gndkt\" (UniqueName: \"kubernetes.io/projected/a9e42506-7789-4b17-9b6c-bece0f981772-kube-api-access-gndkt\") pod \"payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz\" (UID: \"a9e42506-7789-4b17-9b6c-bece0f981772\") " pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"
Jul 26 16:37:21.969902 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.969800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbbhp\" (UniqueName: \"kubernetes.io/projected/de291d7d-0b78-467f-8ac2-db1577ff2053-kube-api-access-jbbhp\") pod \"payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz\" (UID: \"de291d7d-0b78-467f-8ac2-db1577ff2053\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"
Jul 26 16:37:21.969902 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.969839    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9e42506-7789-4b17-9b6c-bece0f981772-plugins-config-volume\") pod \"payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz\" (UID: \"a9e42506-7789-4b17-9b6c-bece0f981772\") " pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"
Jul 26 16:37:21.969902 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.969861    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de291d7d-0b78-467f-8ac2-db1577ff2053-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz\" (UID: \"de291d7d-0b78-467f-8ac2-db1577ff2053\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"
Jul 26 16:37:21.970487 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.970469    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9e42506-7789-4b17-9b6c-bece0f981772-plugins-config-volume\") pod \"payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz\" (UID: \"a9e42506-7789-4b17-9b6c-bece0f981772\") " pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"
Jul 26 16:37:21.977879 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:21.977855    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gndkt\" (UniqueName: \"kubernetes.io/projected/a9e42506-7789-4b17-9b6c-bece0f981772-kube-api-access-gndkt\") pod \"payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz\" (UID: \"a9e42506-7789-4b17-9b6c-bece0f981772\") " pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"
Jul 26 16:37:22.036524 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.036501    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:22.069572 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.069543    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"
Jul 26 16:37:22.071078 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.071050    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbbhp\" (UniqueName: \"kubernetes.io/projected/de291d7d-0b78-467f-8ac2-db1577ff2053-kube-api-access-jbbhp\") pod \"payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz\" (UID: \"de291d7d-0b78-467f-8ac2-db1577ff2053\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"
Jul 26 16:37:22.071217 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.071199    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de291d7d-0b78-467f-8ac2-db1577ff2053-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz\" (UID: \"de291d7d-0b78-467f-8ac2-db1577ff2053\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"
Jul 26 16:37:22.071860 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.071842    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de291d7d-0b78-467f-8ac2-db1577ff2053-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz\" (UID: \"de291d7d-0b78-467f-8ac2-db1577ff2053\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"
Jul 26 16:37:22.081069 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.081045    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbbhp\" (UniqueName: \"kubernetes.io/projected/de291d7d-0b78-467f-8ac2-db1577ff2053-kube-api-access-jbbhp\") pod \"payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz\" (UID: \"de291d7d-0b78-467f-8ac2-db1577ff2053\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"
Jul 26 16:37:22.130314 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.129979    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"
Jul 26 16:37:22.191821 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.191771    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"]
Jul 26 16:37:22.195170 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:37:22.195009    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod368dfd0b_6787_42d0_af9b_d9757ef09611.slice/crio-9ce6adc099e176a9be9c5ac825193486f021a3473d11b56ee8df8fd589a40aee WatchSource:0}: Error finding container 9ce6adc099e176a9be9c5ac825193486f021a3473d11b56ee8df8fd589a40aee: Status 404 returned error can't find the container with id 9ce6adc099e176a9be9c5ac825193486f021a3473d11b56ee8df8fd589a40aee
Jul 26 16:37:22.230842 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.230813    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"]
Jul 26 16:37:22.232783 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:37:22.232421    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e42506_7789_4b17_9b6c_bece0f981772.slice/crio-754f48d34845ee668f3ae9c95b06e80439c2439f8bd03abc4423e555d5e1476e WatchSource:0}: Error finding container 754f48d34845ee668f3ae9c95b06e80439c2439f8bd03abc4423e555d5e1476e: Status 404 returned error can't find the container with id 754f48d34845ee668f3ae9c95b06e80439c2439f8bd03abc4423e555d5e1476e
Jul 26 16:37:22.497483 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.497457    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"]
Jul 26 16:37:22.499355 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:37:22.499325    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde291d7d_0b78_467f_8ac2_db1577ff2053.slice/crio-0673203dea51b2761ff03b5daf408c82cd7874ebe209717853066172cfdb09b5 WatchSource:0}: Error finding container 0673203dea51b2761ff03b5daf408c82cd7874ebe209717853066172cfdb09b5: Status 404 returned error can't find the container with id 0673203dea51b2761ff03b5daf408c82cd7874ebe209717853066172cfdb09b5
Jul 26 16:37:22.573444 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.573333    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz" event={"ID":"de291d7d-0b78-467f-8ac2-db1577ff2053","Type":"ContainerStarted","Data":"0673203dea51b2761ff03b5daf408c82cd7874ebe209717853066172cfdb09b5"}
Jul 26 16:37:22.575149 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.575083    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l" event={"ID":"368dfd0b-6787-42d0-af9b-d9757ef09611","Type":"ContainerStarted","Data":"9ce6adc099e176a9be9c5ac825193486f021a3473d11b56ee8df8fd589a40aee"}
Jul 26 16:37:22.577595 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.577565    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz" event={"ID":"a9e42506-7789-4b17-9b6c-bece0f981772","Type":"ContainerStarted","Data":"565a102003a8339d2d4dfa44ba47f6d88ce5d7e94c4ef30bd62514e1b71d14a9"}
Jul 26 16:37:22.577705 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.577622    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz" event={"ID":"a9e42506-7789-4b17-9b6c-bece0f981772","Type":"ContainerStarted","Data":"754f48d34845ee668f3ae9c95b06e80439c2439f8bd03abc4423e555d5e1476e"}
Jul 26 16:37:22.578103 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.577865    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"
Jul 26 16:37:22.617521 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:22.617481    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz" podStartSLOduration=1.617466431 podStartE2EDuration="1.617466431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:37:22.615673984 +0000 UTC m=+1758.150373253" watchObservedRunningTime="2026-07-26 16:37:22.617466431 +0000 UTC m=+1758.152165762"
Jul 26 16:37:23.585770 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:23.585738    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz" event={"ID":"de291d7d-0b78-467f-8ac2-db1577ff2053","Type":"ContainerStarted","Data":"36067aafb67ee7e8f251bd4880595d11b11361904a3b5e4eebf29343aa2f7f4b"}
Jul 26 16:37:23.586227 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:23.585875    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"
Jul 26 16:37:23.587416 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:23.587385    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l" event={"ID":"368dfd0b-6787-42d0-af9b-d9757ef09611","Type":"ContainerStarted","Data":"66238864afba692b7b8acbdee39170949cfd1ae71cb0d116b72178b52514ee7b"}
Jul 26 16:37:23.587549 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:23.587494    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:23.604301 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:23.604255    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz" podStartSLOduration=2.604243056 podStartE2EDuration="2.604243056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:37:23.602572715 +0000 UTC m=+1759.137271989" watchObservedRunningTime="2026-07-26 16:37:23.604243056 +0000 UTC m=+1759.138942331"
Jul 26 16:37:23.619776 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:23.619736    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l" podStartSLOduration=2.26048569 podStartE2EDuration="2.619728404s" totalImagesPullingTime="359.242714ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:37:23.618550237 +0000 UTC m=+1759.153249513" watchObservedRunningTime="2026-07-26 16:37:23.619728404 +0000 UTC m=+1759.154427671"
Jul 26 16:37:29.597689 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:29.597661    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:33.589728 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:33.589703    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"
Jul 26 16:37:34.594467 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:34.594438    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"
Jul 26 16:37:57.312804 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.312726    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"]
Jul 26 16:37:57.313251 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.313011    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l" podUID="368dfd0b-6787-42d0-af9b-d9757ef09611" containerName="maas-api" containerID="cri-o://66238864afba692b7b8acbdee39170949cfd1ae71cb0d116b72178b52514ee7b" gracePeriod=30
Jul 26 16:37:57.341082 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.341059    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:57.367900 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.367869    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"]
Jul 26 16:37:57.368161 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.368115    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz" podUID="a9e42506-7789-4b17-9b6c-bece0f981772" containerName="payload-processing" containerID="cri-o://565a102003a8339d2d4dfa44ba47f6d88ce5d7e94c4ef30bd62514e1b71d14a9" gracePeriod=30
Jul 26 16:37:57.373348 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.373307    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"]
Jul 26 16:37:57.374284 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.374076    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz" podUID="de291d7d-0b78-467f-8ac2-db1577ff2053" containerName="payload-pre-processing" containerID="cri-o://36067aafb67ee7e8f251bd4880595d11b11361904a3b5e4eebf29343aa2f7f4b" gracePeriod=30
Jul 26 16:37:57.443482 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.443454    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:57.547059 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.546935    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:37:57.645442 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.645419    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:57.667870 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.667847    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"
Jul 26 16:37:57.668840 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.668816    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/368dfd0b-6787-42d0-af9b-d9757ef09611-maas-api-tls\") pod \"368dfd0b-6787-42d0-af9b-d9757ef09611\" (UID: \"368dfd0b-6787-42d0-af9b-d9757ef09611\") "
Jul 26 16:37:57.668921 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.668895    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56tc6\" (UniqueName: \"kubernetes.io/projected/368dfd0b-6787-42d0-af9b-d9757ef09611-kube-api-access-56tc6\") pod \"368dfd0b-6787-42d0-af9b-d9757ef09611\" (UID: \"368dfd0b-6787-42d0-af9b-d9757ef09611\") "
Jul 26 16:37:57.668980 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.668925    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/368dfd0b-6787-42d0-af9b-d9757ef09611-openshift-service-ca\") pod \"368dfd0b-6787-42d0-af9b-d9757ef09611\" (UID: \"368dfd0b-6787-42d0-af9b-d9757ef09611\") "
Jul 26 16:37:57.669363 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.669336    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/368dfd0b-6787-42d0-af9b-d9757ef09611-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "368dfd0b-6787-42d0-af9b-d9757ef09611" (UID: "368dfd0b-6787-42d0-af9b-d9757ef09611"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:37:57.670911 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.670883    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/368dfd0b-6787-42d0-af9b-d9757ef09611-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "368dfd0b-6787-42d0-af9b-d9757ef09611" (UID: "368dfd0b-6787-42d0-af9b-d9757ef09611"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:37:57.671022 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.671002    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/368dfd0b-6787-42d0-af9b-d9757ef09611-kube-api-access-56tc6" (OuterVolumeSpecName: "kube-api-access-56tc6") pod "368dfd0b-6787-42d0-af9b-d9757ef09611" (UID: "368dfd0b-6787-42d0-af9b-d9757ef09611"). InnerVolumeSpecName "kube-api-access-56tc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:37:57.672176 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.672158    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"
Jul 26 16:37:57.764698 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.764655    2559 generic.go:356] "Generic (PLEG): container finished" podID="a9e42506-7789-4b17-9b6c-bece0f981772" containerID="565a102003a8339d2d4dfa44ba47f6d88ce5d7e94c4ef30bd62514e1b71d14a9" exitCode=0
Jul 26 16:37:57.764698 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.764699    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"
Jul 26 16:37:57.764933 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.764730    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz" event={"ID":"a9e42506-7789-4b17-9b6c-bece0f981772","Type":"ContainerDied","Data":"565a102003a8339d2d4dfa44ba47f6d88ce5d7e94c4ef30bd62514e1b71d14a9"}
Jul 26 16:37:57.764933 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.764804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz" event={"ID":"a9e42506-7789-4b17-9b6c-bece0f981772","Type":"ContainerDied","Data":"754f48d34845ee668f3ae9c95b06e80439c2439f8bd03abc4423e555d5e1476e"}
Jul 26 16:37:57.764933 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.764841    2559 scope.go:117] "RemoveContainer" containerID="565a102003a8339d2d4dfa44ba47f6d88ce5d7e94c4ef30bd62514e1b71d14a9"
Jul 26 16:37:57.766441 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.766419    2559 generic.go:356] "Generic (PLEG): container finished" podID="de291d7d-0b78-467f-8ac2-db1577ff2053" containerID="36067aafb67ee7e8f251bd4880595d11b11361904a3b5e4eebf29343aa2f7f4b" exitCode=0
Jul 26 16:37:57.766550 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.766470    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"
Jul 26 16:37:57.766550 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.766491    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz" event={"ID":"de291d7d-0b78-467f-8ac2-db1577ff2053","Type":"ContainerDied","Data":"36067aafb67ee7e8f251bd4880595d11b11361904a3b5e4eebf29343aa2f7f4b"}
Jul 26 16:37:57.766550 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.766546    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz" event={"ID":"de291d7d-0b78-467f-8ac2-db1577ff2053","Type":"ContainerDied","Data":"0673203dea51b2761ff03b5daf408c82cd7874ebe209717853066172cfdb09b5"}
Jul 26 16:37:57.768066 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.768031    2559 generic.go:356] "Generic (PLEG): container finished" podID="368dfd0b-6787-42d0-af9b-d9757ef09611" containerID="66238864afba692b7b8acbdee39170949cfd1ae71cb0d116b72178b52514ee7b" exitCode=0
Jul 26 16:37:57.768203 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.768084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l" event={"ID":"368dfd0b-6787-42d0-af9b-d9757ef09611","Type":"ContainerDied","Data":"66238864afba692b7b8acbdee39170949cfd1ae71cb0d116b72178b52514ee7b"}
Jul 26 16:37:57.768203 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.768086    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"
Jul 26 16:37:57.768203 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.768146    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l" event={"ID":"368dfd0b-6787-42d0-af9b-d9757ef09611","Type":"ContainerDied","Data":"9ce6adc099e176a9be9c5ac825193486f021a3473d11b56ee8df8fd589a40aee"}
Jul 26 16:37:57.770100 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.770071    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9e42506-7789-4b17-9b6c-bece0f981772-plugins-config-volume\") pod \"a9e42506-7789-4b17-9b6c-bece0f981772\" (UID: \"a9e42506-7789-4b17-9b6c-bece0f981772\") "
Jul 26 16:37:57.770217 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.770145    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbbhp\" (UniqueName: \"kubernetes.io/projected/de291d7d-0b78-467f-8ac2-db1577ff2053-kube-api-access-jbbhp\") pod \"de291d7d-0b78-467f-8ac2-db1577ff2053\" (UID: \"de291d7d-0b78-467f-8ac2-db1577ff2053\") "
Jul 26 16:37:57.770217 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.770180    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de291d7d-0b78-467f-8ac2-db1577ff2053-plugins-config-volume\") pod \"de291d7d-0b78-467f-8ac2-db1577ff2053\" (UID: \"de291d7d-0b78-467f-8ac2-db1577ff2053\") "
Jul 26 16:37:57.770358 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.770271    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gndkt\" (UniqueName: \"kubernetes.io/projected/a9e42506-7789-4b17-9b6c-bece0f981772-kube-api-access-gndkt\") pod \"a9e42506-7789-4b17-9b6c-bece0f981772\" (UID: \"a9e42506-7789-4b17-9b6c-bece0f981772\") "
Jul 26 16:37:57.770493 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.770471    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9e42506-7789-4b17-9b6c-bece0f981772-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a9e42506-7789-4b17-9b6c-bece0f981772" (UID: "a9e42506-7789-4b17-9b6c-bece0f981772"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:37:57.770588 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.770566    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de291d7d-0b78-467f-8ac2-db1577ff2053-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de291d7d-0b78-467f-8ac2-db1577ff2053" (UID: "de291d7d-0b78-467f-8ac2-db1577ff2053"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:37:57.770806 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.770718    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9e42506-7789-4b17-9b6c-bece0f981772-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:37:57.770806 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.770741    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/368dfd0b-6787-42d0-af9b-d9757ef09611-maas-api-tls\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:37:57.770806 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.770755    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de291d7d-0b78-467f-8ac2-db1577ff2053-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:37:57.770806 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.770771    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56tc6\" (UniqueName: \"kubernetes.io/projected/368dfd0b-6787-42d0-af9b-d9757ef09611-kube-api-access-56tc6\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:37:57.770806 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.770784    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/368dfd0b-6787-42d0-af9b-d9757ef09611-openshift-service-ca\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:37:57.772431 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.772404    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de291d7d-0b78-467f-8ac2-db1577ff2053-kube-api-access-jbbhp" (OuterVolumeSpecName: "kube-api-access-jbbhp") pod "de291d7d-0b78-467f-8ac2-db1577ff2053" (UID: "de291d7d-0b78-467f-8ac2-db1577ff2053"). InnerVolumeSpecName "kube-api-access-jbbhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:37:57.772531 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.772476    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9e42506-7789-4b17-9b6c-bece0f981772-kube-api-access-gndkt" (OuterVolumeSpecName: "kube-api-access-gndkt") pod "a9e42506-7789-4b17-9b6c-bece0f981772" (UID: "a9e42506-7789-4b17-9b6c-bece0f981772"). InnerVolumeSpecName "kube-api-access-gndkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:37:57.774521 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.774505    2559 scope.go:117] "RemoveContainer" containerID="565a102003a8339d2d4dfa44ba47f6d88ce5d7e94c4ef30bd62514e1b71d14a9"
Jul 26 16:37:57.774795 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:37:57.774772    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"565a102003a8339d2d4dfa44ba47f6d88ce5d7e94c4ef30bd62514e1b71d14a9\": container with ID starting with 565a102003a8339d2d4dfa44ba47f6d88ce5d7e94c4ef30bd62514e1b71d14a9 not found: ID does not exist" containerID="565a102003a8339d2d4dfa44ba47f6d88ce5d7e94c4ef30bd62514e1b71d14a9"
Jul 26 16:37:57.774883 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.774801    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"565a102003a8339d2d4dfa44ba47f6d88ce5d7e94c4ef30bd62514e1b71d14a9"} err="failed to get container status \"565a102003a8339d2d4dfa44ba47f6d88ce5d7e94c4ef30bd62514e1b71d14a9\": rpc error: code = NotFound desc = could not find container \"565a102003a8339d2d4dfa44ba47f6d88ce5d7e94c4ef30bd62514e1b71d14a9\": container with ID starting with 565a102003a8339d2d4dfa44ba47f6d88ce5d7e94c4ef30bd62514e1b71d14a9 not found: ID does not exist"
Jul 26 16:37:57.774883 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.774818    2559 scope.go:117] "RemoveContainer" containerID="36067aafb67ee7e8f251bd4880595d11b11361904a3b5e4eebf29343aa2f7f4b"
Jul 26 16:37:57.784118 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.784102    2559 scope.go:117] "RemoveContainer" containerID="36067aafb67ee7e8f251bd4880595d11b11361904a3b5e4eebf29343aa2f7f4b"
Jul 26 16:37:57.784407 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:37:57.784391    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36067aafb67ee7e8f251bd4880595d11b11361904a3b5e4eebf29343aa2f7f4b\": container with ID starting with 36067aafb67ee7e8f251bd4880595d11b11361904a3b5e4eebf29343aa2f7f4b not found: ID does not exist" containerID="36067aafb67ee7e8f251bd4880595d11b11361904a3b5e4eebf29343aa2f7f4b"
Jul 26 16:37:57.784459 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.784416    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36067aafb67ee7e8f251bd4880595d11b11361904a3b5e4eebf29343aa2f7f4b"} err="failed to get container status \"36067aafb67ee7e8f251bd4880595d11b11361904a3b5e4eebf29343aa2f7f4b\": rpc error: code = NotFound desc = could not find container \"36067aafb67ee7e8f251bd4880595d11b11361904a3b5e4eebf29343aa2f7f4b\": container with ID starting with 36067aafb67ee7e8f251bd4880595d11b11361904a3b5e4eebf29343aa2f7f4b not found: ID does not exist"
Jul 26 16:37:57.784459 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.784433    2559 scope.go:117] "RemoveContainer" containerID="66238864afba692b7b8acbdee39170949cfd1ae71cb0d116b72178b52514ee7b"
Jul 26 16:37:57.791909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.791890    2559 scope.go:117] "RemoveContainer" containerID="66238864afba692b7b8acbdee39170949cfd1ae71cb0d116b72178b52514ee7b"
Jul 26 16:37:57.792168 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:37:57.792146    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66238864afba692b7b8acbdee39170949cfd1ae71cb0d116b72178b52514ee7b\": container with ID starting with 66238864afba692b7b8acbdee39170949cfd1ae71cb0d116b72178b52514ee7b not found: ID does not exist" containerID="66238864afba692b7b8acbdee39170949cfd1ae71cb0d116b72178b52514ee7b"
Jul 26 16:37:57.792245 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.792177    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66238864afba692b7b8acbdee39170949cfd1ae71cb0d116b72178b52514ee7b"} err="failed to get container status \"66238864afba692b7b8acbdee39170949cfd1ae71cb0d116b72178b52514ee7b\": rpc error: code = NotFound desc = could not find container \"66238864afba692b7b8acbdee39170949cfd1ae71cb0d116b72178b52514ee7b\": container with ID starting with 66238864afba692b7b8acbdee39170949cfd1ae71cb0d116b72178b52514ee7b not found: ID does not exist"
Jul 26 16:37:57.814970 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.814947    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"]
Jul 26 16:37:57.818664 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.818644    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f8fd10f-c88757f8b-67l7l"]
Jul 26 16:37:57.871500 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.871432    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbbhp\" (UniqueName: \"kubernetes.io/projected/de291d7d-0b78-467f-8ac2-db1577ff2053-kube-api-access-jbbhp\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:37:57.871500 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:57.871457    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gndkt\" (UniqueName: \"kubernetes.io/projected/a9e42506-7789-4b17-9b6c-bece0f981772-kube-api-access-gndkt\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:37:58.087751 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:58.087725    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"]
Jul 26 16:37:58.091263 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:58.091241    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9f8fd10f-64775d96b4-g9bgz"]
Jul 26 16:37:58.101241 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:58.101220    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"]
Jul 26 16:37:58.105552 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:58.105532    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9f8fd10f-54d95cdd56-jkdxz"]
Jul 26 16:37:58.960780 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:58.960745    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="368dfd0b-6787-42d0-af9b-d9757ef09611" path="/var/lib/kubelet/pods/368dfd0b-6787-42d0-af9b-d9757ef09611/volumes"
Jul 26 16:37:58.961167 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:58.961084    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9e42506-7789-4b17-9b6c-bece0f981772" path="/var/lib/kubelet/pods/a9e42506-7789-4b17-9b6c-bece0f981772/volumes"
Jul 26 16:37:58.961476 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:37:58.961460    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de291d7d-0b78-467f-8ac2-db1577ff2053" path="/var/lib/kubelet/pods/de291d7d-0b78-467f-8ac2-db1577ff2053/volumes"
Jul 26 16:38:01.971299 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:01.971261    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:03.118413 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:03.118385    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:03.333040 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:03.333005    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:03.556224 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:03.556180    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:03.900214 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:03.900135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:04.209022 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:04.208984    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:05.068566 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:05.068531    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:38:05.068848 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:05.068596    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:38:06.297859 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:06.297826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:06.395408 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:06.395375    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:06.556312 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:06.556242    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:06.749163 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:06.749113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:07.024245 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.024217    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:07.124170 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.124118    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:07.133727 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.133697    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"]
Jul 26 16:38:07.134150 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.134134    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="368dfd0b-6787-42d0-af9b-d9757ef09611" containerName="maas-api"
Jul 26 16:38:07.134197 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.134153    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="368dfd0b-6787-42d0-af9b-d9757ef09611" containerName="maas-api"
Jul 26 16:38:07.134197 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.134169    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de291d7d-0b78-467f-8ac2-db1577ff2053" containerName="payload-pre-processing"
Jul 26 16:38:07.134197 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.134174    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="de291d7d-0b78-467f-8ac2-db1577ff2053" containerName="payload-pre-processing"
Jul 26 16:38:07.134197 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.134196    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9e42506-7789-4b17-9b6c-bece0f981772" containerName="payload-processing"
Jul 26 16:38:07.134326 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.134202    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9e42506-7789-4b17-9b6c-bece0f981772" containerName="payload-processing"
Jul 26 16:38:07.134326 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.134267    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="368dfd0b-6787-42d0-af9b-d9757ef09611" containerName="maas-api"
Jul 26 16:38:07.134326 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.134278    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="de291d7d-0b78-467f-8ac2-db1577ff2053" containerName="payload-pre-processing"
Jul 26 16:38:07.134326 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.134290    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9e42506-7789-4b17-9b6c-bece0f981772" containerName="payload-processing"
Jul 26 16:38:07.137357 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.137342    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"
Jul 26 16:38:07.139955 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.139930    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-2774653d-dockercfg-mp4w8\""
Jul 26 16:38:07.140074 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.139977    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-2774653d\""
Jul 26 16:38:07.148140 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.148102    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"]
Jul 26 16:38:07.169363 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.169336    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"]
Jul 26 16:38:07.172616 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.172601    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"
Jul 26 16:38:07.185390 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.185364    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"]
Jul 26 16:38:07.254652 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.254620    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdrhk\" (UniqueName: \"kubernetes.io/projected/a6ce6a8d-57a0-48ca-825f-7940265e9359-kube-api-access-vdrhk\") pod \"payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd\" (UID: \"a6ce6a8d-57a0-48ca-825f-7940265e9359\") " pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"
Jul 26 16:38:07.254808 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.254671    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4970bfb9-55b8-4e08-a180-4bfca4834f21-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj\" (UID: \"4970bfb9-55b8-4e08-a180-4bfca4834f21\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"
Jul 26 16:38:07.254808 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.254759    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll5w4\" (UniqueName: \"kubernetes.io/projected/4970bfb9-55b8-4e08-a180-4bfca4834f21-kube-api-access-ll5w4\") pod \"payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj\" (UID: \"4970bfb9-55b8-4e08-a180-4bfca4834f21\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"
Jul 26 16:38:07.254930 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.254808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6ce6a8d-57a0-48ca-825f-7940265e9359-plugins-config-volume\") pod \"payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd\" (UID: \"a6ce6a8d-57a0-48ca-825f-7940265e9359\") " pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"
Jul 26 16:38:07.356088 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.356015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4970bfb9-55b8-4e08-a180-4bfca4834f21-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj\" (UID: \"4970bfb9-55b8-4e08-a180-4bfca4834f21\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"
Jul 26 16:38:07.356088 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.356058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll5w4\" (UniqueName: \"kubernetes.io/projected/4970bfb9-55b8-4e08-a180-4bfca4834f21-kube-api-access-ll5w4\") pod \"payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj\" (UID: \"4970bfb9-55b8-4e08-a180-4bfca4834f21\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"
Jul 26 16:38:07.356088 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.356089    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6ce6a8d-57a0-48ca-825f-7940265e9359-plugins-config-volume\") pod \"payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd\" (UID: \"a6ce6a8d-57a0-48ca-825f-7940265e9359\") " pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"
Jul 26 16:38:07.356650 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.356144    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdrhk\" (UniqueName: \"kubernetes.io/projected/a6ce6a8d-57a0-48ca-825f-7940265e9359-kube-api-access-vdrhk\") pod \"payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd\" (UID: \"a6ce6a8d-57a0-48ca-825f-7940265e9359\") " pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"
Jul 26 16:38:07.356786 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.356764    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4970bfb9-55b8-4e08-a180-4bfca4834f21-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj\" (UID: \"4970bfb9-55b8-4e08-a180-4bfca4834f21\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"
Jul 26 16:38:07.356960 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.356937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6ce6a8d-57a0-48ca-825f-7940265e9359-plugins-config-volume\") pod \"payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd\" (UID: \"a6ce6a8d-57a0-48ca-825f-7940265e9359\") " pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"
Jul 26 16:38:07.364337 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.364312    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll5w4\" (UniqueName: \"kubernetes.io/projected/4970bfb9-55b8-4e08-a180-4bfca4834f21-kube-api-access-ll5w4\") pod \"payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj\" (UID: \"4970bfb9-55b8-4e08-a180-4bfca4834f21\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"
Jul 26 16:38:07.364720 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.364700    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdrhk\" (UniqueName: \"kubernetes.io/projected/a6ce6a8d-57a0-48ca-825f-7940265e9359-kube-api-access-vdrhk\") pod \"payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd\" (UID: \"a6ce6a8d-57a0-48ca-825f-7940265e9359\") " pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"
Jul 26 16:38:07.448690 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.448659    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"
Jul 26 16:38:07.482028 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.482005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"
Jul 26 16:38:07.600091 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.600061    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"]
Jul 26 16:38:07.601819 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:38:07.601782    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4970bfb9_55b8_4e08_a180_4bfca4834f21.slice/crio-1916fc3ae7e5260c174e78c618261fcc6728f28aee17b65cf055c0f3172e8f84 WatchSource:0}: Error finding container 1916fc3ae7e5260c174e78c618261fcc6728f28aee17b65cf055c0f3172e8f84: Status 404 returned error can't find the container with id 1916fc3ae7e5260c174e78c618261fcc6728f28aee17b65cf055c0f3172e8f84
Jul 26 16:38:07.640115 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.640094    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"]
Jul 26 16:38:07.643294 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:38:07.643268    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ce6a8d_57a0_48ca_825f_7940265e9359.slice/crio-0ce1cd581fc0a9581540c138c5c8d58fa40fc495f95d9db2fb7eab3ae5a90fdb WatchSource:0}: Error finding container 0ce1cd581fc0a9581540c138c5c8d58fa40fc495f95d9db2fb7eab3ae5a90fdb: Status 404 returned error can't find the container with id 0ce1cd581fc0a9581540c138c5c8d58fa40fc495f95d9db2fb7eab3ae5a90fdb
Jul 26 16:38:07.823016 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.822976    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd" event={"ID":"a6ce6a8d-57a0-48ca-825f-7940265e9359","Type":"ContainerStarted","Data":"dcce022ed12b767da92667b20c241ed3a9d72a0ce3634e140e5c3e7e80bd6364"}
Jul 26 16:38:07.823213 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.823162    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"
Jul 26 16:38:07.823213 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.823208    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd" event={"ID":"a6ce6a8d-57a0-48ca-825f-7940265e9359","Type":"ContainerStarted","Data":"0ce1cd581fc0a9581540c138c5c8d58fa40fc495f95d9db2fb7eab3ae5a90fdb"}
Jul 26 16:38:07.824442 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.824418    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj" event={"ID":"4970bfb9-55b8-4e08-a180-4bfca4834f21","Type":"ContainerStarted","Data":"d3e466bdbf52a84a32c9512b1a6eaf88d4fa1d27bb7a1f08b16ed37fe201d41b"}
Jul 26 16:38:07.824552 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.824460    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"
Jul 26 16:38:07.824552 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.824475    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj" event={"ID":"4970bfb9-55b8-4e08-a180-4bfca4834f21","Type":"ContainerStarted","Data":"1916fc3ae7e5260c174e78c618261fcc6728f28aee17b65cf055c0f3172e8f84"}
Jul 26 16:38:07.838986 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.838944    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd" podStartSLOduration=0.838933341 podStartE2EDuration="838.933341ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:38:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:38:07.837792808 +0000 UTC m=+1803.372492083" watchObservedRunningTime="2026-07-26 16:38:07.838933341 +0000 UTC m=+1803.373632615"
Jul 26 16:38:07.851970 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:07.851924    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj" podStartSLOduration=0.851908364 podStartE2EDuration="851.908364ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:38:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:38:07.851712646 +0000 UTC m=+1803.386411921" watchObservedRunningTime="2026-07-26 16:38:07.851908364 +0000 UTC m=+1803.386607642"
Jul 26 16:38:18.832335 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:18.832301    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"
Jul 26 16:38:18.832773 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:18.832451    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"
Jul 26 16:38:31.157850 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:31.157817    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq"]
Jul 26 16:38:31.161578 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:31.161562    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq"
Jul 26 16:38:31.164114 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:31.164092    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2xlcn\""
Jul 26 16:38:31.168426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:31.168403    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq"]
Jul 26 16:38:31.269462 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:31.269429    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6abdafca-55ce-4ba0-a0db-026e36449b46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2774653d-2kljq\" (UID: \"6abdafca-55ce-4ba0-a0db-026e36449b46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq"
Jul 26 16:38:31.370425 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:31.370396    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6abdafca-55ce-4ba0-a0db-026e36449b46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2774653d-2kljq\" (UID: \"6abdafca-55ce-4ba0-a0db-026e36449b46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq"
Jul 26 16:38:31.370972 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:31.370951    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6abdafca-55ce-4ba0-a0db-026e36449b46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2774653d-2kljq\" (UID: \"6abdafca-55ce-4ba0-a0db-026e36449b46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq"
Jul 26 16:38:31.472631 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:31.472602    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq"
Jul 26 16:38:31.607584 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:31.607555    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq"]
Jul 26 16:38:31.608339 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:38:31.608310    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6abdafca_55ce_4ba0_a0db_026e36449b46.slice/crio-ad3b6330b53f0c148d45d28ba02957ccf2d727dc6c3f283a33f89dbc8fe090c5 WatchSource:0}: Error finding container ad3b6330b53f0c148d45d28ba02957ccf2d727dc6c3f283a33f89dbc8fe090c5: Status 404 returned error can't find the container with id ad3b6330b53f0c148d45d28ba02957ccf2d727dc6c3f283a33f89dbc8fe090c5
Jul 26 16:38:31.951028 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:31.950993    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq" event={"ID":"6abdafca-55ce-4ba0-a0db-026e36449b46","Type":"ContainerStarted","Data":"ad3b6330b53f0c148d45d28ba02957ccf2d727dc6c3f283a33f89dbc8fe090c5"}
Jul 26 16:38:32.958015 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:32.957981    2559 generic.go:356] "Generic (PLEG): container finished" podID="6abdafca-55ce-4ba0-a0db-026e36449b46" containerID="7474577a03e8471557dea3a4cfcc83a59c5f49a1ec158fb1140e2b3e6634a9d8" exitCode=0
Jul 26 16:38:32.958482 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:32.958065    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq" event={"ID":"6abdafca-55ce-4ba0-a0db-026e36449b46","Type":"ContainerDied","Data":"7474577a03e8471557dea3a4cfcc83a59c5f49a1ec158fb1140e2b3e6634a9d8"}
Jul 26 16:38:34.098137 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:34.098108    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq"
Jul 26 16:38:34.196570 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:34.196538    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6abdafca-55ce-4ba0-a0db-026e36449b46-maas-api-service-ca\") pod \"6abdafca-55ce-4ba0-a0db-026e36449b46\" (UID: \"6abdafca-55ce-4ba0-a0db-026e36449b46\") "
Jul 26 16:38:34.196862 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:34.196839    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6abdafca-55ce-4ba0-a0db-026e36449b46-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6abdafca-55ce-4ba0-a0db-026e36449b46" (UID: "6abdafca-55ce-4ba0-a0db-026e36449b46"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:38:34.297588 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:34.297531    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6abdafca-55ce-4ba0-a0db-026e36449b46-maas-api-service-ca\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:38:34.969120 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:34.969076    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq" event={"ID":"6abdafca-55ce-4ba0-a0db-026e36449b46","Type":"ContainerDied","Data":"ad3b6330b53f0c148d45d28ba02957ccf2d727dc6c3f283a33f89dbc8fe090c5"}
Jul 26 16:38:34.969120 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:34.969103    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq"
Jul 26 16:38:34.969309 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:34.969164    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad3b6330b53f0c148d45d28ba02957ccf2d727dc6c3f283a33f89dbc8fe090c5"
Jul 26 16:38:42.127991 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.127958    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:42.149607 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.149569    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"]
Jul 26 16:38:42.149876 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.149846    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd" podUID="a6ce6a8d-57a0-48ca-825f-7940265e9359" containerName="payload-processing" containerID="cri-o://dcce022ed12b767da92667b20c241ed3a9d72a0ce3634e140e5c3e7e80bd6364" gracePeriod=30
Jul 26 16:38:42.153225 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.153189    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"]
Jul 26 16:38:42.153557 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.153527    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj" podUID="4970bfb9-55b8-4e08-a180-4bfca4834f21" containerName="payload-pre-processing" containerID="cri-o://d3e466bdbf52a84a32c9512b1a6eaf88d4fa1d27bb7a1f08b16ed37fe201d41b" gracePeriod=30
Jul 26 16:38:42.228187 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.228157    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:42.290175 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.290146    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:42.434500 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.434473    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"
Jul 26 16:38:42.437185 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.437165    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"
Jul 26 16:38:42.465195 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.465172    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6ce6a8d-57a0-48ca-825f-7940265e9359-plugins-config-volume\") pod \"a6ce6a8d-57a0-48ca-825f-7940265e9359\" (UID: \"a6ce6a8d-57a0-48ca-825f-7940265e9359\") "
Jul 26 16:38:42.465303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.465207    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4970bfb9-55b8-4e08-a180-4bfca4834f21-plugins-config-volume\") pod \"4970bfb9-55b8-4e08-a180-4bfca4834f21\" (UID: \"4970bfb9-55b8-4e08-a180-4bfca4834f21\") "
Jul 26 16:38:42.465303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.465284    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdrhk\" (UniqueName: \"kubernetes.io/projected/a6ce6a8d-57a0-48ca-825f-7940265e9359-kube-api-access-vdrhk\") pod \"a6ce6a8d-57a0-48ca-825f-7940265e9359\" (UID: \"a6ce6a8d-57a0-48ca-825f-7940265e9359\") "
Jul 26 16:38:42.465398 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.465325    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll5w4\" (UniqueName: \"kubernetes.io/projected/4970bfb9-55b8-4e08-a180-4bfca4834f21-kube-api-access-ll5w4\") pod \"4970bfb9-55b8-4e08-a180-4bfca4834f21\" (UID: \"4970bfb9-55b8-4e08-a180-4bfca4834f21\") "
Jul 26 16:38:42.465604 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.465573    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6ce6a8d-57a0-48ca-825f-7940265e9359-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6ce6a8d-57a0-48ca-825f-7940265e9359" (UID: "a6ce6a8d-57a0-48ca-825f-7940265e9359"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:38:42.465604 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.465595    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4970bfb9-55b8-4e08-a180-4bfca4834f21-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4970bfb9-55b8-4e08-a180-4bfca4834f21" (UID: "4970bfb9-55b8-4e08-a180-4bfca4834f21"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:38:42.467363 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.467333    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4970bfb9-55b8-4e08-a180-4bfca4834f21-kube-api-access-ll5w4" (OuterVolumeSpecName: "kube-api-access-ll5w4") pod "4970bfb9-55b8-4e08-a180-4bfca4834f21" (UID: "4970bfb9-55b8-4e08-a180-4bfca4834f21"). InnerVolumeSpecName "kube-api-access-ll5w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:38:42.467470 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.467444    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6ce6a8d-57a0-48ca-825f-7940265e9359-kube-api-access-vdrhk" (OuterVolumeSpecName: "kube-api-access-vdrhk") pod "a6ce6a8d-57a0-48ca-825f-7940265e9359" (UID: "a6ce6a8d-57a0-48ca-825f-7940265e9359"). InnerVolumeSpecName "kube-api-access-vdrhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:38:42.566073 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.566048    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdrhk\" (UniqueName: \"kubernetes.io/projected/a6ce6a8d-57a0-48ca-825f-7940265e9359-kube-api-access-vdrhk\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:38:42.566073 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.566072    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll5w4\" (UniqueName: \"kubernetes.io/projected/4970bfb9-55b8-4e08-a180-4bfca4834f21-kube-api-access-ll5w4\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:38:42.566234 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.566081    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6ce6a8d-57a0-48ca-825f-7940265e9359-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:38:42.566234 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:42.566091    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4970bfb9-55b8-4e08-a180-4bfca4834f21-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:38:43.011264 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.011232    2559 generic.go:356] "Generic (PLEG): container finished" podID="4970bfb9-55b8-4e08-a180-4bfca4834f21" containerID="d3e466bdbf52a84a32c9512b1a6eaf88d4fa1d27bb7a1f08b16ed37fe201d41b" exitCode=0
Jul 26 16:38:43.011415 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.011264    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"
Jul 26 16:38:43.011415 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.011308    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj" event={"ID":"4970bfb9-55b8-4e08-a180-4bfca4834f21","Type":"ContainerDied","Data":"d3e466bdbf52a84a32c9512b1a6eaf88d4fa1d27bb7a1f08b16ed37fe201d41b"}
Jul 26 16:38:43.011415 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.011365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj" event={"ID":"4970bfb9-55b8-4e08-a180-4bfca4834f21","Type":"ContainerDied","Data":"1916fc3ae7e5260c174e78c618261fcc6728f28aee17b65cf055c0f3172e8f84"}
Jul 26 16:38:43.011415 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.011396    2559 scope.go:117] "RemoveContainer" containerID="d3e466bdbf52a84a32c9512b1a6eaf88d4fa1d27bb7a1f08b16ed37fe201d41b"
Jul 26 16:38:43.012730 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.012704    2559 generic.go:356] "Generic (PLEG): container finished" podID="a6ce6a8d-57a0-48ca-825f-7940265e9359" containerID="dcce022ed12b767da92667b20c241ed3a9d72a0ce3634e140e5c3e7e80bd6364" exitCode=0
Jul 26 16:38:43.012842 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.012747    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"
Jul 26 16:38:43.012842 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.012783    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd" event={"ID":"a6ce6a8d-57a0-48ca-825f-7940265e9359","Type":"ContainerDied","Data":"dcce022ed12b767da92667b20c241ed3a9d72a0ce3634e140e5c3e7e80bd6364"}
Jul 26 16:38:43.012842 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.012819    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd" event={"ID":"a6ce6a8d-57a0-48ca-825f-7940265e9359","Type":"ContainerDied","Data":"0ce1cd581fc0a9581540c138c5c8d58fa40fc495f95d9db2fb7eab3ae5a90fdb"}
Jul 26 16:38:43.020244 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.020220    2559 scope.go:117] "RemoveContainer" containerID="d3e466bdbf52a84a32c9512b1a6eaf88d4fa1d27bb7a1f08b16ed37fe201d41b"
Jul 26 16:38:43.020495 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:38:43.020478    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3e466bdbf52a84a32c9512b1a6eaf88d4fa1d27bb7a1f08b16ed37fe201d41b\": container with ID starting with d3e466bdbf52a84a32c9512b1a6eaf88d4fa1d27bb7a1f08b16ed37fe201d41b not found: ID does not exist" containerID="d3e466bdbf52a84a32c9512b1a6eaf88d4fa1d27bb7a1f08b16ed37fe201d41b"
Jul 26 16:38:43.020544 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.020502    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e466bdbf52a84a32c9512b1a6eaf88d4fa1d27bb7a1f08b16ed37fe201d41b"} err="failed to get container status \"d3e466bdbf52a84a32c9512b1a6eaf88d4fa1d27bb7a1f08b16ed37fe201d41b\": rpc error: code = NotFound desc = could not find container \"d3e466bdbf52a84a32c9512b1a6eaf88d4fa1d27bb7a1f08b16ed37fe201d41b\": container with ID starting with d3e466bdbf52a84a32c9512b1a6eaf88d4fa1d27bb7a1f08b16ed37fe201d41b not found: ID does not exist"
Jul 26 16:38:43.020544 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.020519    2559 scope.go:117] "RemoveContainer" containerID="dcce022ed12b767da92667b20c241ed3a9d72a0ce3634e140e5c3e7e80bd6364"
Jul 26 16:38:43.028134 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.028104    2559 scope.go:117] "RemoveContainer" containerID="dcce022ed12b767da92667b20c241ed3a9d72a0ce3634e140e5c3e7e80bd6364"
Jul 26 16:38:43.028417 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:38:43.028389    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcce022ed12b767da92667b20c241ed3a9d72a0ce3634e140e5c3e7e80bd6364\": container with ID starting with dcce022ed12b767da92667b20c241ed3a9d72a0ce3634e140e5c3e7e80bd6364 not found: ID does not exist" containerID="dcce022ed12b767da92667b20c241ed3a9d72a0ce3634e140e5c3e7e80bd6364"
Jul 26 16:38:43.028490 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.028414    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcce022ed12b767da92667b20c241ed3a9d72a0ce3634e140e5c3e7e80bd6364"} err="failed to get container status \"dcce022ed12b767da92667b20c241ed3a9d72a0ce3634e140e5c3e7e80bd6364\": rpc error: code = NotFound desc = could not find container \"dcce022ed12b767da92667b20c241ed3a9d72a0ce3634e140e5c3e7e80bd6364\": container with ID starting with dcce022ed12b767da92667b20c241ed3a9d72a0ce3634e140e5c3e7e80bd6364 not found: ID does not exist"
Jul 26 16:38:43.030056 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.030037    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"]
Jul 26 16:38:43.034981 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.034961    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2774653d-5f6bdc48b4-966bj"]
Jul 26 16:38:43.053029 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.053010    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"]
Jul 26 16:38:43.056287 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:43.056257    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2774653d-96fc46f8-rm2cd"]
Jul 26 16:38:44.955118 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:44.955088    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4970bfb9-55b8-4e08-a180-4bfca4834f21" path="/var/lib/kubelet/pods/4970bfb9-55b8-4e08-a180-4bfca4834f21/volumes"
Jul 26 16:38:44.955508 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:44.955471    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6ce6a8d-57a0-48ca-825f-7940265e9359" path="/var/lib/kubelet/pods/a6ce6a8d-57a0-48ca-825f-7940265e9359/volumes"
Jul 26 16:38:46.259420 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:46.259387    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq"]
Jul 26 16:38:46.261207 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:46.261179    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:46.263629 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:46.263602    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2774653d-2kljq"]
Jul 26 16:38:46.425806 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:46.425771    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:46.654722 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:46.654635    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:46.955160 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:46.955112    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6abdafca-55ce-4ba0-a0db-026e36449b46" path="/var/lib/kubelet/pods/6abdafca-55ce-4ba0-a0db-026e36449b46/volumes"
Jul 26 16:38:47.134239 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:47.134206    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:47.227877 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:47.227794    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:47.327883 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:47.327853    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:48.697546 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:48.697514    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:54.570655 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:54.570622    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:54.677813 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:54.677783    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:54.772545 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:54.772511    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:54.870732 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:54.870645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:38:55.303822 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:38:55.303789    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:39:21.251313 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:39:21.251277    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:39:27.630118 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:39:27.630039    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:39:27.735719 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:39:27.735685    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:39:27.832088 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:39:27.832055    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:39:43.703814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:39:43.703777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:39:49.863047 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:39:49.863016    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:39:49.980178 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:39:49.980099    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:39:50.074239 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:39:50.074204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:00.600266 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:00.600230    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:01.409626 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:01.409586    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:07.856921 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:07.856884    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:07.963976 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:07.963943    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:08.059501 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:08.059471    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:08.161660 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:08.161581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:08.909113 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:08.909075    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:09.003755 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:09.003723    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:09.104060 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:09.104032    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:10.716002 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:10.715970    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:16.606077 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:16.606032    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:16.783851 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:16.783819    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:17.230817 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:17.230786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:24.419182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:24.419151    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:24.520138 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:24.520091    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:24.682357 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:24.682329    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:25.001358 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:25.001282    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:25.629775 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:25.629742    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:27.672191 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:27.672155    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:27.753303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:27.753268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:27.821837 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:27.821803    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:28.090018 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.089983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:28.253708 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.253681    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:28.355218 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.355115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:28.363213 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.363186    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"]
Jul 26 16:40:28.363633 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.363616    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4970bfb9-55b8-4e08-a180-4bfca4834f21" containerName="payload-pre-processing"
Jul 26 16:40:28.363677 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.363636    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4970bfb9-55b8-4e08-a180-4bfca4834f21" containerName="payload-pre-processing"
Jul 26 16:40:28.363677 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.363645    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6ce6a8d-57a0-48ca-825f-7940265e9359" containerName="payload-processing"
Jul 26 16:40:28.363677 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.363651    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6ce6a8d-57a0-48ca-825f-7940265e9359" containerName="payload-processing"
Jul 26 16:40:28.363677 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.363667    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6abdafca-55ce-4ba0-a0db-026e36449b46" containerName="revoke-keys"
Jul 26 16:40:28.363677 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.363673    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6abdafca-55ce-4ba0-a0db-026e36449b46" containerName="revoke-keys"
Jul 26 16:40:28.363848 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.363737    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4970bfb9-55b8-4e08-a180-4bfca4834f21" containerName="payload-pre-processing"
Jul 26 16:40:28.363848 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.363746    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6ce6a8d-57a0-48ca-825f-7940265e9359" containerName="payload-processing"
Jul 26 16:40:28.363848 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.363754    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6abdafca-55ce-4ba0-a0db-026e36449b46" containerName="revoke-keys"
Jul 26 16:40:28.366957 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.366941    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"
Jul 26 16:40:28.369485 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.369466    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-d2caf295-dockercfg-kgtft\""
Jul 26 16:40:28.369609 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.369474    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-d2caf295\""
Jul 26 16:40:28.389870 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.389847    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"]
Jul 26 16:40:28.397930 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.397911    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"]
Jul 26 16:40:28.401381 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.401365    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"
Jul 26 16:40:28.412742 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.412722    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"]
Jul 26 16:40:28.473065 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.473035    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gssjk\" (UniqueName: \"kubernetes.io/projected/3f0f2be9-4a16-453e-b876-091fec909c1f-kube-api-access-gssjk\") pod \"payload-processing-e2e-mt-d2caf295-778967ffdb-n454k\" (UID: \"3f0f2be9-4a16-453e-b876-091fec909c1f\") " pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"
Jul 26 16:40:28.473306 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.473070    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f0f2be9-4a16-453e-b876-091fec909c1f-plugins-config-volume\") pod \"payload-processing-e2e-mt-d2caf295-778967ffdb-n454k\" (UID: \"3f0f2be9-4a16-453e-b876-091fec909c1f\") " pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"
Jul 26 16:40:28.473306 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.473164    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d4s4\" (UniqueName: \"kubernetes.io/projected/348b927d-4da3-4ce1-8905-ef0542e40bd3-kube-api-access-7d4s4\") pod \"payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb\" (UID: \"348b927d-4da3-4ce1-8905-ef0542e40bd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"
Jul 26 16:40:28.473306 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.473189    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/348b927d-4da3-4ce1-8905-ef0542e40bd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb\" (UID: \"348b927d-4da3-4ce1-8905-ef0542e40bd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"
Jul 26 16:40:28.574075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.574046    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d4s4\" (UniqueName: \"kubernetes.io/projected/348b927d-4da3-4ce1-8905-ef0542e40bd3-kube-api-access-7d4s4\") pod \"payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb\" (UID: \"348b927d-4da3-4ce1-8905-ef0542e40bd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"
Jul 26 16:40:28.574229 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.574081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/348b927d-4da3-4ce1-8905-ef0542e40bd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb\" (UID: \"348b927d-4da3-4ce1-8905-ef0542e40bd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"
Jul 26 16:40:28.574229 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.574175    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gssjk\" (UniqueName: \"kubernetes.io/projected/3f0f2be9-4a16-453e-b876-091fec909c1f-kube-api-access-gssjk\") pod \"payload-processing-e2e-mt-d2caf295-778967ffdb-n454k\" (UID: \"3f0f2be9-4a16-453e-b876-091fec909c1f\") " pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"
Jul 26 16:40:28.574229 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.574200    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f0f2be9-4a16-453e-b876-091fec909c1f-plugins-config-volume\") pod \"payload-processing-e2e-mt-d2caf295-778967ffdb-n454k\" (UID: \"3f0f2be9-4a16-453e-b876-091fec909c1f\") " pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"
Jul 26 16:40:28.574849 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.574828    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/348b927d-4da3-4ce1-8905-ef0542e40bd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb\" (UID: \"348b927d-4da3-4ce1-8905-ef0542e40bd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"
Jul 26 16:40:28.574887 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.574853    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f0f2be9-4a16-453e-b876-091fec909c1f-plugins-config-volume\") pod \"payload-processing-e2e-mt-d2caf295-778967ffdb-n454k\" (UID: \"3f0f2be9-4a16-453e-b876-091fec909c1f\") " pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"
Jul 26 16:40:28.582176 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.582149    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d4s4\" (UniqueName: \"kubernetes.io/projected/348b927d-4da3-4ce1-8905-ef0542e40bd3-kube-api-access-7d4s4\") pod \"payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb\" (UID: \"348b927d-4da3-4ce1-8905-ef0542e40bd3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"
Jul 26 16:40:28.582687 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.582671    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gssjk\" (UniqueName: \"kubernetes.io/projected/3f0f2be9-4a16-453e-b876-091fec909c1f-kube-api-access-gssjk\") pod \"payload-processing-e2e-mt-d2caf295-778967ffdb-n454k\" (UID: \"3f0f2be9-4a16-453e-b876-091fec909c1f\") " pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"
Jul 26 16:40:28.676851 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.676791    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"
Jul 26 16:40:28.711274 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.711252    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"
Jul 26 16:40:28.829489 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:28.829460    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"]
Jul 26 16:40:28.835392 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:40:28.835360    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod348b927d_4da3_4ce1_8905_ef0542e40bd3.slice/crio-09669f5e165145bee7b4aed0d8b50b78e0e2baa7cbda0a3fe7bc4d88ce15a4ab WatchSource:0}: Error finding container 09669f5e165145bee7b4aed0d8b50b78e0e2baa7cbda0a3fe7bc4d88ce15a4ab: Status 404 returned error can't find the container with id 09669f5e165145bee7b4aed0d8b50b78e0e2baa7cbda0a3fe7bc4d88ce15a4ab
Jul 26 16:40:29.074667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:29.074642    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"]
Jul 26 16:40:29.075554 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:40:29.075535    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0f2be9_4a16_453e_b876_091fec909c1f.slice/crio-a5b91620a6b5405819772f64cff50e5fcf452a99f0d7492809d623ef004a2eda WatchSource:0}: Error finding container a5b91620a6b5405819772f64cff50e5fcf452a99f0d7492809d623ef004a2eda: Status 404 returned error can't find the container with id a5b91620a6b5405819772f64cff50e5fcf452a99f0d7492809d623ef004a2eda
Jul 26 16:40:29.564952 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:29.564913    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k" event={"ID":"3f0f2be9-4a16-453e-b876-091fec909c1f","Type":"ContainerStarted","Data":"96af19f25d47c5ffe5a88d50c683b7ee44337c35b0837ddea79072ad1afbad44"}
Jul 26 16:40:29.565166 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:29.565067    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"
Jul 26 16:40:29.565166 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:29.565114    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k" event={"ID":"3f0f2be9-4a16-453e-b876-091fec909c1f","Type":"ContainerStarted","Data":"a5b91620a6b5405819772f64cff50e5fcf452a99f0d7492809d623ef004a2eda"}
Jul 26 16:40:29.566460 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:29.566429    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb" event={"ID":"348b927d-4da3-4ce1-8905-ef0542e40bd3","Type":"ContainerStarted","Data":"90e370d7361c3d04fdcea2b87639781144786dbff565137710ab79c8dfa19b59"}
Jul 26 16:40:29.566606 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:29.566474    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb" event={"ID":"348b927d-4da3-4ce1-8905-ef0542e40bd3","Type":"ContainerStarted","Data":"09669f5e165145bee7b4aed0d8b50b78e0e2baa7cbda0a3fe7bc4d88ce15a4ab"}
Jul 26 16:40:29.566606 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:29.566536    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"
Jul 26 16:40:29.584778 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:29.584734    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k" podStartSLOduration=1.584721745 podStartE2EDuration="1.584721745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:40:29.583020228 +0000 UTC m=+1945.117719519" watchObservedRunningTime="2026-07-26 16:40:29.584721745 +0000 UTC m=+1945.119421020"
Jul 26 16:40:29.599797 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:29.599756    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb" podStartSLOduration=1.599741785 podStartE2EDuration="1.599741785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:40:29.597684835 +0000 UTC m=+1945.132384109" watchObservedRunningTime="2026-07-26 16:40:29.599741785 +0000 UTC m=+1945.134441059"
Jul 26 16:40:32.178231 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:32.178197    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:32.848251 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:32.848211    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:32.955940 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:32.955911    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:33.279084 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:33.279050    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:39.251509 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:39.251466    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:40.337506 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:40.337474    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:40.573644 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:40.573618    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"
Jul 26 16:40:40.573999 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:40.573976    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"
Jul 26 16:40:50.111480 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.111440    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:50.148701 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.148672    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"]
Jul 26 16:40:50.148917 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.148892    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k" podUID="3f0f2be9-4a16-453e-b876-091fec909c1f" containerName="payload-processing" containerID="cri-o://96af19f25d47c5ffe5a88d50c683b7ee44337c35b0837ddea79072ad1afbad44" gracePeriod=30
Jul 26 16:40:50.154684 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.154614    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"]
Jul 26 16:40:50.155236 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.154928    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb" podUID="348b927d-4da3-4ce1-8905-ef0542e40bd3" containerName="payload-pre-processing" containerID="cri-o://90e370d7361c3d04fdcea2b87639781144786dbff565137710ab79c8dfa19b59" gracePeriod=30
Jul 26 16:40:50.189498 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.189468    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:50.287936 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.287904    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:50.426547 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.426524    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"
Jul 26 16:40:50.429497 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.429478    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"
Jul 26 16:40:50.562182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.562153    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f0f2be9-4a16-453e-b876-091fec909c1f-plugins-config-volume\") pod \"3f0f2be9-4a16-453e-b876-091fec909c1f\" (UID: \"3f0f2be9-4a16-453e-b876-091fec909c1f\") "
Jul 26 16:40:50.562182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.562190    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/348b927d-4da3-4ce1-8905-ef0542e40bd3-plugins-config-volume\") pod \"348b927d-4da3-4ce1-8905-ef0542e40bd3\" (UID: \"348b927d-4da3-4ce1-8905-ef0542e40bd3\") "
Jul 26 16:40:50.562453 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.562253    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gssjk\" (UniqueName: \"kubernetes.io/projected/3f0f2be9-4a16-453e-b876-091fec909c1f-kube-api-access-gssjk\") pod \"3f0f2be9-4a16-453e-b876-091fec909c1f\" (UID: \"3f0f2be9-4a16-453e-b876-091fec909c1f\") "
Jul 26 16:40:50.562453 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.562281    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d4s4\" (UniqueName: \"kubernetes.io/projected/348b927d-4da3-4ce1-8905-ef0542e40bd3-kube-api-access-7d4s4\") pod \"348b927d-4da3-4ce1-8905-ef0542e40bd3\" (UID: \"348b927d-4da3-4ce1-8905-ef0542e40bd3\") "
Jul 26 16:40:50.562603 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.562573    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f0f2be9-4a16-453e-b876-091fec909c1f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3f0f2be9-4a16-453e-b876-091fec909c1f" (UID: "3f0f2be9-4a16-453e-b876-091fec909c1f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:40:50.562664 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.562636    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/348b927d-4da3-4ce1-8905-ef0542e40bd3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "348b927d-4da3-4ce1-8905-ef0542e40bd3" (UID: "348b927d-4da3-4ce1-8905-ef0542e40bd3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:40:50.564394 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.564363    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/348b927d-4da3-4ce1-8905-ef0542e40bd3-kube-api-access-7d4s4" (OuterVolumeSpecName: "kube-api-access-7d4s4") pod "348b927d-4da3-4ce1-8905-ef0542e40bd3" (UID: "348b927d-4da3-4ce1-8905-ef0542e40bd3"). InnerVolumeSpecName "kube-api-access-7d4s4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:40:50.564394 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.564383    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0f2be9-4a16-453e-b876-091fec909c1f-kube-api-access-gssjk" (OuterVolumeSpecName: "kube-api-access-gssjk") pod "3f0f2be9-4a16-453e-b876-091fec909c1f" (UID: "3f0f2be9-4a16-453e-b876-091fec909c1f"). InnerVolumeSpecName "kube-api-access-gssjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:40:50.663757 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.663680    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gssjk\" (UniqueName: \"kubernetes.io/projected/3f0f2be9-4a16-453e-b876-091fec909c1f-kube-api-access-gssjk\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:40:50.663757 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.663706    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d4s4\" (UniqueName: \"kubernetes.io/projected/348b927d-4da3-4ce1-8905-ef0542e40bd3-kube-api-access-7d4s4\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:40:50.663757 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.663719    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f0f2be9-4a16-453e-b876-091fec909c1f-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:40:50.663757 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.663731    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/348b927d-4da3-4ce1-8905-ef0542e40bd3-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:40:50.677009 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.676980    2559 generic.go:356] "Generic (PLEG): container finished" podID="3f0f2be9-4a16-453e-b876-091fec909c1f" containerID="96af19f25d47c5ffe5a88d50c683b7ee44337c35b0837ddea79072ad1afbad44" exitCode=0
Jul 26 16:40:50.677110 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.677022    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"
Jul 26 16:40:50.677110 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.677074    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k" event={"ID":"3f0f2be9-4a16-453e-b876-091fec909c1f","Type":"ContainerDied","Data":"96af19f25d47c5ffe5a88d50c683b7ee44337c35b0837ddea79072ad1afbad44"}
Jul 26 16:40:50.677263 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.677176    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k" event={"ID":"3f0f2be9-4a16-453e-b876-091fec909c1f","Type":"ContainerDied","Data":"a5b91620a6b5405819772f64cff50e5fcf452a99f0d7492809d623ef004a2eda"}
Jul 26 16:40:50.677263 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.677204    2559 scope.go:117] "RemoveContainer" containerID="96af19f25d47c5ffe5a88d50c683b7ee44337c35b0837ddea79072ad1afbad44"
Jul 26 16:40:50.678329 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.678311    2559 generic.go:356] "Generic (PLEG): container finished" podID="348b927d-4da3-4ce1-8905-ef0542e40bd3" containerID="90e370d7361c3d04fdcea2b87639781144786dbff565137710ab79c8dfa19b59" exitCode=0
Jul 26 16:40:50.678388 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.678344    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb" event={"ID":"348b927d-4da3-4ce1-8905-ef0542e40bd3","Type":"ContainerDied","Data":"90e370d7361c3d04fdcea2b87639781144786dbff565137710ab79c8dfa19b59"}
Jul 26 16:40:50.678431 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.678390    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb" event={"ID":"348b927d-4da3-4ce1-8905-ef0542e40bd3","Type":"ContainerDied","Data":"09669f5e165145bee7b4aed0d8b50b78e0e2baa7cbda0a3fe7bc4d88ce15a4ab"}
Jul 26 16:40:50.678431 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.678355    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"
Jul 26 16:40:50.687448 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.687433    2559 scope.go:117] "RemoveContainer" containerID="96af19f25d47c5ffe5a88d50c683b7ee44337c35b0837ddea79072ad1afbad44"
Jul 26 16:40:50.687710 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:40:50.687690    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96af19f25d47c5ffe5a88d50c683b7ee44337c35b0837ddea79072ad1afbad44\": container with ID starting with 96af19f25d47c5ffe5a88d50c683b7ee44337c35b0837ddea79072ad1afbad44 not found: ID does not exist" containerID="96af19f25d47c5ffe5a88d50c683b7ee44337c35b0837ddea79072ad1afbad44"
Jul 26 16:40:50.687789 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.687720    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96af19f25d47c5ffe5a88d50c683b7ee44337c35b0837ddea79072ad1afbad44"} err="failed to get container status \"96af19f25d47c5ffe5a88d50c683b7ee44337c35b0837ddea79072ad1afbad44\": rpc error: code = NotFound desc = could not find container \"96af19f25d47c5ffe5a88d50c683b7ee44337c35b0837ddea79072ad1afbad44\": container with ID starting with 96af19f25d47c5ffe5a88d50c683b7ee44337c35b0837ddea79072ad1afbad44 not found: ID does not exist"
Jul 26 16:40:50.687789 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.687743    2559 scope.go:117] "RemoveContainer" containerID="90e370d7361c3d04fdcea2b87639781144786dbff565137710ab79c8dfa19b59"
Jul 26 16:40:50.695695 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.695679    2559 scope.go:117] "RemoveContainer" containerID="90e370d7361c3d04fdcea2b87639781144786dbff565137710ab79c8dfa19b59"
Jul 26 16:40:50.695924 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:40:50.695907    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90e370d7361c3d04fdcea2b87639781144786dbff565137710ab79c8dfa19b59\": container with ID starting with 90e370d7361c3d04fdcea2b87639781144786dbff565137710ab79c8dfa19b59 not found: ID does not exist" containerID="90e370d7361c3d04fdcea2b87639781144786dbff565137710ab79c8dfa19b59"
Jul 26 16:40:50.695984 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.695930    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e370d7361c3d04fdcea2b87639781144786dbff565137710ab79c8dfa19b59"} err="failed to get container status \"90e370d7361c3d04fdcea2b87639781144786dbff565137710ab79c8dfa19b59\": rpc error: code = NotFound desc = could not find container \"90e370d7361c3d04fdcea2b87639781144786dbff565137710ab79c8dfa19b59\": container with ID starting with 90e370d7361c3d04fdcea2b87639781144786dbff565137710ab79c8dfa19b59 not found: ID does not exist"
Jul 26 16:40:50.698837 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.698818    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"]
Jul 26 16:40:50.702711 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.702687    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d2caf295-778967ffdb-n454k"]
Jul 26 16:40:50.715870 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.715849    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"]
Jul 26 16:40:50.720376 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.720358    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d2caf295-75695fbd88-ptnqb"]
Jul 26 16:40:50.955289 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.955259    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="348b927d-4da3-4ce1-8905-ef0542e40bd3" path="/var/lib/kubelet/pods/348b927d-4da3-4ce1-8905-ef0542e40bd3/volumes"
Jul 26 16:40:50.955618 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:50.955605    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f0f2be9-4a16-453e-b876-091fec909c1f" path="/var/lib/kubelet/pods/3f0f2be9-4a16-453e-b876-091fec909c1f/volumes"
Jul 26 16:40:54.689556 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:54.689513    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:40:55.065245 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:40:55.065152    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:00.873556 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:00.873448    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:00.938974 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:00.938944    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:01.168028 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:01.167930    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:01.391281 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:01.391246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:01.544010 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:01.543977    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:01.650619 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:01.650586    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:01.818103 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:01.818025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:07.667438 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:07.667403    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:07.772164 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:07.772112    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:07.870306 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:07.870279    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:08.040161 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:08.040120    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:14.002038 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:14.002007    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:14.087941 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:14.087913    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:20.745339 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:20.745304    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:21.048874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:21.048792    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:21.253499 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:21.253467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:24.043976 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:24.043936    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:24.156075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:24.156045    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:24.251601 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:24.251568    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:24.363577 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:24.363496    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:25.199549 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.199512    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:25.476299 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.476217    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"]
Jul 26 16:41:25.476689 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.476670    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0f2be9-4a16-453e-b876-091fec909c1f" containerName="payload-processing"
Jul 26 16:41:25.476689 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.476687    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0f2be9-4a16-453e-b876-091fec909c1f" containerName="payload-processing"
Jul 26 16:41:25.476890 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.476699    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="348b927d-4da3-4ce1-8905-ef0542e40bd3" containerName="payload-pre-processing"
Jul 26 16:41:25.476890 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.476707    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="348b927d-4da3-4ce1-8905-ef0542e40bd3" containerName="payload-pre-processing"
Jul 26 16:41:25.476890 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.476782    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="348b927d-4da3-4ce1-8905-ef0542e40bd3" containerName="payload-pre-processing"
Jul 26 16:41:25.476890 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.476795    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0f2be9-4a16-453e-b876-091fec909c1f" containerName="payload-processing"
Jul 26 16:41:25.480286 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.480262    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"
Jul 26 16:41:25.484290 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.484268    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-ffa73817\""
Jul 26 16:41:25.497212 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.497189    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"]
Jul 26 16:41:25.506354 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.506328    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:25.555301 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.555272    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6sss\" (UniqueName: \"kubernetes.io/projected/f8f4e064-13c3-47f5-9367-df76c0798a82-kube-api-access-c6sss\") pod \"payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5\" (UID: \"f8f4e064-13c3-47f5-9367-df76c0798a82\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"
Jul 26 16:41:25.555408 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.555310    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f4e064-13c3-47f5-9367-df76c0798a82-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5\" (UID: \"f8f4e064-13c3-47f5-9367-df76c0798a82\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"
Jul 26 16:41:25.656647 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.656618    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6sss\" (UniqueName: \"kubernetes.io/projected/f8f4e064-13c3-47f5-9367-df76c0798a82-kube-api-access-c6sss\") pod \"payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5\" (UID: \"f8f4e064-13c3-47f5-9367-df76c0798a82\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"
Jul 26 16:41:25.656775 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.656666    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f4e064-13c3-47f5-9367-df76c0798a82-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5\" (UID: \"f8f4e064-13c3-47f5-9367-df76c0798a82\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"
Jul 26 16:41:25.657532 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.657512    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f4e064-13c3-47f5-9367-df76c0798a82-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5\" (UID: \"f8f4e064-13c3-47f5-9367-df76c0798a82\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"
Jul 26 16:41:25.668340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.668313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6sss\" (UniqueName: \"kubernetes.io/projected/f8f4e064-13c3-47f5-9367-df76c0798a82-kube-api-access-c6sss\") pod \"payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5\" (UID: \"f8f4e064-13c3-47f5-9367-df76c0798a82\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"
Jul 26 16:41:25.776840 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.776778    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"]
Jul 26 16:41:25.780299 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.780283    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"
Jul 26 16:41:25.783060 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.783044    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-ffa73817-dockercfg-4rhvl\""
Jul 26 16:41:25.791762 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.791743    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"
Jul 26 16:41:25.797996 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.797974    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"]
Jul 26 16:41:25.858710 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.858677    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54ksq\" (UniqueName: \"kubernetes.io/projected/e956a768-c09d-43fc-8629-ef3d257b1b02-kube-api-access-54ksq\") pod \"payload-processing-e2e-mt-ffa73817-5997d99958-65ftp\" (UID: \"e956a768-c09d-43fc-8629-ef3d257b1b02\") " pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"
Jul 26 16:41:25.858863 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.858739    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e956a768-c09d-43fc-8629-ef3d257b1b02-plugins-config-volume\") pod \"payload-processing-e2e-mt-ffa73817-5997d99958-65ftp\" (UID: \"e956a768-c09d-43fc-8629-ef3d257b1b02\") " pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"
Jul 26 16:41:25.935228 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.935203    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"]
Jul 26 16:41:25.937021 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:41:25.936992    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f4e064_13c3_47f5_9367_df76c0798a82.slice/crio-8e576cf3838cb0b9725beb9b501b21323bd6adb4802b971aa1c93ae9281ea213 WatchSource:0}: Error finding container 8e576cf3838cb0b9725beb9b501b21323bd6adb4802b971aa1c93ae9281ea213: Status 404 returned error can't find the container with id 8e576cf3838cb0b9725beb9b501b21323bd6adb4802b971aa1c93ae9281ea213
Jul 26 16:41:25.959549 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.959525    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54ksq\" (UniqueName: \"kubernetes.io/projected/e956a768-c09d-43fc-8629-ef3d257b1b02-kube-api-access-54ksq\") pod \"payload-processing-e2e-mt-ffa73817-5997d99958-65ftp\" (UID: \"e956a768-c09d-43fc-8629-ef3d257b1b02\") " pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"
Jul 26 16:41:25.959661 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.959573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e956a768-c09d-43fc-8629-ef3d257b1b02-plugins-config-volume\") pod \"payload-processing-e2e-mt-ffa73817-5997d99958-65ftp\" (UID: \"e956a768-c09d-43fc-8629-ef3d257b1b02\") " pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"
Jul 26 16:41:25.960326 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.960301    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e956a768-c09d-43fc-8629-ef3d257b1b02-plugins-config-volume\") pod \"payload-processing-e2e-mt-ffa73817-5997d99958-65ftp\" (UID: \"e956a768-c09d-43fc-8629-ef3d257b1b02\") " pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"
Jul 26 16:41:25.967666 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:25.967643    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54ksq\" (UniqueName: \"kubernetes.io/projected/e956a768-c09d-43fc-8629-ef3d257b1b02-kube-api-access-54ksq\") pod \"payload-processing-e2e-mt-ffa73817-5997d99958-65ftp\" (UID: \"e956a768-c09d-43fc-8629-ef3d257b1b02\") " pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"
Jul 26 16:41:26.090804 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:26.090727    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"
Jul 26 16:41:26.236222 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:26.236197    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"]
Jul 26 16:41:26.238260 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:41:26.238232    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode956a768_c09d_43fc_8629_ef3d257b1b02.slice/crio-baef1a5122f66d557b629a0cd7febe488d759071c0ec5bce06857309aca16582 WatchSource:0}: Error finding container baef1a5122f66d557b629a0cd7febe488d759071c0ec5bce06857309aca16582: Status 404 returned error can't find the container with id baef1a5122f66d557b629a0cd7febe488d759071c0ec5bce06857309aca16582
Jul 26 16:41:26.862183 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:26.862120    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5" event={"ID":"f8f4e064-13c3-47f5-9367-df76c0798a82","Type":"ContainerStarted","Data":"7db43a597a70189ad90522212e8a51b4b993c4597ede7adc742a5e760aae7fd6"}
Jul 26 16:41:26.862376 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:26.862305    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"
Jul 26 16:41:26.862376 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:26.862339    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5" event={"ID":"f8f4e064-13c3-47f5-9367-df76c0798a82","Type":"ContainerStarted","Data":"8e576cf3838cb0b9725beb9b501b21323bd6adb4802b971aa1c93ae9281ea213"}
Jul 26 16:41:26.863759 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:26.863730    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp" event={"ID":"e956a768-c09d-43fc-8629-ef3d257b1b02","Type":"ContainerStarted","Data":"3e295f46ad20b60b8663f576d39089312a5b7b4749d127c12490ee4da34eb089"}
Jul 26 16:41:26.863845 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:26.863771    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"
Jul 26 16:41:26.863845 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:26.863787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp" event={"ID":"e956a768-c09d-43fc-8629-ef3d257b1b02","Type":"ContainerStarted","Data":"baef1a5122f66d557b629a0cd7febe488d759071c0ec5bce06857309aca16582"}
Jul 26 16:41:26.886663 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:26.886617    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5" podStartSLOduration=1.8866049070000002 podStartE2EDuration="1.886604907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:41:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:41:26.885187919 +0000 UTC m=+2002.419887193" watchObservedRunningTime="2026-07-26 16:41:26.886604907 +0000 UTC m=+2002.421304207"
Jul 26 16:41:26.912057 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:26.912012    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp" podStartSLOduration=1.911998584 podStartE2EDuration="1.911998584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:41:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:41:26.910834695 +0000 UTC m=+2002.445533971" watchObservedRunningTime="2026-07-26 16:41:26.911998584 +0000 UTC m=+2002.446697858"
Jul 26 16:41:28.513062 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:28.513028    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:41:37.870739 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:37.870700    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"
Jul 26 16:41:37.871257 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:37.870940    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"
Jul 26 16:41:40.573338 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:41:40.573298    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:42:07.896351 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:07.896311    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc"]
Jul 26 16:42:07.900465 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:07.900443    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc"
Jul 26 16:42:07.903011 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:07.902992    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2xlcn\""
Jul 26 16:42:07.907746 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:07.907720    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc"]
Jul 26 16:42:07.909855 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:07.909832    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1750574d-01c2-4d98-8444-74fff046a87a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc\" (UID: \"1750574d-01c2-4d98-8444-74fff046a87a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc"
Jul 26 16:42:08.010267 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:08.010239    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1750574d-01c2-4d98-8444-74fff046a87a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc\" (UID: \"1750574d-01c2-4d98-8444-74fff046a87a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc"
Jul 26 16:42:08.010785 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:08.010766    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1750574d-01c2-4d98-8444-74fff046a87a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc\" (UID: \"1750574d-01c2-4d98-8444-74fff046a87a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc"
Jul 26 16:42:08.212392 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:08.212360    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc"
Jul 26 16:42:08.550774 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:08.550752    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc"]
Jul 26 16:42:08.552963 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:42:08.552931    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1750574d_01c2_4d98_8444_74fff046a87a.slice/crio-0862fe9c6f23c165713192334c43a234febde27705de966ebb67ade71bbe9f87 WatchSource:0}: Error finding container 0862fe9c6f23c165713192334c43a234febde27705de966ebb67ade71bbe9f87: Status 404 returned error can't find the container with id 0862fe9c6f23c165713192334c43a234febde27705de966ebb67ade71bbe9f87
Jul 26 16:42:09.080422 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:09.080391    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc" event={"ID":"1750574d-01c2-4d98-8444-74fff046a87a","Type":"ContainerStarted","Data":"f97ce21ef1a803606801eb6a291feba6471156427a5844768d7441d2c651c089"}
Jul 26 16:42:09.080807 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:09.080436    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc" event={"ID":"1750574d-01c2-4d98-8444-74fff046a87a","Type":"ContainerStarted","Data":"0862fe9c6f23c165713192334c43a234febde27705de966ebb67ade71bbe9f87"}
Jul 26 16:42:09.098478 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:09.098394    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc" podStartSLOduration=2.098380918 podStartE2EDuration="2.098380918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:42:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:42:09.096832414 +0000 UTC m=+2044.631531690" watchObservedRunningTime="2026-07-26 16:42:09.098380918 +0000 UTC m=+2044.633080193"
Jul 26 16:42:10.088074 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:10.088042    2559 generic.go:356] "Generic (PLEG): container finished" podID="1750574d-01c2-4d98-8444-74fff046a87a" containerID="f97ce21ef1a803606801eb6a291feba6471156427a5844768d7441d2c651c089" exitCode=0
Jul 26 16:42:10.088481 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:10.088136    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc" event={"ID":"1750574d-01c2-4d98-8444-74fff046a87a","Type":"ContainerDied","Data":"f97ce21ef1a803606801eb6a291feba6471156427a5844768d7441d2c651c089"}
Jul 26 16:42:11.232520 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:11.232494    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc"
Jul 26 16:42:11.233743 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:11.233725    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1750574d-01c2-4d98-8444-74fff046a87a-maas-api-service-ca\") pod \"1750574d-01c2-4d98-8444-74fff046a87a\" (UID: \"1750574d-01c2-4d98-8444-74fff046a87a\") "
Jul 26 16:42:11.234059 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:11.234038    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1750574d-01c2-4d98-8444-74fff046a87a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1750574d-01c2-4d98-8444-74fff046a87a" (UID: "1750574d-01c2-4d98-8444-74fff046a87a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:42:11.334420 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:11.334387    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1750574d-01c2-4d98-8444-74fff046a87a-maas-api-service-ca\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:42:12.099593 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:12.099565    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc"
Jul 26 16:42:12.099764 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:12.099605    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc" event={"ID":"1750574d-01c2-4d98-8444-74fff046a87a","Type":"ContainerDied","Data":"0862fe9c6f23c165713192334c43a234febde27705de966ebb67ade71bbe9f87"}
Jul 26 16:42:12.099764 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:12.099662    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0862fe9c6f23c165713192334c43a234febde27705de966ebb67ade71bbe9f87"
Jul 26 16:42:23.508290 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.508258    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:42:23.537333 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.537302    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"]
Jul 26 16:42:23.537578 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.537542    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp" podUID="e956a768-c09d-43fc-8629-ef3d257b1b02" containerName="payload-processing" containerID="cri-o://3e295f46ad20b60b8663f576d39089312a5b7b4749d127c12490ee4da34eb089" gracePeriod=30
Jul 26 16:42:23.544570 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.544542    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"]
Jul 26 16:42:23.544771 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.544745    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5" podUID="f8f4e064-13c3-47f5-9367-df76c0798a82" containerName="payload-pre-processing" containerID="cri-o://7db43a597a70189ad90522212e8a51b4b993c4597ede7adc742a5e760aae7fd6" gracePeriod=30
Jul 26 16:42:23.581177 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.581149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:42:23.643604 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.643575    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:42:23.802197 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.802175    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"
Jul 26 16:42:23.828511 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.828488    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"
Jul 26 16:42:23.839111 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.839090    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54ksq\" (UniqueName: \"kubernetes.io/projected/e956a768-c09d-43fc-8629-ef3d257b1b02-kube-api-access-54ksq\") pod \"e956a768-c09d-43fc-8629-ef3d257b1b02\" (UID: \"e956a768-c09d-43fc-8629-ef3d257b1b02\") "
Jul 26 16:42:23.839232 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.839116    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e956a768-c09d-43fc-8629-ef3d257b1b02-plugins-config-volume\") pod \"e956a768-c09d-43fc-8629-ef3d257b1b02\" (UID: \"e956a768-c09d-43fc-8629-ef3d257b1b02\") "
Jul 26 16:42:23.839576 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.839551    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e956a768-c09d-43fc-8629-ef3d257b1b02-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e956a768-c09d-43fc-8629-ef3d257b1b02" (UID: "e956a768-c09d-43fc-8629-ef3d257b1b02"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:42:23.841014 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.840994    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e956a768-c09d-43fc-8629-ef3d257b1b02-kube-api-access-54ksq" (OuterVolumeSpecName: "kube-api-access-54ksq") pod "e956a768-c09d-43fc-8629-ef3d257b1b02" (UID: "e956a768-c09d-43fc-8629-ef3d257b1b02"). InnerVolumeSpecName "kube-api-access-54ksq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:42:23.940617 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.940589    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f4e064-13c3-47f5-9367-df76c0798a82-plugins-config-volume\") pod \"f8f4e064-13c3-47f5-9367-df76c0798a82\" (UID: \"f8f4e064-13c3-47f5-9367-df76c0798a82\") "
Jul 26 16:42:23.940787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.940771    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6sss\" (UniqueName: \"kubernetes.io/projected/f8f4e064-13c3-47f5-9367-df76c0798a82-kube-api-access-c6sss\") pod \"f8f4e064-13c3-47f5-9367-df76c0798a82\" (UID: \"f8f4e064-13c3-47f5-9367-df76c0798a82\") "
Jul 26 16:42:23.940988 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.940963    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8f4e064-13c3-47f5-9367-df76c0798a82-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8f4e064-13c3-47f5-9367-df76c0798a82" (UID: "f8f4e064-13c3-47f5-9367-df76c0798a82"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:42:23.941075 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.941066    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54ksq\" (UniqueName: \"kubernetes.io/projected/e956a768-c09d-43fc-8629-ef3d257b1b02-kube-api-access-54ksq\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:42:23.941155 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.941079    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e956a768-c09d-43fc-8629-ef3d257b1b02-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:42:23.941155 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.941097    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f4e064-13c3-47f5-9367-df76c0798a82-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:42:23.942823 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:23.942795    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8f4e064-13c3-47f5-9367-df76c0798a82-kube-api-access-c6sss" (OuterVolumeSpecName: "kube-api-access-c6sss") pod "f8f4e064-13c3-47f5-9367-df76c0798a82" (UID: "f8f4e064-13c3-47f5-9367-df76c0798a82"). InnerVolumeSpecName "kube-api-access-c6sss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:42:24.041648 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.041591    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6sss\" (UniqueName: \"kubernetes.io/projected/f8f4e064-13c3-47f5-9367-df76c0798a82-kube-api-access-c6sss\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:42:24.159418 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.159389    2559 generic.go:356] "Generic (PLEG): container finished" podID="f8f4e064-13c3-47f5-9367-df76c0798a82" containerID="7db43a597a70189ad90522212e8a51b4b993c4597ede7adc742a5e760aae7fd6" exitCode=0
Jul 26 16:42:24.159564 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.159424    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"
Jul 26 16:42:24.159564 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.159476    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5" event={"ID":"f8f4e064-13c3-47f5-9367-df76c0798a82","Type":"ContainerDied","Data":"7db43a597a70189ad90522212e8a51b4b993c4597ede7adc742a5e760aae7fd6"}
Jul 26 16:42:24.159564 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.159536    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5" event={"ID":"f8f4e064-13c3-47f5-9367-df76c0798a82","Type":"ContainerDied","Data":"8e576cf3838cb0b9725beb9b501b21323bd6adb4802b971aa1c93ae9281ea213"}
Jul 26 16:42:24.159740 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.159567    2559 scope.go:117] "RemoveContainer" containerID="7db43a597a70189ad90522212e8a51b4b993c4597ede7adc742a5e760aae7fd6"
Jul 26 16:42:24.160757 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.160739    2559 generic.go:356] "Generic (PLEG): container finished" podID="e956a768-c09d-43fc-8629-ef3d257b1b02" containerID="3e295f46ad20b60b8663f576d39089312a5b7b4749d127c12490ee4da34eb089" exitCode=0
Jul 26 16:42:24.160842 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.160780    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp" event={"ID":"e956a768-c09d-43fc-8629-ef3d257b1b02","Type":"ContainerDied","Data":"3e295f46ad20b60b8663f576d39089312a5b7b4749d127c12490ee4da34eb089"}
Jul 26 16:42:24.160904 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.160781    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"
Jul 26 16:42:24.160960 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.160850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp" event={"ID":"e956a768-c09d-43fc-8629-ef3d257b1b02","Type":"ContainerDied","Data":"baef1a5122f66d557b629a0cd7febe488d759071c0ec5bce06857309aca16582"}
Jul 26 16:42:24.169538 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.169500    2559 scope.go:117] "RemoveContainer" containerID="7db43a597a70189ad90522212e8a51b4b993c4597ede7adc742a5e760aae7fd6"
Jul 26 16:42:24.169873 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:42:24.169851    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7db43a597a70189ad90522212e8a51b4b993c4597ede7adc742a5e760aae7fd6\": container with ID starting with 7db43a597a70189ad90522212e8a51b4b993c4597ede7adc742a5e760aae7fd6 not found: ID does not exist" containerID="7db43a597a70189ad90522212e8a51b4b993c4597ede7adc742a5e760aae7fd6"
Jul 26 16:42:24.169967 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.169884    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7db43a597a70189ad90522212e8a51b4b993c4597ede7adc742a5e760aae7fd6"} err="failed to get container status \"7db43a597a70189ad90522212e8a51b4b993c4597ede7adc742a5e760aae7fd6\": rpc error: code = NotFound desc = could not find container \"7db43a597a70189ad90522212e8a51b4b993c4597ede7adc742a5e760aae7fd6\": container with ID starting with 7db43a597a70189ad90522212e8a51b4b993c4597ede7adc742a5e760aae7fd6 not found: ID does not exist"
Jul 26 16:42:24.169967 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.169906    2559 scope.go:117] "RemoveContainer" containerID="3e295f46ad20b60b8663f576d39089312a5b7b4749d127c12490ee4da34eb089"
Jul 26 16:42:24.178231 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.178216    2559 scope.go:117] "RemoveContainer" containerID="3e295f46ad20b60b8663f576d39089312a5b7b4749d127c12490ee4da34eb089"
Jul 26 16:42:24.178491 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:42:24.178472    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e295f46ad20b60b8663f576d39089312a5b7b4749d127c12490ee4da34eb089\": container with ID starting with 3e295f46ad20b60b8663f576d39089312a5b7b4749d127c12490ee4da34eb089 not found: ID does not exist" containerID="3e295f46ad20b60b8663f576d39089312a5b7b4749d127c12490ee4da34eb089"
Jul 26 16:42:24.178546 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.178498    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e295f46ad20b60b8663f576d39089312a5b7b4749d127c12490ee4da34eb089"} err="failed to get container status \"3e295f46ad20b60b8663f576d39089312a5b7b4749d127c12490ee4da34eb089\": rpc error: code = NotFound desc = could not find container \"3e295f46ad20b60b8663f576d39089312a5b7b4749d127c12490ee4da34eb089\": container with ID starting with 3e295f46ad20b60b8663f576d39089312a5b7b4749d127c12490ee4da34eb089 not found: ID does not exist"
Jul 26 16:42:24.185491 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.185469    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"]
Jul 26 16:42:24.187382 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.187360    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ffa73817-68888fb856-flpz5"]
Jul 26 16:42:24.199208 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.199187    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"]
Jul 26 16:42:24.203043 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.203025    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ffa73817-5997d99958-65ftp"]
Jul 26 16:42:24.955228 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.955199    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e956a768-c09d-43fc-8629-ef3d257b1b02" path="/var/lib/kubelet/pods/e956a768-c09d-43fc-8629-ef3d257b1b02/volumes"
Jul 26 16:42:24.955617 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:24.955553    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8f4e064-13c3-47f5-9367-df76c0798a82" path="/var/lib/kubelet/pods/f8f4e064-13c3-47f5-9367-df76c0798a82/volumes"
Jul 26 16:42:27.971768 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:27.971690    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc"]
Jul 26 16:42:27.977118 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:27.977076    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:42:27.979140 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:27.979106    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ffa73817-qtlgc"]
Jul 26 16:42:28.635522 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:28.635487    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:42:28.954907 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:28.954876    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1750574d-01c2-4d98-8444-74fff046a87a" path="/var/lib/kubelet/pods/1750574d-01c2-4d98-8444-74fff046a87a/volumes"
Jul 26 16:42:31.146248 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:31.146217    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:42:36.223365 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:36.223327    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:42:50.297430 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:42:50.297394    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:05.102070 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:05.102041    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:43:05.103982 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:05.103956    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:43:05.204421 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:05.204398    2559 scope.go:117] "RemoveContainer" containerID="e23d85e32bbf17ba0aacb52f2a2c5a740bb230446ea6b706c62defd10cb2d710"
Jul 26 16:43:13.151163 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:13.151110    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:13.500509 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:13.500458    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:19.284399 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:19.284366    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:34.309984 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:34.309949    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:34.409742 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:34.409708    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:34.634093 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:34.633999    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:34.917560 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:34.917482    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:36.015604 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:36.015567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:36.191092 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:36.191060    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:37.066809 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:37.066779    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:37.297426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:37.297390    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:37.545793 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:37.545760    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:38.790899 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:38.790861    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:45.641646 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:45.641610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:45.742872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:45.742841    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:46.321785 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:46.321747    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:54.523933 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:54.523888    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:54.642833 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:54.642801    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:43:54.781023 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:43:54.780941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:05.353928 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:05.353855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:05.590409 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:05.590377    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:26.692641 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:26.692610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:33.816638 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:33.816588    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:33.895787 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:33.895756    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:34.168929 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:34.168853    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:34.519667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:34.519630    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:34.868026 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:34.867939    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:37.064299 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.064266    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:37.177276 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.177228    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:37.267966 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.267937    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:37.755956 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.755919    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:37.857886 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.857854    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:37.922680 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.922644    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"]
Jul 26 16:44:37.923115 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.923099    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e956a768-c09d-43fc-8629-ef3d257b1b02" containerName="payload-processing"
Jul 26 16:44:37.923255 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.923118    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e956a768-c09d-43fc-8629-ef3d257b1b02" containerName="payload-processing"
Jul 26 16:44:37.923255 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.923143    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8f4e064-13c3-47f5-9367-df76c0798a82" containerName="payload-pre-processing"
Jul 26 16:44:37.923255 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.923149    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8f4e064-13c3-47f5-9367-df76c0798a82" containerName="payload-pre-processing"
Jul 26 16:44:37.923255 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.923161    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1750574d-01c2-4d98-8444-74fff046a87a" containerName="revoke-keys"
Jul 26 16:44:37.923255 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.923168    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1750574d-01c2-4d98-8444-74fff046a87a" containerName="revoke-keys"
Jul 26 16:44:37.923255 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.923240    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1750574d-01c2-4d98-8444-74fff046a87a" containerName="revoke-keys"
Jul 26 16:44:37.923255 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.923249    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e956a768-c09d-43fc-8629-ef3d257b1b02" containerName="payload-processing"
Jul 26 16:44:37.923255 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.923257    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8f4e064-13c3-47f5-9367-df76c0798a82" containerName="payload-pre-processing"
Jul 26 16:44:37.926521 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.926503    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"
Jul 26 16:44:37.929885 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.929862    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-e38070\""
Jul 26 16:44:37.930284 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.930269    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-e38070-dockercfg-nlgrn\""
Jul 26 16:44:37.944906 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.944883    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"]
Jul 26 16:44:37.960557 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:37.960539    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:38.006408 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.006349    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"]
Jul 26 16:44:38.009763 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.009745    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"
Jul 26 16:44:38.036317 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.036285    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"]
Jul 26 16:44:38.063928 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.063897    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a2b38e9-c25e-4eb0-a735-b330b2f59288-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c\" (UID: \"7a2b38e9-c25e-4eb0-a735-b330b2f59288\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"
Jul 26 16:44:38.064106 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.064086    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8jzh\" (UniqueName: \"kubernetes.io/projected/7a2b38e9-c25e-4eb0-a735-b330b2f59288-kube-api-access-b8jzh\") pod \"payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c\" (UID: \"7a2b38e9-c25e-4eb0-a735-b330b2f59288\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"
Jul 26 16:44:38.164595 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.164566    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8jzh\" (UniqueName: \"kubernetes.io/projected/7a2b38e9-c25e-4eb0-a735-b330b2f59288-kube-api-access-b8jzh\") pod \"payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c\" (UID: \"7a2b38e9-c25e-4eb0-a735-b330b2f59288\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"
Jul 26 16:44:38.164595 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.164600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a2b38e9-c25e-4eb0-a735-b330b2f59288-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c\" (UID: \"7a2b38e9-c25e-4eb0-a735-b330b2f59288\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"
Jul 26 16:44:38.165027 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.164651    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84f710d4-772e-4064-9037-00644e1f6bbe-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8\" (UID: \"84f710d4-772e-4064-9037-00644e1f6bbe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"
Jul 26 16:44:38.165027 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.164676    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79cm6\" (UniqueName: \"kubernetes.io/projected/84f710d4-772e-4064-9037-00644e1f6bbe-kube-api-access-79cm6\") pod \"payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8\" (UID: \"84f710d4-772e-4064-9037-00644e1f6bbe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"
Jul 26 16:44:38.165395 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.165375    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a2b38e9-c25e-4eb0-a735-b330b2f59288-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c\" (UID: \"7a2b38e9-c25e-4eb0-a735-b330b2f59288\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"
Jul 26 16:44:38.174559 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.174540    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8jzh\" (UniqueName: \"kubernetes.io/projected/7a2b38e9-c25e-4eb0-a735-b330b2f59288-kube-api-access-b8jzh\") pod \"payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c\" (UID: \"7a2b38e9-c25e-4eb0-a735-b330b2f59288\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"
Jul 26 16:44:38.236593 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.236568    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"
Jul 26 16:44:38.265840 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.265778    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84f710d4-772e-4064-9037-00644e1f6bbe-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8\" (UID: \"84f710d4-772e-4064-9037-00644e1f6bbe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"
Jul 26 16:44:38.265840 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.265813    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79cm6\" (UniqueName: \"kubernetes.io/projected/84f710d4-772e-4064-9037-00644e1f6bbe-kube-api-access-79cm6\") pod \"payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8\" (UID: \"84f710d4-772e-4064-9037-00644e1f6bbe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"
Jul 26 16:44:38.266464 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.266445    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84f710d4-772e-4064-9037-00644e1f6bbe-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8\" (UID: \"84f710d4-772e-4064-9037-00644e1f6bbe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"
Jul 26 16:44:38.275372 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.275353    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79cm6\" (UniqueName: \"kubernetes.io/projected/84f710d4-772e-4064-9037-00644e1f6bbe-kube-api-access-79cm6\") pod \"payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8\" (UID: \"84f710d4-772e-4064-9037-00644e1f6bbe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"
Jul 26 16:44:38.319856 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.319824    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"
Jul 26 16:44:38.391701 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.391673    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"]
Jul 26 16:44:38.396700 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:44:38.396619    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2b38e9_c25e_4eb0_a735_b330b2f59288.slice/crio-f24c6eaf567bc45dd8c4ed23970e5615aa15b96547f6529a9284c92e0f19c2dc WatchSource:0}: Error finding container f24c6eaf567bc45dd8c4ed23970e5615aa15b96547f6529a9284c92e0f19c2dc: Status 404 returned error can't find the container with id f24c6eaf567bc45dd8c4ed23970e5615aa15b96547f6529a9284c92e0f19c2dc
Jul 26 16:44:38.477490 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.477464    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"]
Jul 26 16:44:38.478331 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:44:38.478281    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84f710d4_772e_4064_9037_00644e1f6bbe.slice/crio-2e6961a3aab8db5c530155c5188714178ef534133642f7945fb13e7afbae9bb1 WatchSource:0}: Error finding container 2e6961a3aab8db5c530155c5188714178ef534133642f7945fb13e7afbae9bb1: Status 404 returned error can't find the container with id 2e6961a3aab8db5c530155c5188714178ef534133642f7945fb13e7afbae9bb1
Jul 26 16:44:38.833410 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.833278    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c" event={"ID":"7a2b38e9-c25e-4eb0-a735-b330b2f59288","Type":"ContainerStarted","Data":"89c8732c1e03e501a33660e14d3d3bd91ab98e9a5b8272021edbe2107002f53a"}
Jul 26 16:44:38.833410 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.833397    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"
Jul 26 16:44:38.833628 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.833424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c" event={"ID":"7a2b38e9-c25e-4eb0-a735-b330b2f59288","Type":"ContainerStarted","Data":"f24c6eaf567bc45dd8c4ed23970e5615aa15b96547f6529a9284c92e0f19c2dc"}
Jul 26 16:44:38.834748 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.834723    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8" event={"ID":"84f710d4-772e-4064-9037-00644e1f6bbe","Type":"ContainerStarted","Data":"03ad3a9a8cd3b0e3dbd14e87d3ddb806c50295ea776da0f5b4ab627e1588691c"}
Jul 26 16:44:38.834832 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.834767    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8" event={"ID":"84f710d4-772e-4064-9037-00644e1f6bbe","Type":"ContainerStarted","Data":"2e6961a3aab8db5c530155c5188714178ef534133642f7945fb13e7afbae9bb1"}
Jul 26 16:44:38.834832 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.834787    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"
Jul 26 16:44:38.853965 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.853914    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c" podStartSLOduration=1.853900081 podStartE2EDuration="1.853900081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:44:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:44:38.851719698 +0000 UTC m=+2194.386418977" watchObservedRunningTime="2026-07-26 16:44:38.853900081 +0000 UTC m=+2194.388599385"
Jul 26 16:44:38.869833 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:38.869787    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8" podStartSLOduration=1.869772678 podStartE2EDuration="1.869772678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:44:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:44:38.867538144 +0000 UTC m=+2194.402237418" watchObservedRunningTime="2026-07-26 16:44:38.869772678 +0000 UTC m=+2194.404471974"
Jul 26 16:44:41.588585 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:41.588548    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:41.927441 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:41.927358    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:42.346382 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:42.346343    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:42.469514 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:42.469480    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:45.134893 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.134854    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:45.251065 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.251026    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:45.283202 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.283165    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"]
Jul 26 16:44:45.286938 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.286916    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:44:45.289529 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.289505    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6a9b62-serving-cert\""
Jul 26 16:44:45.289747 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.289604    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c6ndf\""
Jul 26 16:44:45.298874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.298851    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"]
Jul 26 16:44:45.418591 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.418505    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:45.425637 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.425613    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8ed48bb-8648-426a-a920-bd6883497f5b-maas-api-tls\") pod \"maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n\" (UID: \"f8ed48bb-8648-426a-a920-bd6883497f5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:44:45.425735 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.425641    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52pgk\" (UniqueName: \"kubernetes.io/projected/f8ed48bb-8648-426a-a920-bd6883497f5b-kube-api-access-52pgk\") pod \"maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n\" (UID: \"f8ed48bb-8648-426a-a920-bd6883497f5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:44:45.425735 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.425719    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ed48bb-8648-426a-a920-bd6883497f5b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n\" (UID: \"f8ed48bb-8648-426a-a920-bd6883497f5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:44:45.514956 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.514925    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:45.526191 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.526165    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8ed48bb-8648-426a-a920-bd6883497f5b-maas-api-tls\") pod \"maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n\" (UID: \"f8ed48bb-8648-426a-a920-bd6883497f5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:44:45.526191 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.526193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52pgk\" (UniqueName: \"kubernetes.io/projected/f8ed48bb-8648-426a-a920-bd6883497f5b-kube-api-access-52pgk\") pod \"maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n\" (UID: \"f8ed48bb-8648-426a-a920-bd6883497f5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:44:45.526420 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.526260    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ed48bb-8648-426a-a920-bd6883497f5b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n\" (UID: \"f8ed48bb-8648-426a-a920-bd6883497f5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:44:45.527109 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.527082    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ed48bb-8648-426a-a920-bd6883497f5b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n\" (UID: \"f8ed48bb-8648-426a-a920-bd6883497f5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:44:45.529007 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.528988    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8ed48bb-8648-426a-a920-bd6883497f5b-maas-api-tls\") pod \"maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n\" (UID: \"f8ed48bb-8648-426a-a920-bd6883497f5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:44:45.544235 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.544212    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52pgk\" (UniqueName: \"kubernetes.io/projected/f8ed48bb-8648-426a-a920-bd6883497f5b-kube-api-access-52pgk\") pod \"maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n\" (UID: \"f8ed48bb-8648-426a-a920-bd6883497f5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:44:45.601917 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.601884    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:44:45.739514 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.739479    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"]
Jul 26 16:44:45.743069 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:44:45.743035    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ed48bb_8648_426a_a920_bd6883497f5b.slice/crio-ce3cd02d6b351abb4d51341ed83cc5006b48209c2e0f0a552bdf0cc98db5afb7 WatchSource:0}: Error finding container ce3cd02d6b351abb4d51341ed83cc5006b48209c2e0f0a552bdf0cc98db5afb7: Status 404 returned error can't find the container with id ce3cd02d6b351abb4d51341ed83cc5006b48209c2e0f0a552bdf0cc98db5afb7
Jul 26 16:44:45.744826 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.744808    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 16:44:45.872038 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.872008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n" event={"ID":"f8ed48bb-8648-426a-a920-bd6883497f5b","Type":"ContainerStarted","Data":"ce3cd02d6b351abb4d51341ed83cc5006b48209c2e0f0a552bdf0cc98db5afb7"}
Jul 26 16:44:45.939860 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:45.939764    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:46.033653 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.033610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:46.038588 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.038562    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"]
Jul 26 16:44:46.043418 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.043399    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"
Jul 26 16:44:46.046043 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.046023    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-6a9b62\""
Jul 26 16:44:46.046155 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.046043    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-6a9b62-dockercfg-xphdd\""
Jul 26 16:44:46.053479 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.053455    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"]
Jul 26 16:44:46.065007 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.064973    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"]
Jul 26 16:44:46.069391 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.069370    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"
Jul 26 16:44:46.084601 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.084576    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"]
Jul 26 16:44:46.132062 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.132037    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q4pd\" (UniqueName: \"kubernetes.io/projected/144f8c54-ddf6-45b7-a63e-867a84f27598-kube-api-access-7q4pd\") pod \"payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9\" (UID: \"144f8c54-ddf6-45b7-a63e-867a84f27598\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"
Jul 26 16:44:46.132180 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.132093    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/144f8c54-ddf6-45b7-a63e-867a84f27598-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9\" (UID: \"144f8c54-ddf6-45b7-a63e-867a84f27598\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"
Jul 26 16:44:46.232859 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.232775    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdbca61b-a629-4e3b-8638-6d35ef661f61-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k\" (UID: \"fdbca61b-a629-4e3b-8638-6d35ef661f61\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"
Jul 26 16:44:46.232859 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.232841    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4n97\" (UniqueName: \"kubernetes.io/projected/fdbca61b-a629-4e3b-8638-6d35ef661f61-kube-api-access-p4n97\") pod \"payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k\" (UID: \"fdbca61b-a629-4e3b-8638-6d35ef661f61\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"
Jul 26 16:44:46.233347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.232891    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q4pd\" (UniqueName: \"kubernetes.io/projected/144f8c54-ddf6-45b7-a63e-867a84f27598-kube-api-access-7q4pd\") pod \"payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9\" (UID: \"144f8c54-ddf6-45b7-a63e-867a84f27598\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"
Jul 26 16:44:46.233347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.232959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/144f8c54-ddf6-45b7-a63e-867a84f27598-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9\" (UID: \"144f8c54-ddf6-45b7-a63e-867a84f27598\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"
Jul 26 16:44:46.233646 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.233624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/144f8c54-ddf6-45b7-a63e-867a84f27598-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9\" (UID: \"144f8c54-ddf6-45b7-a63e-867a84f27598\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"
Jul 26 16:44:46.242478 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.242444    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q4pd\" (UniqueName: \"kubernetes.io/projected/144f8c54-ddf6-45b7-a63e-867a84f27598-kube-api-access-7q4pd\") pod \"payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9\" (UID: \"144f8c54-ddf6-45b7-a63e-867a84f27598\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"
Jul 26 16:44:46.333939 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.333898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4n97\" (UniqueName: \"kubernetes.io/projected/fdbca61b-a629-4e3b-8638-6d35ef661f61-kube-api-access-p4n97\") pod \"payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k\" (UID: \"fdbca61b-a629-4e3b-8638-6d35ef661f61\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"
Jul 26 16:44:46.334172 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.334023    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdbca61b-a629-4e3b-8638-6d35ef661f61-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k\" (UID: \"fdbca61b-a629-4e3b-8638-6d35ef661f61\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"
Jul 26 16:44:46.334766 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.334740    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdbca61b-a629-4e3b-8638-6d35ef661f61-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k\" (UID: \"fdbca61b-a629-4e3b-8638-6d35ef661f61\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"
Jul 26 16:44:46.342021 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.341996    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4n97\" (UniqueName: \"kubernetes.io/projected/fdbca61b-a629-4e3b-8638-6d35ef661f61-kube-api-access-p4n97\") pod \"payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k\" (UID: \"fdbca61b-a629-4e3b-8638-6d35ef661f61\") " pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"
Jul 26 16:44:46.355880 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.355853    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"
Jul 26 16:44:46.382638 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.382605    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"
Jul 26 16:44:46.511041 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.511010    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"]
Jul 26 16:44:46.511794 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:44:46.511767    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144f8c54_ddf6_45b7_a63e_867a84f27598.slice/crio-b6211b81a78c0ddcb614aadc141c47c0b20436b5d00fe2dfd4fb4f82b57b1468 WatchSource:0}: Error finding container b6211b81a78c0ddcb614aadc141c47c0b20436b5d00fe2dfd4fb4f82b57b1468: Status 404 returned error can't find the container with id b6211b81a78c0ddcb614aadc141c47c0b20436b5d00fe2dfd4fb4f82b57b1468
Jul 26 16:44:46.744873 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.744834    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"]
Jul 26 16:44:46.747442 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:44:46.747413    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbca61b_a629_4e3b_8638_6d35ef661f61.slice/crio-1199d598fe88e9a7cc3382958a42db3d371b5f3f77c8ed51efac19f1b91aad7d WatchSource:0}: Error finding container 1199d598fe88e9a7cc3382958a42db3d371b5f3f77c8ed51efac19f1b91aad7d: Status 404 returned error can't find the container with id 1199d598fe88e9a7cc3382958a42db3d371b5f3f77c8ed51efac19f1b91aad7d
Jul 26 16:44:46.879169 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.879104    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k" event={"ID":"fdbca61b-a629-4e3b-8638-6d35ef661f61","Type":"ContainerStarted","Data":"3857564a5ab17c006ebd0280c4f762acbd28dc15c041a358bf75f03d15d4c43a"}
Jul 26 16:44:46.879350 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.879322    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"
Jul 26 16:44:46.879484 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.879385    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k" event={"ID":"fdbca61b-a629-4e3b-8638-6d35ef661f61","Type":"ContainerStarted","Data":"1199d598fe88e9a7cc3382958a42db3d371b5f3f77c8ed51efac19f1b91aad7d"}
Jul 26 16:44:46.880851 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.880826    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n" event={"ID":"f8ed48bb-8648-426a-a920-bd6883497f5b","Type":"ContainerStarted","Data":"a97a1f78f13c6f4693c74a2fb5270ec1af8cd44af248a4a23c40e70e08eb8b64"}
Jul 26 16:44:46.880984 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.880876    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:44:46.882570 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.882542    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9" event={"ID":"144f8c54-ddf6-45b7-a63e-867a84f27598","Type":"ContainerStarted","Data":"aa87788c2c0433f4f13efbf0b4bed5d159ddeeb261fb28931b4fee4ef93d4520"}
Jul 26 16:44:46.882691 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.882590    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9" event={"ID":"144f8c54-ddf6-45b7-a63e-867a84f27598","Type":"ContainerStarted","Data":"b6211b81a78c0ddcb614aadc141c47c0b20436b5d00fe2dfd4fb4f82b57b1468"}
Jul 26 16:44:46.882691 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.882656    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"
Jul 26 16:44:46.906383 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.906341    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k" podStartSLOduration=0.906326419 podStartE2EDuration="906.326419ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:44:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:44:46.903248035 +0000 UTC m=+2202.437947309" watchObservedRunningTime="2026-07-26 16:44:46.906326419 +0000 UTC m=+2202.441025695"
Jul 26 16:44:46.923871 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.923829    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n" podStartSLOduration=1.595591816 podStartE2EDuration="1.923817471s" totalImagesPullingTime="328.225655ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:44:46.922756078 +0000 UTC m=+2202.457455354" watchObservedRunningTime="2026-07-26 16:44:46.923817471 +0000 UTC m=+2202.458516747"
Jul 26 16:44:46.939112 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:46.939073    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9" podStartSLOduration=0.939060408 podStartE2EDuration="939.060408ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:44:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:44:46.938633186 +0000 UTC m=+2202.473332462" watchObservedRunningTime="2026-07-26 16:44:46.939060408 +0000 UTC m=+2202.473759682"
Jul 26 16:44:49.590645 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:49.590617    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:44:49.841942 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:49.841855    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"
Jul 26 16:44:49.841942 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:49.841928    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"
Jul 26 16:44:52.894398 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:52.894368    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:44:57.890958 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:57.890924    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"
Jul 26 16:44:57.891467 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:44:57.891242    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"
Jul 26 16:45:00.138298 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.138256    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6a9b62-29751405-q5prj"]
Jul 26 16:45:00.142161 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.142137    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e38070-29751405-8fkkt"]
Jul 26 16:45:00.142318 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.142262    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6a9b62-29751405-q5prj"
Jul 26 16:45:00.145639 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.145617    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e38070-29751405-8fkkt"
Jul 26 16:45:00.147292 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.147277    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2xlcn\""
Jul 26 16:45:00.154329 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.154308    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6a9b62-29751405-q5prj"
Jul 26 16:45:00.155990 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.155960    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6a9b62-29751405-q5prj"]
Jul 26 16:45:00.159920 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.159835    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e38070-29751405-8fkkt"]
Jul 26 16:45:00.162863 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.162841    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e38070-29751405-8fkkt"
Jul 26 16:45:00.247557 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.247508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:45:00.328331 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.328301    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6a9b62-29751405-q5prj"]
Jul 26 16:45:00.329784 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:45:00.329745    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e813e7_15ff_4899_928a_46abec475787.slice/crio-503eaee2a1dad966bbb5edc25fd416caddd8f10e9477d1f852490e4b3dde43c3 WatchSource:0}: Error finding container 503eaee2a1dad966bbb5edc25fd416caddd8f10e9477d1f852490e4b3dde43c3: Status 404 returned error can't find the container with id 503eaee2a1dad966bbb5edc25fd416caddd8f10e9477d1f852490e4b3dde43c3
Jul 26 16:45:00.345763 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.345738    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e38070-29751405-8fkkt"]
Jul 26 16:45:00.347475 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:45:00.347448    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717dde04_e03f_49e7_8489_e8a70b89fc06.slice/crio-d4618365521479a7dd6412617e78e1ae63485bee647f44c9e44fb1c7f83e8da1 WatchSource:0}: Error finding container d4618365521479a7dd6412617e78e1ae63485bee647f44c9e44fb1c7f83e8da1: Status 404 returned error can't find the container with id d4618365521479a7dd6412617e78e1ae63485bee647f44c9e44fb1c7f83e8da1
Jul 26 16:45:00.962566 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.962532    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6a9b62-29751405-q5prj" event={"ID":"b1e813e7-15ff-4899-928a-46abec475787","Type":"ContainerStarted","Data":"8721133f2e83d11d2d423667d1b4698a167e10293e4aa5cfede5e63be1507be7"}
Jul 26 16:45:00.962754 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.962591    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6a9b62-29751405-q5prj" event={"ID":"b1e813e7-15ff-4899-928a-46abec475787","Type":"ContainerStarted","Data":"503eaee2a1dad966bbb5edc25fd416caddd8f10e9477d1f852490e4b3dde43c3"}
Jul 26 16:45:00.963987 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.963960    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e38070-29751405-8fkkt" event={"ID":"717dde04-e03f-49e7-8489-e8a70b89fc06","Type":"ContainerStarted","Data":"87c60ea9fd862f05ace37ca79e16ed7e003ba2f99cf9e25cf95aec437590fd0c"}
Jul 26 16:45:00.964101 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.964010    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e38070-29751405-8fkkt" event={"ID":"717dde04-e03f-49e7-8489-e8a70b89fc06","Type":"ContainerStarted","Data":"d4618365521479a7dd6412617e78e1ae63485bee647f44c9e44fb1c7f83e8da1"}
Jul 26 16:45:00.984277 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:00.984231    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6a9b62-29751405-q5prj" podStartSLOduration=0.984218296 podStartE2EDuration="984.218296ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:45:00.981387766 +0000 UTC m=+2216.516087038" watchObservedRunningTime="2026-07-26 16:45:00.984218296 +0000 UTC m=+2216.518917571"
Jul 26 16:45:01.010521 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:01.010484    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e38070-29751405-8fkkt" podStartSLOduration=1.010471933 podStartE2EDuration="1.010471933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:45:01.008573918 +0000 UTC m=+2216.543273192" watchObservedRunningTime="2026-07-26 16:45:01.010471933 +0000 UTC m=+2216.545171208"
Jul 26 16:45:01.971765 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:01.971729    2559 generic.go:356] "Generic (PLEG): container finished" podID="717dde04-e03f-49e7-8489-e8a70b89fc06" containerID="87c60ea9fd862f05ace37ca79e16ed7e003ba2f99cf9e25cf95aec437590fd0c" exitCode=0
Jul 26 16:45:01.972226 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:01.971814    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e38070-29751405-8fkkt" event={"ID":"717dde04-e03f-49e7-8489-e8a70b89fc06","Type":"ContainerDied","Data":"87c60ea9fd862f05ace37ca79e16ed7e003ba2f99cf9e25cf95aec437590fd0c"}
Jul 26 16:45:01.973748 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:01.973717    2559 generic.go:356] "Generic (PLEG): container finished" podID="b1e813e7-15ff-4899-928a-46abec475787" containerID="8721133f2e83d11d2d423667d1b4698a167e10293e4aa5cfede5e63be1507be7" exitCode=0
Jul 26 16:45:01.973892 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:01.973802    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6a9b62-29751405-q5prj" event={"ID":"b1e813e7-15ff-4899-928a-46abec475787","Type":"ContainerDied","Data":"8721133f2e83d11d2d423667d1b4698a167e10293e4aa5cfede5e63be1507be7"}
Jul 26 16:45:03.141719 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:03.141690    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6a9b62-29751405-q5prj"
Jul 26 16:45:03.144772 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:03.144751    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e38070-29751405-8fkkt"
Jul 26 16:45:03.985640 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:03.985610    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e38070-29751405-8fkkt"
Jul 26 16:45:03.985830 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:03.985630    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e38070-29751405-8fkkt" event={"ID":"717dde04-e03f-49e7-8489-e8a70b89fc06","Type":"ContainerDied","Data":"d4618365521479a7dd6412617e78e1ae63485bee647f44c9e44fb1c7f83e8da1"}
Jul 26 16:45:03.985830 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:03.985689    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4618365521479a7dd6412617e78e1ae63485bee647f44c9e44fb1c7f83e8da1"
Jul 26 16:45:03.986881 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:03.986865    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6a9b62-29751405-q5prj"
Jul 26 16:45:03.986978 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:03.986862    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6a9b62-29751405-q5prj" event={"ID":"b1e813e7-15ff-4899-928a-46abec475787","Type":"ContainerDied","Data":"503eaee2a1dad966bbb5edc25fd416caddd8f10e9477d1f852490e4b3dde43c3"}
Jul 26 16:45:03.986978 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:03.986965    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="503eaee2a1dad966bbb5edc25fd416caddd8f10e9477d1f852490e4b3dde43c3"
Jul 26 16:45:05.238685 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:05.238655    2559 scope.go:117] "RemoveContainer" containerID="7474577a03e8471557dea3a4cfcc83a59c5f49a1ec158fb1140e2b3e6634a9d8"
Jul 26 16:45:33.581514 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:33.581448    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:45:43.098648 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:43.098618    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:45:44.123776 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:45:44.123743    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:19.833309 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:19.833262    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:20.714572 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:20.714531    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:31.358334 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.358295    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e38070-29751405-8fkkt"]
Jul 26 16:46:31.360222 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.360200    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e38070-29751405-8fkkt"]
Jul 26 16:46:31.361269 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.361247    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:31.393370 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.393334    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"]
Jul 26 16:46:31.393642 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.393613    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c" podUID="7a2b38e9-c25e-4eb0-a735-b330b2f59288" containerName="payload-processing" containerID="cri-o://89c8732c1e03e501a33660e14d3d3bd91ab98e9a5b8272021edbe2107002f53a" gracePeriod=30
Jul 26 16:46:31.399751 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.399724    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"]
Jul 26 16:46:31.400137 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.400093    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8" podUID="84f710d4-772e-4064-9037-00644e1f6bbe" containerName="payload-pre-processing" containerID="cri-o://03ad3a9a8cd3b0e3dbd14e87d3ddb806c50295ea776da0f5b4ab627e1588691c" gracePeriod=30
Jul 26 16:46:31.436204 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.436173    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:31.498016 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:46:31.497975    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2b38e9_c25e_4eb0_a735_b330b2f59288.slice/crio-conmon-89c8732c1e03e501a33660e14d3d3bd91ab98e9a5b8272021edbe2107002f53a.scope\": RecentStats: unable to find data in memory cache]"
Jul 26 16:46:31.537041 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.536973    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:31.683842 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.683822    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"
Jul 26 16:46:31.686424 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.686401    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"
Jul 26 16:46:31.853218 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.853186    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8jzh\" (UniqueName: \"kubernetes.io/projected/7a2b38e9-c25e-4eb0-a735-b330b2f59288-kube-api-access-b8jzh\") pod \"7a2b38e9-c25e-4eb0-a735-b330b2f59288\" (UID: \"7a2b38e9-c25e-4eb0-a735-b330b2f59288\") "
Jul 26 16:46:31.853418 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.853260    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84f710d4-772e-4064-9037-00644e1f6bbe-plugins-config-volume\") pod \"84f710d4-772e-4064-9037-00644e1f6bbe\" (UID: \"84f710d4-772e-4064-9037-00644e1f6bbe\") "
Jul 26 16:46:31.853418 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.853313    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79cm6\" (UniqueName: \"kubernetes.io/projected/84f710d4-772e-4064-9037-00644e1f6bbe-kube-api-access-79cm6\") pod \"84f710d4-772e-4064-9037-00644e1f6bbe\" (UID: \"84f710d4-772e-4064-9037-00644e1f6bbe\") "
Jul 26 16:46:31.853418 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.853358    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a2b38e9-c25e-4eb0-a735-b330b2f59288-plugins-config-volume\") pod \"7a2b38e9-c25e-4eb0-a735-b330b2f59288\" (UID: \"7a2b38e9-c25e-4eb0-a735-b330b2f59288\") "
Jul 26 16:46:31.853727 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.853620    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84f710d4-772e-4064-9037-00644e1f6bbe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "84f710d4-772e-4064-9037-00644e1f6bbe" (UID: "84f710d4-772e-4064-9037-00644e1f6bbe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:46:31.853828 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.853774    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a2b38e9-c25e-4eb0-a735-b330b2f59288-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a2b38e9-c25e-4eb0-a735-b330b2f59288" (UID: "7a2b38e9-c25e-4eb0-a735-b330b2f59288"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:46:31.855388 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.855365    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a2b38e9-c25e-4eb0-a735-b330b2f59288-kube-api-access-b8jzh" (OuterVolumeSpecName: "kube-api-access-b8jzh") pod "7a2b38e9-c25e-4eb0-a735-b330b2f59288" (UID: "7a2b38e9-c25e-4eb0-a735-b330b2f59288"). InnerVolumeSpecName "kube-api-access-b8jzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:46:31.855489 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.855412    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84f710d4-772e-4064-9037-00644e1f6bbe-kube-api-access-79cm6" (OuterVolumeSpecName: "kube-api-access-79cm6") pod "84f710d4-772e-4064-9037-00644e1f6bbe" (UID: "84f710d4-772e-4064-9037-00644e1f6bbe"). InnerVolumeSpecName "kube-api-access-79cm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:46:31.953967 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.953938    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8jzh\" (UniqueName: \"kubernetes.io/projected/7a2b38e9-c25e-4eb0-a735-b330b2f59288-kube-api-access-b8jzh\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:46:31.953967 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.953964    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84f710d4-772e-4064-9037-00644e1f6bbe-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:46:31.954169 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.953974    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79cm6\" (UniqueName: \"kubernetes.io/projected/84f710d4-772e-4064-9037-00644e1f6bbe-kube-api-access-79cm6\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:46:31.954169 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:31.953983    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a2b38e9-c25e-4eb0-a735-b330b2f59288-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:46:32.001181 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.001152    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:32.443736 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.443702    2559 generic.go:356] "Generic (PLEG): container finished" podID="84f710d4-772e-4064-9037-00644e1f6bbe" containerID="03ad3a9a8cd3b0e3dbd14e87d3ddb806c50295ea776da0f5b4ab627e1588691c" exitCode=0
Jul 26 16:46:32.444135 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.443741    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"
Jul 26 16:46:32.444135 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.443794    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8" event={"ID":"84f710d4-772e-4064-9037-00644e1f6bbe","Type":"ContainerDied","Data":"03ad3a9a8cd3b0e3dbd14e87d3ddb806c50295ea776da0f5b4ab627e1588691c"}
Jul 26 16:46:32.444135 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.443843    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8" event={"ID":"84f710d4-772e-4064-9037-00644e1f6bbe","Type":"ContainerDied","Data":"2e6961a3aab8db5c530155c5188714178ef534133642f7945fb13e7afbae9bb1"}
Jul 26 16:46:32.444135 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.443867    2559 scope.go:117] "RemoveContainer" containerID="03ad3a9a8cd3b0e3dbd14e87d3ddb806c50295ea776da0f5b4ab627e1588691c"
Jul 26 16:46:32.445279 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.445258    2559 generic.go:356] "Generic (PLEG): container finished" podID="7a2b38e9-c25e-4eb0-a735-b330b2f59288" containerID="89c8732c1e03e501a33660e14d3d3bd91ab98e9a5b8272021edbe2107002f53a" exitCode=0
Jul 26 16:46:32.445375 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.445291    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c" event={"ID":"7a2b38e9-c25e-4eb0-a735-b330b2f59288","Type":"ContainerDied","Data":"89c8732c1e03e501a33660e14d3d3bd91ab98e9a5b8272021edbe2107002f53a"}
Jul 26 16:46:32.445375 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.445299    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"
Jul 26 16:46:32.445375 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.445328    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c" event={"ID":"7a2b38e9-c25e-4eb0-a735-b330b2f59288","Type":"ContainerDied","Data":"f24c6eaf567bc45dd8c4ed23970e5615aa15b96547f6529a9284c92e0f19c2dc"}
Jul 26 16:46:32.456556 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.454247    2559 scope.go:117] "RemoveContainer" containerID="03ad3a9a8cd3b0e3dbd14e87d3ddb806c50295ea776da0f5b4ab627e1588691c"
Jul 26 16:46:32.456556 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:46:32.455648    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03ad3a9a8cd3b0e3dbd14e87d3ddb806c50295ea776da0f5b4ab627e1588691c\": container with ID starting with 03ad3a9a8cd3b0e3dbd14e87d3ddb806c50295ea776da0f5b4ab627e1588691c not found: ID does not exist" containerID="03ad3a9a8cd3b0e3dbd14e87d3ddb806c50295ea776da0f5b4ab627e1588691c"
Jul 26 16:46:32.456556 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.455680    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ad3a9a8cd3b0e3dbd14e87d3ddb806c50295ea776da0f5b4ab627e1588691c"} err="failed to get container status \"03ad3a9a8cd3b0e3dbd14e87d3ddb806c50295ea776da0f5b4ab627e1588691c\": rpc error: code = NotFound desc = could not find container \"03ad3a9a8cd3b0e3dbd14e87d3ddb806c50295ea776da0f5b4ab627e1588691c\": container with ID starting with 03ad3a9a8cd3b0e3dbd14e87d3ddb806c50295ea776da0f5b4ab627e1588691c not found: ID does not exist"
Jul 26 16:46:32.456556 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.455703    2559 scope.go:117] "RemoveContainer" containerID="89c8732c1e03e501a33660e14d3d3bd91ab98e9a5b8272021edbe2107002f53a"
Jul 26 16:46:32.464490 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.464468    2559 scope.go:117] "RemoveContainer" containerID="89c8732c1e03e501a33660e14d3d3bd91ab98e9a5b8272021edbe2107002f53a"
Jul 26 16:46:32.464727 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:46:32.464711    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89c8732c1e03e501a33660e14d3d3bd91ab98e9a5b8272021edbe2107002f53a\": container with ID starting with 89c8732c1e03e501a33660e14d3d3bd91ab98e9a5b8272021edbe2107002f53a not found: ID does not exist" containerID="89c8732c1e03e501a33660e14d3d3bd91ab98e9a5b8272021edbe2107002f53a"
Jul 26 16:46:32.464779 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.464733    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89c8732c1e03e501a33660e14d3d3bd91ab98e9a5b8272021edbe2107002f53a"} err="failed to get container status \"89c8732c1e03e501a33660e14d3d3bd91ab98e9a5b8272021edbe2107002f53a\": rpc error: code = NotFound desc = could not find container \"89c8732c1e03e501a33660e14d3d3bd91ab98e9a5b8272021edbe2107002f53a\": container with ID starting with 89c8732c1e03e501a33660e14d3d3bd91ab98e9a5b8272021edbe2107002f53a not found: ID does not exist"
Jul 26 16:46:32.470746 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.470723    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"]
Jul 26 16:46:32.474385 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.474364    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e38070-6787658bdd-6chn8"]
Jul 26 16:46:32.485011 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.484992    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"]
Jul 26 16:46:32.488833 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.488815    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e38070-7fd6577668-48t6c"]
Jul 26 16:46:32.955089 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.955057    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="717dde04-e03f-49e7-8489-e8a70b89fc06" path="/var/lib/kubelet/pods/717dde04-e03f-49e7-8489-e8a70b89fc06/volumes"
Jul 26 16:46:32.955438 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.955424    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a2b38e9-c25e-4eb0-a735-b330b2f59288" path="/var/lib/kubelet/pods/7a2b38e9-c25e-4eb0-a735-b330b2f59288/volumes"
Jul 26 16:46:32.955738 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:32.955727    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84f710d4-772e-4064-9037-00644e1f6bbe" path="/var/lib/kubelet/pods/84f710d4-772e-4064-9037-00644e1f6bbe/volumes"
Jul 26 16:46:35.913234 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:35.913195    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:36.299877 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:36.299838    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:41.989065 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:41.989031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:42.048874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:42.048840    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:42.258740 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:42.258658    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:42.528556 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:42.528471    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:53.053767 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.053733    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"]
Jul 26 16:46:53.054338 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.053932    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n" podUID="f8ed48bb-8648-426a-a920-bd6883497f5b" containerName="maas-api" containerID="cri-o://a97a1f78f13c6f4693c74a2fb5270ec1af8cd44af248a4a23c40e70e08eb8b64" gracePeriod=30
Jul 26 16:46:53.082055 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.082023    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6a9b62-29751405-q5prj"]
Jul 26 16:46:53.085333 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.085311    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6a9b62-29751405-q5prj"]
Jul 26 16:46:53.086673 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.086651    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:53.115653 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.115627    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"]
Jul 26 16:46:53.116003 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.115862    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k" podUID="fdbca61b-a629-4e3b-8638-6d35ef661f61" containerName="payload-processing" containerID="cri-o://3857564a5ab17c006ebd0280c4f762acbd28dc15c041a358bf75f03d15d4c43a" gracePeriod=30
Jul 26 16:46:53.122271 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.122244    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"]
Jul 26 16:46:53.122433 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.122412    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9" podUID="144f8c54-ddf6-45b7-a63e-867a84f27598" containerName="payload-pre-processing" containerID="cri-o://aa87788c2c0433f4f13efbf0b4bed5d159ddeeb261fb28931b4fee4ef93d4520" gracePeriod=30
Jul 26 16:46:53.186768 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.186739    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:53.287889 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.287819    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:53.420953 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.420923    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"
Jul 26 16:46:53.425880 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.425852    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"
Jul 26 16:46:53.435925 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.435904    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4n97\" (UniqueName: \"kubernetes.io/projected/fdbca61b-a629-4e3b-8638-6d35ef661f61-kube-api-access-p4n97\") pod \"fdbca61b-a629-4e3b-8638-6d35ef661f61\" (UID: \"fdbca61b-a629-4e3b-8638-6d35ef661f61\") "
Jul 26 16:46:53.436022 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.435937    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdbca61b-a629-4e3b-8638-6d35ef661f61-plugins-config-volume\") pod \"fdbca61b-a629-4e3b-8638-6d35ef661f61\" (UID: \"fdbca61b-a629-4e3b-8638-6d35ef661f61\") "
Jul 26 16:46:53.436022 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.435956    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q4pd\" (UniqueName: \"kubernetes.io/projected/144f8c54-ddf6-45b7-a63e-867a84f27598-kube-api-access-7q4pd\") pod \"144f8c54-ddf6-45b7-a63e-867a84f27598\" (UID: \"144f8c54-ddf6-45b7-a63e-867a84f27598\") "
Jul 26 16:46:53.436108 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.436026    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/144f8c54-ddf6-45b7-a63e-867a84f27598-plugins-config-volume\") pod \"144f8c54-ddf6-45b7-a63e-867a84f27598\" (UID: \"144f8c54-ddf6-45b7-a63e-867a84f27598\") "
Jul 26 16:46:53.436617 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.436361    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdbca61b-a629-4e3b-8638-6d35ef661f61-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fdbca61b-a629-4e3b-8638-6d35ef661f61" (UID: "fdbca61b-a629-4e3b-8638-6d35ef661f61"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:46:53.436617 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.436494    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/144f8c54-ddf6-45b7-a63e-867a84f27598-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "144f8c54-ddf6-45b7-a63e-867a84f27598" (UID: "144f8c54-ddf6-45b7-a63e-867a84f27598"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:46:53.436918 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.436896    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:46:53.438170 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.438141    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdbca61b-a629-4e3b-8638-6d35ef661f61-kube-api-access-p4n97" (OuterVolumeSpecName: "kube-api-access-p4n97") pod "fdbca61b-a629-4e3b-8638-6d35ef661f61" (UID: "fdbca61b-a629-4e3b-8638-6d35ef661f61"). InnerVolumeSpecName "kube-api-access-p4n97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:46:53.438381 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.438353    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/144f8c54-ddf6-45b7-a63e-867a84f27598-kube-api-access-7q4pd" (OuterVolumeSpecName: "kube-api-access-7q4pd") pod "144f8c54-ddf6-45b7-a63e-867a84f27598" (UID: "144f8c54-ddf6-45b7-a63e-867a84f27598"). InnerVolumeSpecName "kube-api-access-7q4pd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:46:53.536781 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.536748    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ed48bb-8648-426a-a920-bd6883497f5b-openshift-service-ca\") pod \"f8ed48bb-8648-426a-a920-bd6883497f5b\" (UID: \"f8ed48bb-8648-426a-a920-bd6883497f5b\") "
Jul 26 16:46:53.537282 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.536797    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8ed48bb-8648-426a-a920-bd6883497f5b-maas-api-tls\") pod \"f8ed48bb-8648-426a-a920-bd6883497f5b\" (UID: \"f8ed48bb-8648-426a-a920-bd6883497f5b\") "
Jul 26 16:46:53.537282 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.536856    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52pgk\" (UniqueName: \"kubernetes.io/projected/f8ed48bb-8648-426a-a920-bd6883497f5b-kube-api-access-52pgk\") pod \"f8ed48bb-8648-426a-a920-bd6883497f5b\" (UID: \"f8ed48bb-8648-426a-a920-bd6883497f5b\") "
Jul 26 16:46:53.537282 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.537204    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8ed48bb-8648-426a-a920-bd6883497f5b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8ed48bb-8648-426a-a920-bd6883497f5b" (UID: "f8ed48bb-8648-426a-a920-bd6883497f5b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:46:53.537282 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.537216    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q4pd\" (UniqueName: \"kubernetes.io/projected/144f8c54-ddf6-45b7-a63e-867a84f27598-kube-api-access-7q4pd\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:46:53.537282 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.537271    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/144f8c54-ddf6-45b7-a63e-867a84f27598-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:46:53.537282 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.537282    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4n97\" (UniqueName: \"kubernetes.io/projected/fdbca61b-a629-4e3b-8638-6d35ef661f61-kube-api-access-p4n97\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:46:53.537537 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.537293    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdbca61b-a629-4e3b-8638-6d35ef661f61-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:46:53.538815 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.538796    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8ed48bb-8648-426a-a920-bd6883497f5b-kube-api-access-52pgk" (OuterVolumeSpecName: "kube-api-access-52pgk") pod "f8ed48bb-8648-426a-a920-bd6883497f5b" (UID: "f8ed48bb-8648-426a-a920-bd6883497f5b"). InnerVolumeSpecName "kube-api-access-52pgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:46:53.538893 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.538822    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8ed48bb-8648-426a-a920-bd6883497f5b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8ed48bb-8648-426a-a920-bd6883497f5b" (UID: "f8ed48bb-8648-426a-a920-bd6883497f5b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:46:53.570173 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.570116    2559 generic.go:356] "Generic (PLEG): container finished" podID="f8ed48bb-8648-426a-a920-bd6883497f5b" containerID="a97a1f78f13c6f4693c74a2fb5270ec1af8cd44af248a4a23c40e70e08eb8b64" exitCode=0
Jul 26 16:46:53.570320 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.570191    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"
Jul 26 16:46:53.570320 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.570217    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n" event={"ID":"f8ed48bb-8648-426a-a920-bd6883497f5b","Type":"ContainerDied","Data":"a97a1f78f13c6f4693c74a2fb5270ec1af8cd44af248a4a23c40e70e08eb8b64"}
Jul 26 16:46:53.570320 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.570307    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n" event={"ID":"f8ed48bb-8648-426a-a920-bd6883497f5b","Type":"ContainerDied","Data":"ce3cd02d6b351abb4d51341ed83cc5006b48209c2e0f0a552bdf0cc98db5afb7"}
Jul 26 16:46:53.570490 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.570339    2559 scope.go:117] "RemoveContainer" containerID="a97a1f78f13c6f4693c74a2fb5270ec1af8cd44af248a4a23c40e70e08eb8b64"
Jul 26 16:46:53.571553 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.571527    2559 generic.go:356] "Generic (PLEG): container finished" podID="144f8c54-ddf6-45b7-a63e-867a84f27598" containerID="aa87788c2c0433f4f13efbf0b4bed5d159ddeeb261fb28931b4fee4ef93d4520" exitCode=0
Jul 26 16:46:53.571667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.571598    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"
Jul 26 16:46:53.571667 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.571559    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9" event={"ID":"144f8c54-ddf6-45b7-a63e-867a84f27598","Type":"ContainerDied","Data":"aa87788c2c0433f4f13efbf0b4bed5d159ddeeb261fb28931b4fee4ef93d4520"}
Jul 26 16:46:53.571795 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.571683    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9" event={"ID":"144f8c54-ddf6-45b7-a63e-867a84f27598","Type":"ContainerDied","Data":"b6211b81a78c0ddcb614aadc141c47c0b20436b5d00fe2dfd4fb4f82b57b1468"}
Jul 26 16:46:53.572995 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.572972    2559 generic.go:356] "Generic (PLEG): container finished" podID="fdbca61b-a629-4e3b-8638-6d35ef661f61" containerID="3857564a5ab17c006ebd0280c4f762acbd28dc15c041a358bf75f03d15d4c43a" exitCode=0
Jul 26 16:46:53.573105 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.573008    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"
Jul 26 16:46:53.573105 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.573032    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k" event={"ID":"fdbca61b-a629-4e3b-8638-6d35ef661f61","Type":"ContainerDied","Data":"3857564a5ab17c006ebd0280c4f762acbd28dc15c041a358bf75f03d15d4c43a"}
Jul 26 16:46:53.573105 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.573071    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k" event={"ID":"fdbca61b-a629-4e3b-8638-6d35ef661f61","Type":"ContainerDied","Data":"1199d598fe88e9a7cc3382958a42db3d371b5f3f77c8ed51efac19f1b91aad7d"}
Jul 26 16:46:53.579962 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.579941    2559 scope.go:117] "RemoveContainer" containerID="a97a1f78f13c6f4693c74a2fb5270ec1af8cd44af248a4a23c40e70e08eb8b64"
Jul 26 16:46:53.580358 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:46:53.580337    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a97a1f78f13c6f4693c74a2fb5270ec1af8cd44af248a4a23c40e70e08eb8b64\": container with ID starting with a97a1f78f13c6f4693c74a2fb5270ec1af8cd44af248a4a23c40e70e08eb8b64 not found: ID does not exist" containerID="a97a1f78f13c6f4693c74a2fb5270ec1af8cd44af248a4a23c40e70e08eb8b64"
Jul 26 16:46:53.580445 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.580365    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a97a1f78f13c6f4693c74a2fb5270ec1af8cd44af248a4a23c40e70e08eb8b64"} err="failed to get container status \"a97a1f78f13c6f4693c74a2fb5270ec1af8cd44af248a4a23c40e70e08eb8b64\": rpc error: code = NotFound desc = could not find container \"a97a1f78f13c6f4693c74a2fb5270ec1af8cd44af248a4a23c40e70e08eb8b64\": container with ID starting with a97a1f78f13c6f4693c74a2fb5270ec1af8cd44af248a4a23c40e70e08eb8b64 not found: ID does not exist"
Jul 26 16:46:53.580445 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.580387    2559 scope.go:117] "RemoveContainer" containerID="aa87788c2c0433f4f13efbf0b4bed5d159ddeeb261fb28931b4fee4ef93d4520"
Jul 26 16:46:53.589036 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.589020    2559 scope.go:117] "RemoveContainer" containerID="aa87788c2c0433f4f13efbf0b4bed5d159ddeeb261fb28931b4fee4ef93d4520"
Jul 26 16:46:53.589307 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:46:53.589291    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa87788c2c0433f4f13efbf0b4bed5d159ddeeb261fb28931b4fee4ef93d4520\": container with ID starting with aa87788c2c0433f4f13efbf0b4bed5d159ddeeb261fb28931b4fee4ef93d4520 not found: ID does not exist" containerID="aa87788c2c0433f4f13efbf0b4bed5d159ddeeb261fb28931b4fee4ef93d4520"
Jul 26 16:46:53.589379 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.589312    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa87788c2c0433f4f13efbf0b4bed5d159ddeeb261fb28931b4fee4ef93d4520"} err="failed to get container status \"aa87788c2c0433f4f13efbf0b4bed5d159ddeeb261fb28931b4fee4ef93d4520\": rpc error: code = NotFound desc = could not find container \"aa87788c2c0433f4f13efbf0b4bed5d159ddeeb261fb28931b4fee4ef93d4520\": container with ID starting with aa87788c2c0433f4f13efbf0b4bed5d159ddeeb261fb28931b4fee4ef93d4520 not found: ID does not exist"
Jul 26 16:46:53.589379 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.589327    2559 scope.go:117] "RemoveContainer" containerID="3857564a5ab17c006ebd0280c4f762acbd28dc15c041a358bf75f03d15d4c43a"
Jul 26 16:46:53.597092 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.597067    2559 scope.go:117] "RemoveContainer" containerID="3857564a5ab17c006ebd0280c4f762acbd28dc15c041a358bf75f03d15d4c43a"
Jul 26 16:46:53.597353 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:46:53.597337    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3857564a5ab17c006ebd0280c4f762acbd28dc15c041a358bf75f03d15d4c43a\": container with ID starting with 3857564a5ab17c006ebd0280c4f762acbd28dc15c041a358bf75f03d15d4c43a not found: ID does not exist" containerID="3857564a5ab17c006ebd0280c4f762acbd28dc15c041a358bf75f03d15d4c43a"
Jul 26 16:46:53.597406 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.597358    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3857564a5ab17c006ebd0280c4f762acbd28dc15c041a358bf75f03d15d4c43a"} err="failed to get container status \"3857564a5ab17c006ebd0280c4f762acbd28dc15c041a358bf75f03d15d4c43a\": rpc error: code = NotFound desc = could not find container \"3857564a5ab17c006ebd0280c4f762acbd28dc15c041a358bf75f03d15d4c43a\": container with ID starting with 3857564a5ab17c006ebd0280c4f762acbd28dc15c041a358bf75f03d15d4c43a not found: ID does not exist"
Jul 26 16:46:53.597910 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.597893    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"]
Jul 26 16:46:53.602715 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.602694    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-6a9b62-75d85b65d4-jwp5k"]
Jul 26 16:46:53.612027 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.611999    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"]
Jul 26 16:46:53.618069 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.618047    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6a9b62-66b57d98b-tkx4n"]
Jul 26 16:46:53.631479 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.631458    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"]
Jul 26 16:46:53.634720 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.634700    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6a9b62-85f457ddcb-pt5h9"]
Jul 26 16:46:53.638013 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.637996    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8ed48bb-8648-426a-a920-bd6883497f5b-openshift-service-ca\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:46:53.638095 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.638015    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8ed48bb-8648-426a-a920-bd6883497f5b-maas-api-tls\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:46:53.638095 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:53.638025    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52pgk\" (UniqueName: \"kubernetes.io/projected/f8ed48bb-8648-426a-a920-bd6883497f5b-kube-api-access-52pgk\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:46:54.955680 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:54.955647    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="144f8c54-ddf6-45b7-a63e-867a84f27598" path="/var/lib/kubelet/pods/144f8c54-ddf6-45b7-a63e-867a84f27598/volumes"
Jul 26 16:46:54.956060 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:54.955932    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1e813e7-15ff-4899-928a-46abec475787" path="/var/lib/kubelet/pods/b1e813e7-15ff-4899-928a-46abec475787/volumes"
Jul 26 16:46:54.956254 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:54.956241    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8ed48bb-8648-426a-a920-bd6883497f5b" path="/var/lib/kubelet/pods/f8ed48bb-8648-426a-a920-bd6883497f5b/volumes"
Jul 26 16:46:54.956557 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:54.956546    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdbca61b-a629-4e3b-8638-6d35ef661f61" path="/var/lib/kubelet/pods/fdbca61b-a629-4e3b-8638-6d35ef661f61/volumes"
Jul 26 16:46:57.682116 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:57.682035    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:46:58.047097 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:46:58.047061    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:03.922155 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:03.922105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:04.029453 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:04.029424    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:04.201895 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:04.201853    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:04.415156 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:04.415107    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:04.757959 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:04.757931    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:05.086903 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:05.086808    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:05.243220 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:05.243188    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:07.905646 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:07.905616    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:08.003451 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.003412    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:08.148979 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.148941    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"]
Jul 26 16:47:08.149359 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149344    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8ed48bb-8648-426a-a920-bd6883497f5b" containerName="maas-api"
Jul 26 16:47:08.149359 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149359    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8ed48bb-8648-426a-a920-bd6883497f5b" containerName="maas-api"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149376    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84f710d4-772e-4064-9037-00644e1f6bbe" containerName="payload-pre-processing"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149383    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="84f710d4-772e-4064-9037-00644e1f6bbe" containerName="payload-pre-processing"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149397    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e813e7-15ff-4899-928a-46abec475787" containerName="cleanup"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149402    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e813e7-15ff-4899-928a-46abec475787" containerName="cleanup"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149411    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a2b38e9-c25e-4eb0-a735-b330b2f59288" containerName="payload-processing"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149416    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a2b38e9-c25e-4eb0-a735-b330b2f59288" containerName="payload-processing"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149423    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="144f8c54-ddf6-45b7-a63e-867a84f27598" containerName="payload-pre-processing"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149429    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="144f8c54-ddf6-45b7-a63e-867a84f27598" containerName="payload-pre-processing"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149435    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdbca61b-a629-4e3b-8638-6d35ef661f61" containerName="payload-processing"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149440    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdbca61b-a629-4e3b-8638-6d35ef661f61" containerName="payload-processing"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149452    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717dde04-e03f-49e7-8489-e8a70b89fc06" containerName="cleanup"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149457    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="717dde04-e03f-49e7-8489-e8a70b89fc06" containerName="cleanup"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149514    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="144f8c54-ddf6-45b7-a63e-867a84f27598" containerName="payload-pre-processing"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149523    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8ed48bb-8648-426a-a920-bd6883497f5b" containerName="maas-api"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149530    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1e813e7-15ff-4899-928a-46abec475787" containerName="cleanup"
Jul 26 16:47:08.149528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149537    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="84f710d4-772e-4064-9037-00644e1f6bbe" containerName="payload-pre-processing"
Jul 26 16:47:08.150444 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149544    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdbca61b-a629-4e3b-8638-6d35ef661f61" containerName="payload-processing"
Jul 26 16:47:08.150444 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149550    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a2b38e9-c25e-4eb0-a735-b330b2f59288" containerName="payload-processing"
Jul 26 16:47:08.150444 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.149556    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="717dde04-e03f-49e7-8489-e8a70b89fc06" containerName="cleanup"
Jul 26 16:47:08.154626 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.154606    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:08.157020 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.156962    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-5425d5-serving-cert\""
Jul 26 16:47:08.157106 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.157039    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c6ndf\""
Jul 26 16:47:08.164341 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.164318    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"]
Jul 26 16:47:08.185561 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.185535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:08.266242 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.266216    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e17c82a6-22af-472c-ad97-fc0af46d2a03-maas-api-tls\") pod \"maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct\" (UID: \"e17c82a6-22af-472c-ad97-fc0af46d2a03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:08.266366 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.266261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e17c82a6-22af-472c-ad97-fc0af46d2a03-openshift-service-ca\") pod \"maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct\" (UID: \"e17c82a6-22af-472c-ad97-fc0af46d2a03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:08.266366 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.266317    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7x8n\" (UniqueName: \"kubernetes.io/projected/e17c82a6-22af-472c-ad97-fc0af46d2a03-kube-api-access-m7x8n\") pod \"maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct\" (UID: \"e17c82a6-22af-472c-ad97-fc0af46d2a03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:08.367267 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.367238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e17c82a6-22af-472c-ad97-fc0af46d2a03-maas-api-tls\") pod \"maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct\" (UID: \"e17c82a6-22af-472c-ad97-fc0af46d2a03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:08.367403 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.367290    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e17c82a6-22af-472c-ad97-fc0af46d2a03-openshift-service-ca\") pod \"maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct\" (UID: \"e17c82a6-22af-472c-ad97-fc0af46d2a03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:08.367403 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.367329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7x8n\" (UniqueName: \"kubernetes.io/projected/e17c82a6-22af-472c-ad97-fc0af46d2a03-kube-api-access-m7x8n\") pod \"maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct\" (UID: \"e17c82a6-22af-472c-ad97-fc0af46d2a03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:08.367403 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:47:08.367374    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-serving-cert: secret "maas-api-e2e-api-a-5425d5-serving-cert" not found
Jul 26 16:47:08.367570 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:47:08.367446    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17c82a6-22af-472c-ad97-fc0af46d2a03-maas-api-tls podName:e17c82a6-22af-472c-ad97-fc0af46d2a03 nodeName:}" failed. No retries permitted until 2026-07-26 16:47:08.867426943 +0000 UTC m=+2344.402126199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e17c82a6-22af-472c-ad97-fc0af46d2a03-maas-api-tls") pod "maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct" (UID: "e17c82a6-22af-472c-ad97-fc0af46d2a03") : secret "maas-api-e2e-api-a-5425d5-serving-cert" not found
Jul 26 16:47:08.367933 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.367913    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e17c82a6-22af-472c-ad97-fc0af46d2a03-openshift-service-ca\") pod \"maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct\" (UID: \"e17c82a6-22af-472c-ad97-fc0af46d2a03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:08.376135 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.376101    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7x8n\" (UniqueName: \"kubernetes.io/projected/e17c82a6-22af-472c-ad97-fc0af46d2a03-kube-api-access-m7x8n\") pod \"maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct\" (UID: \"e17c82a6-22af-472c-ad97-fc0af46d2a03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:08.525924 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.525894    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:08.683895 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.683851    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:08.779867 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.779764    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:08.790086 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.790059    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"]
Jul 26 16:47:08.793745 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.793728    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"
Jul 26 16:47:08.798319 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.798302    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-5425d5-dockercfg-rlzjv\""
Jul 26 16:47:08.798463 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.798448    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-5425d5\""
Jul 26 16:47:08.812761 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.812738    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"]
Jul 26 16:47:08.817963 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.817942    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"]
Jul 26 16:47:08.821270 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.821240    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"
Jul 26 16:47:08.830921 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.830902    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"]
Jul 26 16:47:08.871347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.871317    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phcjw\" (UniqueName: \"kubernetes.io/projected/6bee2577-029d-46a1-95b0-45a638e2820c-kube-api-access-phcjw\") pod \"payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2\" (UID: \"6bee2577-029d-46a1-95b0-45a638e2820c\") " pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"
Jul 26 16:47:08.871490 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.871365    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bee2577-029d-46a1-95b0-45a638e2820c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2\" (UID: \"6bee2577-029d-46a1-95b0-45a638e2820c\") " pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"
Jul 26 16:47:08.871490 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.871400    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x47nn\" (UniqueName: \"kubernetes.io/projected/429e2f5c-c91c-4554-826b-b60d62fb3717-kube-api-access-x47nn\") pod \"payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw\" (UID: \"429e2f5c-c91c-4554-826b-b60d62fb3717\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"
Jul 26 16:47:08.871490 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.871428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/429e2f5c-c91c-4554-826b-b60d62fb3717-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw\" (UID: \"429e2f5c-c91c-4554-826b-b60d62fb3717\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"
Jul 26 16:47:08.871652 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.871516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e17c82a6-22af-472c-ad97-fc0af46d2a03-maas-api-tls\") pod \"maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct\" (UID: \"e17c82a6-22af-472c-ad97-fc0af46d2a03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:08.873858 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.873838    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e17c82a6-22af-472c-ad97-fc0af46d2a03-maas-api-tls\") pod \"maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct\" (UID: \"e17c82a6-22af-472c-ad97-fc0af46d2a03\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:08.972552 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.972517    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phcjw\" (UniqueName: \"kubernetes.io/projected/6bee2577-029d-46a1-95b0-45a638e2820c-kube-api-access-phcjw\") pod \"payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2\" (UID: \"6bee2577-029d-46a1-95b0-45a638e2820c\") " pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"
Jul 26 16:47:08.972960 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.972569    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bee2577-029d-46a1-95b0-45a638e2820c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2\" (UID: \"6bee2577-029d-46a1-95b0-45a638e2820c\") " pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"
Jul 26 16:47:08.972960 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.972595    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x47nn\" (UniqueName: \"kubernetes.io/projected/429e2f5c-c91c-4554-826b-b60d62fb3717-kube-api-access-x47nn\") pod \"payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw\" (UID: \"429e2f5c-c91c-4554-826b-b60d62fb3717\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"
Jul 26 16:47:08.972960 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.972626    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/429e2f5c-c91c-4554-826b-b60d62fb3717-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw\" (UID: \"429e2f5c-c91c-4554-826b-b60d62fb3717\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"
Jul 26 16:47:08.973367 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.973334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bee2577-029d-46a1-95b0-45a638e2820c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2\" (UID: \"6bee2577-029d-46a1-95b0-45a638e2820c\") " pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"
Jul 26 16:47:08.973492 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.973410    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/429e2f5c-c91c-4554-826b-b60d62fb3717-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw\" (UID: \"429e2f5c-c91c-4554-826b-b60d62fb3717\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"
Jul 26 16:47:08.980471 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.980449    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x47nn\" (UniqueName: \"kubernetes.io/projected/429e2f5c-c91c-4554-826b-b60d62fb3717-kube-api-access-x47nn\") pod \"payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw\" (UID: \"429e2f5c-c91c-4554-826b-b60d62fb3717\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"
Jul 26 16:47:08.980584 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:08.980564    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phcjw\" (UniqueName: \"kubernetes.io/projected/6bee2577-029d-46a1-95b0-45a638e2820c-kube-api-access-phcjw\") pod \"payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2\" (UID: \"6bee2577-029d-46a1-95b0-45a638e2820c\") " pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"
Jul 26 16:47:09.066592 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.066521    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:09.104801 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.104777    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"
Jul 26 16:47:09.132406 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.132317    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"
Jul 26 16:47:09.218626 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.218598    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"]
Jul 26 16:47:09.222725 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:47:09.222685    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17c82a6_22af_472c_ad97_fc0af46d2a03.slice/crio-3b1fc691f069923af4acc84a92a052ea03a4b2fe9e07ac670197cc3417088577 WatchSource:0}: Error finding container 3b1fc691f069923af4acc84a92a052ea03a4b2fe9e07ac670197cc3417088577: Status 404 returned error can't find the container with id 3b1fc691f069923af4acc84a92a052ea03a4b2fe9e07ac670197cc3417088577
Jul 26 16:47:09.267929 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.267901    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"]
Jul 26 16:47:09.269846 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:47:09.269819    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod429e2f5c_c91c_4554_826b_b60d62fb3717.slice/crio-11e208e049cda2d932dd8c3fe097d195c1d335c21ee6800a7af2b853f83fb1c1 WatchSource:0}: Error finding container 11e208e049cda2d932dd8c3fe097d195c1d335c21ee6800a7af2b853f83fb1c1: Status 404 returned error can't find the container with id 11e208e049cda2d932dd8c3fe097d195c1d335c21ee6800a7af2b853f83fb1c1
Jul 26 16:47:09.302252 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.302226    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"]
Jul 26 16:47:09.304732 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:47:09.304709    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bee2577_029d_46a1_95b0_45a638e2820c.slice/crio-1513113494e2565a4f8527b8e7726140e5c6d90762950531572444ed13d364da WatchSource:0}: Error finding container 1513113494e2565a4f8527b8e7726140e5c6d90762950531572444ed13d364da: Status 404 returned error can't find the container with id 1513113494e2565a4f8527b8e7726140e5c6d90762950531572444ed13d364da
Jul 26 16:47:09.660461 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.660397    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2" event={"ID":"6bee2577-029d-46a1-95b0-45a638e2820c","Type":"ContainerStarted","Data":"84143c819c23d23279d8a4c42ae56b863e479bb0fe1f2baced290d042934e197"}
Jul 26 16:47:09.660554 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.660503    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2" event={"ID":"6bee2577-029d-46a1-95b0-45a638e2820c","Type":"ContainerStarted","Data":"1513113494e2565a4f8527b8e7726140e5c6d90762950531572444ed13d364da"}
Jul 26 16:47:09.660554 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.660544    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"
Jul 26 16:47:09.662564 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.662534    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw" event={"ID":"429e2f5c-c91c-4554-826b-b60d62fb3717","Type":"ContainerStarted","Data":"22994ed5e9126d6a0e8904d3a792672428405989a09d7a105eaa9550f393239a"}
Jul 26 16:47:09.662678 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.662590    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw" event={"ID":"429e2f5c-c91c-4554-826b-b60d62fb3717","Type":"ContainerStarted","Data":"11e208e049cda2d932dd8c3fe097d195c1d335c21ee6800a7af2b853f83fb1c1"}
Jul 26 16:47:09.662678 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.662645    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"
Jul 26 16:47:09.663973 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.663949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct" event={"ID":"e17c82a6-22af-472c-ad97-fc0af46d2a03","Type":"ContainerStarted","Data":"3b1fc691f069923af4acc84a92a052ea03a4b2fe9e07ac670197cc3417088577"}
Jul 26 16:47:09.677649 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.677603    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2" podStartSLOduration=1.6775897419999999 podStartE2EDuration="1.677589742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:47:09.675557467 +0000 UTC m=+2345.210256743" watchObservedRunningTime="2026-07-26 16:47:09.677589742 +0000 UTC m=+2345.212289017"
Jul 26 16:47:09.693625 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:09.693588    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw" podStartSLOduration=1.6935765919999999 podStartE2EDuration="1.693576592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:47:09.693382271 +0000 UTC m=+2345.228081546" watchObservedRunningTime="2026-07-26 16:47:09.693576592 +0000 UTC m=+2345.228275867"
Jul 26 16:47:10.670551 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:10.670504    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct" event={"ID":"e17c82a6-22af-472c-ad97-fc0af46d2a03","Type":"ContainerStarted","Data":"f7fd9f952102ccf7441482f5c8ba48eb8cf7264cd21952c289160af104dcffe0"}
Jul 26 16:47:10.670928 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:10.670895    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:10.690579 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:10.690534    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct" podStartSLOduration=2.275852897 podStartE2EDuration="2.690517986s" totalImagesPullingTime="414.665089ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:47:10.688483589 +0000 UTC m=+2346.223182863" watchObservedRunningTime="2026-07-26 16:47:10.690517986 +0000 UTC m=+2346.225217260"
Jul 26 16:47:12.511751 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:12.511719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:12.867017 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:12.866936    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:13.169588 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:13.169513    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:13.268895 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:13.268864    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:15.943003 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:15.942964    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:16.032198 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.032159    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:16.147291 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.147253    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:16.245509 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.245395    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:16.634881 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.634803    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:16.744378 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.744343    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:16.748574 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.748549    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"]
Jul 26 16:47:16.752228 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.752210    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"
Jul 26 16:47:16.754547 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.754526    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-ddd8f8\""
Jul 26 16:47:16.762446 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.762425    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"]
Jul 26 16:47:16.770941 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.770916    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"]
Jul 26 16:47:16.774687 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.774670    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"
Jul 26 16:47:16.777072 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.777049    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-ddd8f8-dockercfg-cwtll\""
Jul 26 16:47:16.786037 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.786017    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"]
Jul 26 16:47:16.839965 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.839930    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcmpc\" (UniqueName: \"kubernetes.io/projected/ade62f9b-3053-4600-9210-30ccd938c604-kube-api-access-wcmpc\") pod \"payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw\" (UID: \"ade62f9b-3053-4600-9210-30ccd938c604\") " pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"
Jul 26 16:47:16.840088 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.839976    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61432485-7948-4171-8cbc-4dee47b17170-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk\" (UID: \"61432485-7948-4171-8cbc-4dee47b17170\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"
Jul 26 16:47:16.840088 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.840004    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkd72\" (UniqueName: \"kubernetes.io/projected/61432485-7948-4171-8cbc-4dee47b17170-kube-api-access-lkd72\") pod \"payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk\" (UID: \"61432485-7948-4171-8cbc-4dee47b17170\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"
Jul 26 16:47:16.840088 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.840026    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade62f9b-3053-4600-9210-30ccd938c604-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw\" (UID: \"ade62f9b-3053-4600-9210-30ccd938c604\") " pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"
Jul 26 16:47:16.941199 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.941171    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcmpc\" (UniqueName: \"kubernetes.io/projected/ade62f9b-3053-4600-9210-30ccd938c604-kube-api-access-wcmpc\") pod \"payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw\" (UID: \"ade62f9b-3053-4600-9210-30ccd938c604\") " pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"
Jul 26 16:47:16.941341 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.941214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61432485-7948-4171-8cbc-4dee47b17170-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk\" (UID: \"61432485-7948-4171-8cbc-4dee47b17170\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"
Jul 26 16:47:16.941400 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.941333    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkd72\" (UniqueName: \"kubernetes.io/projected/61432485-7948-4171-8cbc-4dee47b17170-kube-api-access-lkd72\") pod \"payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk\" (UID: \"61432485-7948-4171-8cbc-4dee47b17170\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"
Jul 26 16:47:16.941400 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.941380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade62f9b-3053-4600-9210-30ccd938c604-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw\" (UID: \"ade62f9b-3053-4600-9210-30ccd938c604\") " pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"
Jul 26 16:47:16.941904 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.941886    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61432485-7948-4171-8cbc-4dee47b17170-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk\" (UID: \"61432485-7948-4171-8cbc-4dee47b17170\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"
Jul 26 16:47:16.942061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.942045    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade62f9b-3053-4600-9210-30ccd938c604-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw\" (UID: \"ade62f9b-3053-4600-9210-30ccd938c604\") " pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"
Jul 26 16:47:16.949634 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.949608    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcmpc\" (UniqueName: \"kubernetes.io/projected/ade62f9b-3053-4600-9210-30ccd938c604-kube-api-access-wcmpc\") pod \"payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw\" (UID: \"ade62f9b-3053-4600-9210-30ccd938c604\") " pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"
Jul 26 16:47:16.949999 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:16.949788    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkd72\" (UniqueName: \"kubernetes.io/projected/61432485-7948-4171-8cbc-4dee47b17170-kube-api-access-lkd72\") pod \"payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk\" (UID: \"61432485-7948-4171-8cbc-4dee47b17170\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"
Jul 26 16:47:17.064998 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:17.064963    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"
Jul 26 16:47:17.085040 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:17.085014    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"
Jul 26 16:47:17.232069 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:17.232044    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"]
Jul 26 16:47:17.234264 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:47:17.234236    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61432485_7948_4171_8cbc_4dee47b17170.slice/crio-59023bfa3319b73d1a0dad01ed9f6c0e0ab5a8207d6ec9f0006db6a2368e84aa WatchSource:0}: Error finding container 59023bfa3319b73d1a0dad01ed9f6c0e0ab5a8207d6ec9f0006db6a2368e84aa: Status 404 returned error can't find the container with id 59023bfa3319b73d1a0dad01ed9f6c0e0ab5a8207d6ec9f0006db6a2368e84aa
Jul 26 16:47:17.448976 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:17.448950    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"]
Jul 26 16:47:17.451249 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:47:17.451218    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade62f9b_3053_4600_9210_30ccd938c604.slice/crio-42bf585f59e6e601635d8b06ef87fc44b07673d18287a2b42cb650729872828c WatchSource:0}: Error finding container 42bf585f59e6e601635d8b06ef87fc44b07673d18287a2b42cb650729872828c: Status 404 returned error can't find the container with id 42bf585f59e6e601635d8b06ef87fc44b07673d18287a2b42cb650729872828c
Jul 26 16:47:17.686944 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:17.686916    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:17.708535 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:17.708501    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw" event={"ID":"ade62f9b-3053-4600-9210-30ccd938c604","Type":"ContainerStarted","Data":"97c1917d05bf380bf963ba6a1d74460467e16e0a9397ac32d476deafc9b94539"}
Jul 26 16:47:17.708696 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:17.708557    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw" event={"ID":"ade62f9b-3053-4600-9210-30ccd938c604","Type":"ContainerStarted","Data":"42bf585f59e6e601635d8b06ef87fc44b07673d18287a2b42cb650729872828c"}
Jul 26 16:47:17.708696 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:17.708591    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"
Jul 26 16:47:17.709953 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:17.709924    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk" event={"ID":"61432485-7948-4171-8cbc-4dee47b17170","Type":"ContainerStarted","Data":"926e9e4dfe55ed80a6f152f7eb4b3d2502152aac79b1543be77302f3f531170d"}
Jul 26 16:47:17.710043 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:17.709970    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk" event={"ID":"61432485-7948-4171-8cbc-4dee47b17170","Type":"ContainerStarted","Data":"59023bfa3319b73d1a0dad01ed9f6c0e0ab5a8207d6ec9f0006db6a2368e84aa"}
Jul 26 16:47:17.710043 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:17.709992    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"
Jul 26 16:47:17.732329 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:17.731545    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw" podStartSLOduration=1.731526568 podStartE2EDuration="1.731526568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:47:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:47:17.729823941 +0000 UTC m=+2353.264523217" watchObservedRunningTime="2026-07-26 16:47:17.731526568 +0000 UTC m=+2353.266225844"
Jul 26 16:47:17.749477 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:17.749391    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk" podStartSLOduration=1.749377908 podStartE2EDuration="1.749377908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:47:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:47:17.747746867 +0000 UTC m=+2353.282446180" watchObservedRunningTime="2026-07-26 16:47:17.749377908 +0000 UTC m=+2353.284077182"
Jul 26 16:47:20.425730 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:20.425695    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:20.672498 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:20.672470    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"
Jul 26 16:47:20.672855 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:20.672837    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"
Jul 26 16:47:28.719162 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:28.719113    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"
Jul 26 16:47:28.719679 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:28.719218    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"
Jul 26 16:47:44.255324 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.255291    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"]
Jul 26 16:47:44.255714 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.255490    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct" podUID="e17c82a6-22af-472c-ad97-fc0af46d2a03" containerName="maas-api" containerID="cri-o://f7fd9f952102ccf7441482f5c8ba48eb8cf7264cd21952c289160af104dcffe0" gracePeriod=30
Jul 26 16:47:44.281326 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.281290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:44.315703 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.315677    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"]
Jul 26 16:47:44.315890 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.315867    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2" podUID="6bee2577-029d-46a1-95b0-45a638e2820c" containerName="payload-processing" containerID="cri-o://84143c819c23d23279d8a4c42ae56b863e479bb0fe1f2baced290d042934e197" gracePeriod=30
Jul 26 16:47:44.325958 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.325928    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"]
Jul 26 16:47:44.326352 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.326209    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw" podUID="429e2f5c-c91c-4554-826b-b60d62fb3717" containerName="payload-pre-processing" containerID="cri-o://22994ed5e9126d6a0e8904d3a792672428405989a09d7a105eaa9550f393239a" gracePeriod=30
Jul 26 16:47:44.383826 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.383792    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:44.589658 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.589631    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:44.620238 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.620202    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"
Jul 26 16:47:44.629449 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.629423    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"
Jul 26 16:47:44.690051 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.690019    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e17c82a6-22af-472c-ad97-fc0af46d2a03-maas-api-tls\") pod \"e17c82a6-22af-472c-ad97-fc0af46d2a03\" (UID: \"e17c82a6-22af-472c-ad97-fc0af46d2a03\") "
Jul 26 16:47:44.690253 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.690103    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7x8n\" (UniqueName: \"kubernetes.io/projected/e17c82a6-22af-472c-ad97-fc0af46d2a03-kube-api-access-m7x8n\") pod \"e17c82a6-22af-472c-ad97-fc0af46d2a03\" (UID: \"e17c82a6-22af-472c-ad97-fc0af46d2a03\") "
Jul 26 16:47:44.690253 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.690150    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e17c82a6-22af-472c-ad97-fc0af46d2a03-openshift-service-ca\") pod \"e17c82a6-22af-472c-ad97-fc0af46d2a03\" (UID: \"e17c82a6-22af-472c-ad97-fc0af46d2a03\") "
Jul 26 16:47:44.690643 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.690611    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e17c82a6-22af-472c-ad97-fc0af46d2a03-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e17c82a6-22af-472c-ad97-fc0af46d2a03" (UID: "e17c82a6-22af-472c-ad97-fc0af46d2a03"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:47:44.690755 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.690730    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e17c82a6-22af-472c-ad97-fc0af46d2a03-openshift-service-ca\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:47:44.692151 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.692097    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e17c82a6-22af-472c-ad97-fc0af46d2a03-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e17c82a6-22af-472c-ad97-fc0af46d2a03" (UID: "e17c82a6-22af-472c-ad97-fc0af46d2a03"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:47:44.692274 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.692250    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e17c82a6-22af-472c-ad97-fc0af46d2a03-kube-api-access-m7x8n" (OuterVolumeSpecName: "kube-api-access-m7x8n") pod "e17c82a6-22af-472c-ad97-fc0af46d2a03" (UID: "e17c82a6-22af-472c-ad97-fc0af46d2a03"). InnerVolumeSpecName "kube-api-access-m7x8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:47:44.791937 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.791904    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bee2577-029d-46a1-95b0-45a638e2820c-plugins-config-volume\") pod \"6bee2577-029d-46a1-95b0-45a638e2820c\" (UID: \"6bee2577-029d-46a1-95b0-45a638e2820c\") "
Jul 26 16:47:44.792155 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.791959    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/429e2f5c-c91c-4554-826b-b60d62fb3717-plugins-config-volume\") pod \"429e2f5c-c91c-4554-826b-b60d62fb3717\" (UID: \"429e2f5c-c91c-4554-826b-b60d62fb3717\") "
Jul 26 16:47:44.792155 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.791978    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phcjw\" (UniqueName: \"kubernetes.io/projected/6bee2577-029d-46a1-95b0-45a638e2820c-kube-api-access-phcjw\") pod \"6bee2577-029d-46a1-95b0-45a638e2820c\" (UID: \"6bee2577-029d-46a1-95b0-45a638e2820c\") "
Jul 26 16:47:44.792155 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.792029    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x47nn\" (UniqueName: \"kubernetes.io/projected/429e2f5c-c91c-4554-826b-b60d62fb3717-kube-api-access-x47nn\") pod \"429e2f5c-c91c-4554-826b-b60d62fb3717\" (UID: \"429e2f5c-c91c-4554-826b-b60d62fb3717\") "
Jul 26 16:47:44.792380 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.792350    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e17c82a6-22af-472c-ad97-fc0af46d2a03-maas-api-tls\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:47:44.792489 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.792384    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7x8n\" (UniqueName: \"kubernetes.io/projected/e17c82a6-22af-472c-ad97-fc0af46d2a03-kube-api-access-m7x8n\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:47:44.792489 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.792413    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bee2577-029d-46a1-95b0-45a638e2820c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6bee2577-029d-46a1-95b0-45a638e2820c" (UID: "6bee2577-029d-46a1-95b0-45a638e2820c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:47:44.792489 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.792413    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/429e2f5c-c91c-4554-826b-b60d62fb3717-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "429e2f5c-c91c-4554-826b-b60d62fb3717" (UID: "429e2f5c-c91c-4554-826b-b60d62fb3717"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:47:44.794215 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.794194    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bee2577-029d-46a1-95b0-45a638e2820c-kube-api-access-phcjw" (OuterVolumeSpecName: "kube-api-access-phcjw") pod "6bee2577-029d-46a1-95b0-45a638e2820c" (UID: "6bee2577-029d-46a1-95b0-45a638e2820c"). InnerVolumeSpecName "kube-api-access-phcjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:47:44.794277 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.794201    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/429e2f5c-c91c-4554-826b-b60d62fb3717-kube-api-access-x47nn" (OuterVolumeSpecName: "kube-api-access-x47nn") pod "429e2f5c-c91c-4554-826b-b60d62fb3717" (UID: "429e2f5c-c91c-4554-826b-b60d62fb3717"). InnerVolumeSpecName "kube-api-access-x47nn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:47:44.858817 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.858713    2559 generic.go:356] "Generic (PLEG): container finished" podID="e17c82a6-22af-472c-ad97-fc0af46d2a03" containerID="f7fd9f952102ccf7441482f5c8ba48eb8cf7264cd21952c289160af104dcffe0" exitCode=0
Jul 26 16:47:44.858817 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.858752    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"
Jul 26 16:47:44.859041 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.858803    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct" event={"ID":"e17c82a6-22af-472c-ad97-fc0af46d2a03","Type":"ContainerDied","Data":"f7fd9f952102ccf7441482f5c8ba48eb8cf7264cd21952c289160af104dcffe0"}
Jul 26 16:47:44.859041 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.858859    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct" event={"ID":"e17c82a6-22af-472c-ad97-fc0af46d2a03","Type":"ContainerDied","Data":"3b1fc691f069923af4acc84a92a052ea03a4b2fe9e07ac670197cc3417088577"}
Jul 26 16:47:44.859041 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.858881    2559 scope.go:117] "RemoveContainer" containerID="f7fd9f952102ccf7441482f5c8ba48eb8cf7264cd21952c289160af104dcffe0"
Jul 26 16:47:44.860293 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.860269    2559 generic.go:356] "Generic (PLEG): container finished" podID="6bee2577-029d-46a1-95b0-45a638e2820c" containerID="84143c819c23d23279d8a4c42ae56b863e479bb0fe1f2baced290d042934e197" exitCode=0
Jul 26 16:47:44.860394 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.860316    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"
Jul 26 16:47:44.860394 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.860355    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2" event={"ID":"6bee2577-029d-46a1-95b0-45a638e2820c","Type":"ContainerDied","Data":"84143c819c23d23279d8a4c42ae56b863e479bb0fe1f2baced290d042934e197"}
Jul 26 16:47:44.860499 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.860398    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2" event={"ID":"6bee2577-029d-46a1-95b0-45a638e2820c","Type":"ContainerDied","Data":"1513113494e2565a4f8527b8e7726140e5c6d90762950531572444ed13d364da"}
Jul 26 16:47:44.861934 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.861914    2559 generic.go:356] "Generic (PLEG): container finished" podID="429e2f5c-c91c-4554-826b-b60d62fb3717" containerID="22994ed5e9126d6a0e8904d3a792672428405989a09d7a105eaa9550f393239a" exitCode=0
Jul 26 16:47:44.862052 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.861947    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"
Jul 26 16:47:44.862052 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.861979    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw" event={"ID":"429e2f5c-c91c-4554-826b-b60d62fb3717","Type":"ContainerDied","Data":"22994ed5e9126d6a0e8904d3a792672428405989a09d7a105eaa9550f393239a"}
Jul 26 16:47:44.862052 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.862045    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw" event={"ID":"429e2f5c-c91c-4554-826b-b60d62fb3717","Type":"ContainerDied","Data":"11e208e049cda2d932dd8c3fe097d195c1d335c21ee6800a7af2b853f83fb1c1"}
Jul 26 16:47:44.871405 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.871383    2559 scope.go:117] "RemoveContainer" containerID="f7fd9f952102ccf7441482f5c8ba48eb8cf7264cd21952c289160af104dcffe0"
Jul 26 16:47:44.871878 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:47:44.871851    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7fd9f952102ccf7441482f5c8ba48eb8cf7264cd21952c289160af104dcffe0\": container with ID starting with f7fd9f952102ccf7441482f5c8ba48eb8cf7264cd21952c289160af104dcffe0 not found: ID does not exist" containerID="f7fd9f952102ccf7441482f5c8ba48eb8cf7264cd21952c289160af104dcffe0"
Jul 26 16:47:44.871971 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.871891    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7fd9f952102ccf7441482f5c8ba48eb8cf7264cd21952c289160af104dcffe0"} err="failed to get container status \"f7fd9f952102ccf7441482f5c8ba48eb8cf7264cd21952c289160af104dcffe0\": rpc error: code = NotFound desc = could not find container \"f7fd9f952102ccf7441482f5c8ba48eb8cf7264cd21952c289160af104dcffe0\": container with ID starting with f7fd9f952102ccf7441482f5c8ba48eb8cf7264cd21952c289160af104dcffe0 not found: ID does not exist"
Jul 26 16:47:44.871971 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.871917    2559 scope.go:117] "RemoveContainer" containerID="84143c819c23d23279d8a4c42ae56b863e479bb0fe1f2baced290d042934e197"
Jul 26 16:47:44.883602 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.883584    2559 scope.go:117] "RemoveContainer" containerID="84143c819c23d23279d8a4c42ae56b863e479bb0fe1f2baced290d042934e197"
Jul 26 16:47:44.883876 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:47:44.883852    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84143c819c23d23279d8a4c42ae56b863e479bb0fe1f2baced290d042934e197\": container with ID starting with 84143c819c23d23279d8a4c42ae56b863e479bb0fe1f2baced290d042934e197 not found: ID does not exist" containerID="84143c819c23d23279d8a4c42ae56b863e479bb0fe1f2baced290d042934e197"
Jul 26 16:47:44.883940 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.883889    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84143c819c23d23279d8a4c42ae56b863e479bb0fe1f2baced290d042934e197"} err="failed to get container status \"84143c819c23d23279d8a4c42ae56b863e479bb0fe1f2baced290d042934e197\": rpc error: code = NotFound desc = could not find container \"84143c819c23d23279d8a4c42ae56b863e479bb0fe1f2baced290d042934e197\": container with ID starting with 84143c819c23d23279d8a4c42ae56b863e479bb0fe1f2baced290d042934e197 not found: ID does not exist"
Jul 26 16:47:44.883940 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.883913    2559 scope.go:117] "RemoveContainer" containerID="22994ed5e9126d6a0e8904d3a792672428405989a09d7a105eaa9550f393239a"
Jul 26 16:47:44.891874 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.891858    2559 scope.go:117] "RemoveContainer" containerID="22994ed5e9126d6a0e8904d3a792672428405989a09d7a105eaa9550f393239a"
Jul 26 16:47:44.892119 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:47:44.892102    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22994ed5e9126d6a0e8904d3a792672428405989a09d7a105eaa9550f393239a\": container with ID starting with 22994ed5e9126d6a0e8904d3a792672428405989a09d7a105eaa9550f393239a not found: ID does not exist" containerID="22994ed5e9126d6a0e8904d3a792672428405989a09d7a105eaa9550f393239a"
Jul 26 16:47:44.892205 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.892138    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22994ed5e9126d6a0e8904d3a792672428405989a09d7a105eaa9550f393239a"} err="failed to get container status \"22994ed5e9126d6a0e8904d3a792672428405989a09d7a105eaa9550f393239a\": rpc error: code = NotFound desc = could not find container \"22994ed5e9126d6a0e8904d3a792672428405989a09d7a105eaa9550f393239a\": container with ID starting with 22994ed5e9126d6a0e8904d3a792672428405989a09d7a105eaa9550f393239a not found: ID does not exist"
Jul 26 16:47:44.893490 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.893473    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x47nn\" (UniqueName: \"kubernetes.io/projected/429e2f5c-c91c-4554-826b-b60d62fb3717-kube-api-access-x47nn\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:47:44.893556 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.893494    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bee2577-029d-46a1-95b0-45a638e2820c-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:47:44.893556 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.893503    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/429e2f5c-c91c-4554-826b-b60d62fb3717-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:47:44.893556 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.893511    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phcjw\" (UniqueName: \"kubernetes.io/projected/6bee2577-029d-46a1-95b0-45a638e2820c-kube-api-access-phcjw\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:47:44.900417 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.900395    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"]
Jul 26 16:47:44.904541 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.904522    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-5425d5-866bb57988-j9pzw"]
Jul 26 16:47:44.916256 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.916227    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"]
Jul 26 16:47:44.919586 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.919563    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5425d5-55db5d9d-9s5j2"]
Jul 26 16:47:44.931367 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.931345    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"]
Jul 26 16:47:44.936283 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.936264    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5425d5-7885fb4bd5-n5mct"]
Jul 26 16:47:44.955305 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.955283    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="429e2f5c-c91c-4554-826b-b60d62fb3717" path="/var/lib/kubelet/pods/429e2f5c-c91c-4554-826b-b60d62fb3717/volumes"
Jul 26 16:47:44.955666 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.955653    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bee2577-029d-46a1-95b0-45a638e2820c" path="/var/lib/kubelet/pods/6bee2577-029d-46a1-95b0-45a638e2820c/volumes"
Jul 26 16:47:44.955992 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:44.955980    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e17c82a6-22af-472c-ad97-fc0af46d2a03" path="/var/lib/kubelet/pods/e17c82a6-22af-472c-ad97-fc0af46d2a03/volumes"
Jul 26 16:47:48.542157 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:48.542103    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:48.922363 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:48.922286    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:54.754445 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:54.754413    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:54.853426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:54.853398    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:55.024178 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:55.024083    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:47:55.253117 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:47:55.253071    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:05.134948 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:05.134917    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:48:05.138452 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:05.138417    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:48:08.398154 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:08.398107    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:09.649050 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:09.649015    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:11.006233 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.006204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:11.038245 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.038217    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"]
Jul 26 16:48:11.038426 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.038396    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw" podUID="ade62f9b-3053-4600-9210-30ccd938c604" containerName="payload-processing" containerID="cri-o://97c1917d05bf380bf963ba6a1d74460467e16e0a9397ac32d476deafc9b94539" gracePeriod=30
Jul 26 16:48:11.048368 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.048346    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"]
Jul 26 16:48:11.048561 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.048536    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk" podUID="61432485-7948-4171-8cbc-4dee47b17170" containerName="payload-pre-processing" containerID="cri-o://926e9e4dfe55ed80a6f152f7eb4b3d2502152aac79b1543be77302f3f531170d" gracePeriod=30
Jul 26 16:48:11.104583 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.104555    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:11.205164 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.205025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:11.297524 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.297500    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"
Jul 26 16:48:11.332433 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.332410    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"
Jul 26 16:48:11.415189 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.415159    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcmpc\" (UniqueName: \"kubernetes.io/projected/ade62f9b-3053-4600-9210-30ccd938c604-kube-api-access-wcmpc\") pod \"ade62f9b-3053-4600-9210-30ccd938c604\" (UID: \"ade62f9b-3053-4600-9210-30ccd938c604\") "
Jul 26 16:48:11.415189 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.415194    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61432485-7948-4171-8cbc-4dee47b17170-plugins-config-volume\") pod \"61432485-7948-4171-8cbc-4dee47b17170\" (UID: \"61432485-7948-4171-8cbc-4dee47b17170\") "
Jul 26 16:48:11.415375 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.415231    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade62f9b-3053-4600-9210-30ccd938c604-plugins-config-volume\") pod \"ade62f9b-3053-4600-9210-30ccd938c604\" (UID: \"ade62f9b-3053-4600-9210-30ccd938c604\") "
Jul 26 16:48:11.415375 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.415324    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkd72\" (UniqueName: \"kubernetes.io/projected/61432485-7948-4171-8cbc-4dee47b17170-kube-api-access-lkd72\") pod \"61432485-7948-4171-8cbc-4dee47b17170\" (UID: \"61432485-7948-4171-8cbc-4dee47b17170\") "
Jul 26 16:48:11.415671 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.415638    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61432485-7948-4171-8cbc-4dee47b17170-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "61432485-7948-4171-8cbc-4dee47b17170" (UID: "61432485-7948-4171-8cbc-4dee47b17170"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:48:11.415766 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.415639    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ade62f9b-3053-4600-9210-30ccd938c604-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ade62f9b-3053-4600-9210-30ccd938c604" (UID: "ade62f9b-3053-4600-9210-30ccd938c604"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:48:11.417386 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.417355    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ade62f9b-3053-4600-9210-30ccd938c604-kube-api-access-wcmpc" (OuterVolumeSpecName: "kube-api-access-wcmpc") pod "ade62f9b-3053-4600-9210-30ccd938c604" (UID: "ade62f9b-3053-4600-9210-30ccd938c604"). InnerVolumeSpecName "kube-api-access-wcmpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:48:11.417471 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.417423    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61432485-7948-4171-8cbc-4dee47b17170-kube-api-access-lkd72" (OuterVolumeSpecName: "kube-api-access-lkd72") pod "61432485-7948-4171-8cbc-4dee47b17170" (UID: "61432485-7948-4171-8cbc-4dee47b17170"). InnerVolumeSpecName "kube-api-access-lkd72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:48:11.516120 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.516056    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcmpc\" (UniqueName: \"kubernetes.io/projected/ade62f9b-3053-4600-9210-30ccd938c604-kube-api-access-wcmpc\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:48:11.516120 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.516081    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61432485-7948-4171-8cbc-4dee47b17170-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:48:11.516120 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.516091    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade62f9b-3053-4600-9210-30ccd938c604-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:48:11.516120 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:11.516099    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkd72\" (UniqueName: \"kubernetes.io/projected/61432485-7948-4171-8cbc-4dee47b17170-kube-api-access-lkd72\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:48:12.011347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.011310    2559 generic.go:356] "Generic (PLEG): container finished" podID="ade62f9b-3053-4600-9210-30ccd938c604" containerID="97c1917d05bf380bf963ba6a1d74460467e16e0a9397ac32d476deafc9b94539" exitCode=0
Jul 26 16:48:12.011872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.011364    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"
Jul 26 16:48:12.011872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.011397    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw" event={"ID":"ade62f9b-3053-4600-9210-30ccd938c604","Type":"ContainerDied","Data":"97c1917d05bf380bf963ba6a1d74460467e16e0a9397ac32d476deafc9b94539"}
Jul 26 16:48:12.011872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.011486    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw" event={"ID":"ade62f9b-3053-4600-9210-30ccd938c604","Type":"ContainerDied","Data":"42bf585f59e6e601635d8b06ef87fc44b07673d18287a2b42cb650729872828c"}
Jul 26 16:48:12.011872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.011516    2559 scope.go:117] "RemoveContainer" containerID="97c1917d05bf380bf963ba6a1d74460467e16e0a9397ac32d476deafc9b94539"
Jul 26 16:48:12.012782 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.012759    2559 generic.go:356] "Generic (PLEG): container finished" podID="61432485-7948-4171-8cbc-4dee47b17170" containerID="926e9e4dfe55ed80a6f152f7eb4b3d2502152aac79b1543be77302f3f531170d" exitCode=0
Jul 26 16:48:12.012892 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.012801    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk" event={"ID":"61432485-7948-4171-8cbc-4dee47b17170","Type":"ContainerDied","Data":"926e9e4dfe55ed80a6f152f7eb4b3d2502152aac79b1543be77302f3f531170d"}
Jul 26 16:48:12.012892 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.012807    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"
Jul 26 16:48:12.012892 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.012832    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk" event={"ID":"61432485-7948-4171-8cbc-4dee47b17170","Type":"ContainerDied","Data":"59023bfa3319b73d1a0dad01ed9f6c0e0ab5a8207d6ec9f0006db6a2368e84aa"}
Jul 26 16:48:12.021354 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.021337    2559 scope.go:117] "RemoveContainer" containerID="97c1917d05bf380bf963ba6a1d74460467e16e0a9397ac32d476deafc9b94539"
Jul 26 16:48:12.021627 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:48:12.021608    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97c1917d05bf380bf963ba6a1d74460467e16e0a9397ac32d476deafc9b94539\": container with ID starting with 97c1917d05bf380bf963ba6a1d74460467e16e0a9397ac32d476deafc9b94539 not found: ID does not exist" containerID="97c1917d05bf380bf963ba6a1d74460467e16e0a9397ac32d476deafc9b94539"
Jul 26 16:48:12.021685 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.021634    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97c1917d05bf380bf963ba6a1d74460467e16e0a9397ac32d476deafc9b94539"} err="failed to get container status \"97c1917d05bf380bf963ba6a1d74460467e16e0a9397ac32d476deafc9b94539\": rpc error: code = NotFound desc = could not find container \"97c1917d05bf380bf963ba6a1d74460467e16e0a9397ac32d476deafc9b94539\": container with ID starting with 97c1917d05bf380bf963ba6a1d74460467e16e0a9397ac32d476deafc9b94539 not found: ID does not exist"
Jul 26 16:48:12.021685 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.021654    2559 scope.go:117] "RemoveContainer" containerID="926e9e4dfe55ed80a6f152f7eb4b3d2502152aac79b1543be77302f3f531170d"
Jul 26 16:48:12.029548 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.029530    2559 scope.go:117] "RemoveContainer" containerID="926e9e4dfe55ed80a6f152f7eb4b3d2502152aac79b1543be77302f3f531170d"
Jul 26 16:48:12.029781 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:48:12.029764    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"926e9e4dfe55ed80a6f152f7eb4b3d2502152aac79b1543be77302f3f531170d\": container with ID starting with 926e9e4dfe55ed80a6f152f7eb4b3d2502152aac79b1543be77302f3f531170d not found: ID does not exist" containerID="926e9e4dfe55ed80a6f152f7eb4b3d2502152aac79b1543be77302f3f531170d"
Jul 26 16:48:12.029827 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.029788    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"926e9e4dfe55ed80a6f152f7eb4b3d2502152aac79b1543be77302f3f531170d"} err="failed to get container status \"926e9e4dfe55ed80a6f152f7eb4b3d2502152aac79b1543be77302f3f531170d\": rpc error: code = NotFound desc = could not find container \"926e9e4dfe55ed80a6f152f7eb4b3d2502152aac79b1543be77302f3f531170d\": container with ID starting with 926e9e4dfe55ed80a6f152f7eb4b3d2502152aac79b1543be77302f3f531170d not found: ID does not exist"
Jul 26 16:48:12.035579 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.035558    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"]
Jul 26 16:48:12.041951 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.041927    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ddd8f8-6b45f7495b-b4vjk"]
Jul 26 16:48:12.056049 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.056000    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"]
Jul 26 16:48:12.058416 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.058392    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ddd8f8-6ccbdb45f8-x5sbw"]
Jul 26 16:48:12.955282 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.955253    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61432485-7948-4171-8cbc-4dee47b17170" path="/var/lib/kubelet/pods/61432485-7948-4171-8cbc-4dee47b17170/volumes"
Jul 26 16:48:12.955603 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:12.955590    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ade62f9b-3053-4600-9210-30ccd938c604" path="/var/lib/kubelet/pods/ade62f9b-3053-4600-9210-30ccd938c604/volumes"
Jul 26 16:48:15.445568 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:15.445537    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:15.841096 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:15.840985    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:21.897060 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:21.897026    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:21.967207 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:21.967183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:22.177682 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:22.177599    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:22.401332 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:22.401290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:22.736621 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:22.736590    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:23.097511 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:23.097427    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:23.188761 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:23.188730    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:26.516359 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.516317    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:26.654431 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.654400    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:26.673716 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.673688    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"]
Jul 26 16:48:26.674097 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674085    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61432485-7948-4171-8cbc-4dee47b17170" containerName="payload-pre-processing"
Jul 26 16:48:26.674158 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674100    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="61432485-7948-4171-8cbc-4dee47b17170" containerName="payload-pre-processing"
Jul 26 16:48:26.674158 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674112    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="429e2f5c-c91c-4554-826b-b60d62fb3717" containerName="payload-pre-processing"
Jul 26 16:48:26.674158 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674117    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="429e2f5c-c91c-4554-826b-b60d62fb3717" containerName="payload-pre-processing"
Jul 26 16:48:26.674158 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674140    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e17c82a6-22af-472c-ad97-fc0af46d2a03" containerName="maas-api"
Jul 26 16:48:26.674158 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674147    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e17c82a6-22af-472c-ad97-fc0af46d2a03" containerName="maas-api"
Jul 26 16:48:26.674324 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674164    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ade62f9b-3053-4600-9210-30ccd938c604" containerName="payload-processing"
Jul 26 16:48:26.674324 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674169    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ade62f9b-3053-4600-9210-30ccd938c604" containerName="payload-processing"
Jul 26 16:48:26.674324 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674179    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bee2577-029d-46a1-95b0-45a638e2820c" containerName="payload-processing"
Jul 26 16:48:26.674324 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674184    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bee2577-029d-46a1-95b0-45a638e2820c" containerName="payload-processing"
Jul 26 16:48:26.674324 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674249    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e17c82a6-22af-472c-ad97-fc0af46d2a03" containerName="maas-api"
Jul 26 16:48:26.674324 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674258    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="61432485-7948-4171-8cbc-4dee47b17170" containerName="payload-pre-processing"
Jul 26 16:48:26.674324 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674264    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="429e2f5c-c91c-4554-826b-b60d62fb3717" containerName="payload-pre-processing"
Jul 26 16:48:26.674324 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674270    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bee2577-029d-46a1-95b0-45a638e2820c" containerName="payload-processing"
Jul 26 16:48:26.674324 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.674276    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ade62f9b-3053-4600-9210-30ccd938c604" containerName="payload-processing"
Jul 26 16:48:26.678864 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.678849    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 16:48:26.683975 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.683954    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-1b2072-serving-cert\""
Jul 26 16:48:26.683975 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.683964    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c6ndf\""
Jul 26 16:48:26.702327 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.702305    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"]
Jul 26 16:48:26.764900 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.764866    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:26.842148 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.842059    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm\" (UID: \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 16:48:26.842148 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.842108    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-maas-api-tls\") pod \"maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm\" (UID: \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 16:48:26.842311 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.842202    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4frm4\" (UniqueName: \"kubernetes.io/projected/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-kube-api-access-4frm4\") pod \"maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm\" (UID: \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 16:48:26.942940 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.942913    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm\" (UID: \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 16:48:26.943078 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.942957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-maas-api-tls\") pod \"maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm\" (UID: \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 16:48:26.943078 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.942997    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4frm4\" (UniqueName: \"kubernetes.io/projected/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-kube-api-access-4frm4\") pod \"maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm\" (UID: \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 16:48:26.943549 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.943528    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm\" (UID: \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 16:48:26.945307 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.945286    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-maas-api-tls\") pod \"maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm\" (UID: \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 16:48:26.960140 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.960101    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4frm4\" (UniqueName: \"kubernetes.io/projected/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-kube-api-access-4frm4\") pod \"maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm\" (UID: \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 16:48:26.989013 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:26.988991    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 16:48:27.026593 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.026554    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:27.132295 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.132270    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"]
Jul 26 16:48:27.134472 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:48:27.134447    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb460cd5b_9bc6_41a4_bba6_ea97ba8f97a6.slice/crio-70e37675d7212ed64bd3a40b843c55a6d4391b12571fea3d1a2a3031e9796c3a WatchSource:0}: Error finding container 70e37675d7212ed64bd3a40b843c55a6d4391b12571fea3d1a2a3031e9796c3a: Status 404 returned error can't find the container with id 70e37675d7212ed64bd3a40b843c55a6d4391b12571fea3d1a2a3031e9796c3a
Jul 26 16:48:27.456467 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.456420    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:27.550769 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.550732    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:27.631326 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.631293    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"]
Jul 26 16:48:27.636102 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.636084    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"
Jul 26 16:48:27.640038 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.640021    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-1b2072-dockercfg-8l49q\""
Jul 26 16:48:27.640709 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.640694    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-1b2072\""
Jul 26 16:48:27.648014 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.647990    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"]
Jul 26 16:48:27.751285 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.751151    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrdq5\" (UniqueName: \"kubernetes.io/projected/4bcaca0f-465a-4810-b596-4dd74e7eb270-kube-api-access-qrdq5\") pod \"payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv\" (UID: \"4bcaca0f-465a-4810-b596-4dd74e7eb270\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"
Jul 26 16:48:27.751285 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.751215    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bcaca0f-465a-4810-b596-4dd74e7eb270-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv\" (UID: \"4bcaca0f-465a-4810-b596-4dd74e7eb270\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"
Jul 26 16:48:27.851808 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.851778    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrdq5\" (UniqueName: \"kubernetes.io/projected/4bcaca0f-465a-4810-b596-4dd74e7eb270-kube-api-access-qrdq5\") pod \"payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv\" (UID: \"4bcaca0f-465a-4810-b596-4dd74e7eb270\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"
Jul 26 16:48:27.851808 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.851813    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bcaca0f-465a-4810-b596-4dd74e7eb270-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv\" (UID: \"4bcaca0f-465a-4810-b596-4dd74e7eb270\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"
Jul 26 16:48:27.852562 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.852542    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bcaca0f-465a-4810-b596-4dd74e7eb270-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv\" (UID: \"4bcaca0f-465a-4810-b596-4dd74e7eb270\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"
Jul 26 16:48:27.860337 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.860310    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrdq5\" (UniqueName: \"kubernetes.io/projected/4bcaca0f-465a-4810-b596-4dd74e7eb270-kube-api-access-qrdq5\") pod \"payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv\" (UID: \"4bcaca0f-465a-4810-b596-4dd74e7eb270\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"
Jul 26 16:48:27.947056 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:27.947027    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"
Jul 26 16:48:28.090005 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:28.089832    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"]
Jul 26 16:48:28.093027 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:48:28.093000    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bcaca0f_465a_4810_b596_4dd74e7eb270.slice/crio-fd2e3f599ec88b8476aa75ae33d28c4b2c97aaaca60a9be39da84ebb5f9fbc1a WatchSource:0}: Error finding container fd2e3f599ec88b8476aa75ae33d28c4b2c97aaaca60a9be39da84ebb5f9fbc1a: Status 404 returned error can't find the container with id fd2e3f599ec88b8476aa75ae33d28c4b2c97aaaca60a9be39da84ebb5f9fbc1a
Jul 26 16:48:28.099703 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:28.099680    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm" event={"ID":"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6","Type":"ContainerStarted","Data":"83e29612c2e3a4336e56747d3c93f2f89117e67cd217a7068a8784415ef8bb68"}
Jul 26 16:48:28.099791 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:28.099723    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm" event={"ID":"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6","Type":"ContainerStarted","Data":"70e37675d7212ed64bd3a40b843c55a6d4391b12571fea3d1a2a3031e9796c3a"}
Jul 26 16:48:28.101342 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:28.101320    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 16:48:28.151842 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:28.151797    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm" podStartSLOduration=1.410801446 podStartE2EDuration="2.151780031s" totalImagesPullingTime="740.978585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:48:28.148576328 +0000 UTC m=+2423.683275600" watchObservedRunningTime="2026-07-26 16:48:28.151780031 +0000 UTC m=+2423.686479305"
Jul 26 16:48:29.105548 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:29.105512    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv" event={"ID":"4bcaca0f-465a-4810-b596-4dd74e7eb270","Type":"ContainerStarted","Data":"89e12dc2c4ed891e1837323b5b54e75206d7c41d9a54e44b0141877a306ad211"}
Jul 26 16:48:29.105964 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:29.105570    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv" event={"ID":"4bcaca0f-465a-4810-b596-4dd74e7eb270","Type":"ContainerStarted","Data":"fd2e3f599ec88b8476aa75ae33d28c4b2c97aaaca60a9be39da84ebb5f9fbc1a"}
Jul 26 16:48:29.105964 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:29.105754    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"
Jul 26 16:48:29.125668 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:29.125621    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv" podStartSLOduration=2.1256066000000002 podStartE2EDuration="2.1256066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:48:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:48:29.123488822 +0000 UTC m=+2424.658188098" watchObservedRunningTime="2026-07-26 16:48:29.1256066 +0000 UTC m=+2424.660305875"
Jul 26 16:48:30.892136 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:30.892102    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:31.228218 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:31.228184    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:31.574233 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:31.574143    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:32.012699 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:32.012672    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:34.111347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:34.111285    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 16:48:34.452110 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:34.452082    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:34.547282 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:34.547257    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:35.190833 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:35.190800    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:35.719492 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:35.719465    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:35.854078 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:35.854044    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:35.949796 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:35.949766    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"]
Jul 26 16:48:35.953633 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:35.953611    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"
Jul 26 16:48:35.957992 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:35.957962    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-a06722\""
Jul 26 16:48:35.958112 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:35.958091    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-a06722-dockercfg-w57ms\""
Jul 26 16:48:35.970419 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:35.970364    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"]
Jul 26 16:48:36.012474 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.012449    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"]
Jul 26 16:48:36.015858 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.015841    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"
Jul 26 16:48:36.037499 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.037424    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"]
Jul 26 16:48:36.122657 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.122625    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dpfh\" (UniqueName: \"kubernetes.io/projected/4b0f1b5e-fbb9-4c6a-9031-0b096577c746-kube-api-access-7dpfh\") pod \"payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk\" (UID: \"4b0f1b5e-fbb9-4c6a-9031-0b096577c746\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"
Jul 26 16:48:36.122830 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.122671    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvx8x\" (UniqueName: \"kubernetes.io/projected/b6d23cdc-1d6c-4a37-adba-addc6da631b9-kube-api-access-fvx8x\") pod \"payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj\" (UID: \"b6d23cdc-1d6c-4a37-adba-addc6da631b9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"
Jul 26 16:48:36.122830 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.122787    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6d23cdc-1d6c-4a37-adba-addc6da631b9-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj\" (UID: \"b6d23cdc-1d6c-4a37-adba-addc6da631b9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"
Jul 26 16:48:36.122914 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.122856    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b0f1b5e-fbb9-4c6a-9031-0b096577c746-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk\" (UID: \"4b0f1b5e-fbb9-4c6a-9031-0b096577c746\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"
Jul 26 16:48:36.223523 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.223455    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b0f1b5e-fbb9-4c6a-9031-0b096577c746-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk\" (UID: \"4b0f1b5e-fbb9-4c6a-9031-0b096577c746\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"
Jul 26 16:48:36.223523 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.223494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dpfh\" (UniqueName: \"kubernetes.io/projected/4b0f1b5e-fbb9-4c6a-9031-0b096577c746-kube-api-access-7dpfh\") pod \"payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk\" (UID: \"4b0f1b5e-fbb9-4c6a-9031-0b096577c746\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"
Jul 26 16:48:36.223523 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.223517    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvx8x\" (UniqueName: \"kubernetes.io/projected/b6d23cdc-1d6c-4a37-adba-addc6da631b9-kube-api-access-fvx8x\") pod \"payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj\" (UID: \"b6d23cdc-1d6c-4a37-adba-addc6da631b9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"
Jul 26 16:48:36.223985 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.223563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6d23cdc-1d6c-4a37-adba-addc6da631b9-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj\" (UID: \"b6d23cdc-1d6c-4a37-adba-addc6da631b9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"
Jul 26 16:48:36.224259 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.224242    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6d23cdc-1d6c-4a37-adba-addc6da631b9-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj\" (UID: \"b6d23cdc-1d6c-4a37-adba-addc6da631b9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"
Jul 26 16:48:36.224259 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.224249    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b0f1b5e-fbb9-4c6a-9031-0b096577c746-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk\" (UID: \"4b0f1b5e-fbb9-4c6a-9031-0b096577c746\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"
Jul 26 16:48:36.231849 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.231823    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dpfh\" (UniqueName: \"kubernetes.io/projected/4b0f1b5e-fbb9-4c6a-9031-0b096577c746-kube-api-access-7dpfh\") pod \"payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk\" (UID: \"4b0f1b5e-fbb9-4c6a-9031-0b096577c746\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"
Jul 26 16:48:36.231970 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.231862    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvx8x\" (UniqueName: \"kubernetes.io/projected/b6d23cdc-1d6c-4a37-adba-addc6da631b9-kube-api-access-fvx8x\") pod \"payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj\" (UID: \"b6d23cdc-1d6c-4a37-adba-addc6da631b9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"
Jul 26 16:48:36.264388 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.264366    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"
Jul 26 16:48:36.325006 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.324977    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"
Jul 26 16:48:36.411524 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.411495    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"]
Jul 26 16:48:36.413412 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:48:36.413386    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0f1b5e_fbb9_4c6a_9031_0b096577c746.slice/crio-f5c490884e935952a360800c1bb34a9ff8c2d21b6a5ccce1c2265723d7696743 WatchSource:0}: Error finding container f5c490884e935952a360800c1bb34a9ff8c2d21b6a5ccce1c2265723d7696743: Status 404 returned error can't find the container with id f5c490884e935952a360800c1bb34a9ff8c2d21b6a5ccce1c2265723d7696743
Jul 26 16:48:36.682727 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:36.682699    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"]
Jul 26 16:48:36.684048 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:48:36.684019    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d23cdc_1d6c_4a37_adba_addc6da631b9.slice/crio-a51d0cab469fc7b44cbb73a279106a1e22295e17e958f7998c130fda607ca0b3 WatchSource:0}: Error finding container a51d0cab469fc7b44cbb73a279106a1e22295e17e958f7998c130fda607ca0b3: Status 404 returned error can't find the container with id a51d0cab469fc7b44cbb73a279106a1e22295e17e958f7998c130fda607ca0b3
Jul 26 16:48:37.148898 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:37.148797    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj" event={"ID":"b6d23cdc-1d6c-4a37-adba-addc6da631b9","Type":"ContainerStarted","Data":"c542143f64ba48b4dd2877b7a1dc860f32ed5a52617879ad02b2e92ac34ce70a"}
Jul 26 16:48:37.148898 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:37.148862    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj" event={"ID":"b6d23cdc-1d6c-4a37-adba-addc6da631b9","Type":"ContainerStarted","Data":"a51d0cab469fc7b44cbb73a279106a1e22295e17e958f7998c130fda607ca0b3"}
Jul 26 16:48:37.149175 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:37.148908    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"
Jul 26 16:48:37.150865 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:37.150836    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk" event={"ID":"4b0f1b5e-fbb9-4c6a-9031-0b096577c746","Type":"ContainerStarted","Data":"91d6d81c6ae809496cf0cb1428f4bfcc149bf4e600d12fd8d33154f7ff72b281"}
Jul 26 16:48:37.151001 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:37.150882    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk" event={"ID":"4b0f1b5e-fbb9-4c6a-9031-0b096577c746","Type":"ContainerStarted","Data":"f5c490884e935952a360800c1bb34a9ff8c2d21b6a5ccce1c2265723d7696743"}
Jul 26 16:48:37.151001 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:37.150957    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"
Jul 26 16:48:37.170442 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:37.170400    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj" podStartSLOduration=2.170387558 podStartE2EDuration="2.170387558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:48:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:48:37.168839057 +0000 UTC m=+2432.703538335" watchObservedRunningTime="2026-07-26 16:48:37.170387558 +0000 UTC m=+2432.705086834"
Jul 26 16:48:37.188657 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:37.188604    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk" podStartSLOduration=2.188587123 podStartE2EDuration="2.188587123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:48:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:48:37.186798715 +0000 UTC m=+2432.721497989" watchObservedRunningTime="2026-07-26 16:48:37.188587123 +0000 UTC m=+2432.723286399"
Jul 26 16:48:38.919928 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:38.919895    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:48:40.112310 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:40.112267    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv" podUID="4bcaca0f-465a-4810-b596-4dd74e7eb270" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.84:9004: connect: connection refused"
Jul 26 16:48:48.160642 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:48.160610    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"
Jul 26 16:48:48.161028 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:48.160679    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"
Jul 26 16:48:50.112144 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:50.112098    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"
Jul 26 16:48:55.510722 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:48:55.510682    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:49:05.317691 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:05.317656    2559 scope.go:117] "RemoveContainer" containerID="f97ce21ef1a803606801eb6a291feba6471156427a5844768d7441d2c651c089"
Jul 26 16:49:39.779055 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.779024    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"]
Jul 26 16:49:39.782925 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.782906    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.786789 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.786765    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a06722\"/\"kube-root-ca.crt\""
Jul 26 16:49:39.786789 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.786782    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a06722\"/\"default-dockercfg-4bmgt\""
Jul 26 16:49:39.786951 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.786783    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a06722\"/\"auth-test-model-a06722-kserve-self-signed-certs\""
Jul 26 16:49:39.786951 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.786815    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a06722\"/\"openshift-service-ca.crt\""
Jul 26 16:49:39.802461 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.802441    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"]
Jul 26 16:49:39.822597 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.822567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:49:39.882580 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.882556    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-dshm\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.882693 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.882583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwknx\" (UniqueName: \"kubernetes.io/projected/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-kube-api-access-wwknx\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.882693 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.882658    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-home\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.882693 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.882673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-tmp-dir\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.882693 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.882687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-tls-certs\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.882854 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.882728    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-model-cache\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.983922 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.983893    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-dshm\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.984061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.983926    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwknx\" (UniqueName: \"kubernetes.io/projected/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-kube-api-access-wwknx\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.984061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.984006    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-home\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.984061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.984022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-tmp-dir\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.984061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.984046    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-tls-certs\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.984323 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.984099    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-model-cache\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.984437 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.984415    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-home\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.984501 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.984465    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-tmp-dir\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.984556 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.984522    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-model-cache\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.986433 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.986409    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-dshm\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.986683 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.986661    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-tls-certs\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:39.996315 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:39.996293    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwknx\" (UniqueName: \"kubernetes.io/projected/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-kube-api-access-wwknx\") pod \"auth-test-model-a06722-kserve-8677744d59-4hnvq\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") " pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:40.092415 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:40.092332    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:40.234262 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:40.234233    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"]
Jul 26 16:49:40.235220 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:49:40.235196    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfad8437b_c1a9_4aa6_8a22_e24fb46a02d8.slice/crio-11480797bc59e83459baf0e067be137ef88304ab92dc479c1464a9afc5b96bc2 WatchSource:0}: Error finding container 11480797bc59e83459baf0e067be137ef88304ab92dc479c1464a9afc5b96bc2: Status 404 returned error can't find the container with id 11480797bc59e83459baf0e067be137ef88304ab92dc479c1464a9afc5b96bc2
Jul 26 16:49:40.486439 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:40.486406    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq" event={"ID":"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8","Type":"ContainerStarted","Data":"6a94af4ff97526e55efafea309ceb11952e405cbf6217ed03ebeb71f01fa514c"}
Jul 26 16:49:40.486439 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:40.486444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq" event={"ID":"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8","Type":"ContainerStarted","Data":"11480797bc59e83459baf0e067be137ef88304ab92dc479c1464a9afc5b96bc2"}
Jul 26 16:49:40.510064 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:40.510014    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq" podStartSLOduration=1.510000719 podStartE2EDuration="1.510000719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:49:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:49:40.50761394 +0000 UTC m=+2496.042313216" watchObservedRunningTime="2026-07-26 16:49:40.510000719 +0000 UTC m=+2496.044700025"
Jul 26 16:49:50.093523 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:50.093483    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:50.093932 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:50.093549    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:50.106045 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:50.106016    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:49:50.551056 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:49:50.551028    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:50:19.076249 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:50:19.076220    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:50:19.177624 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:50:19.177592    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:50:56.798428 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:50:56.798389    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:51:03.127012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:51:03.126958    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:51:03.221308 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:51:03.221255    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:51:05.353357 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:51:05.353329    2559 scope.go:117] "RemoveContainer" containerID="8721133f2e83d11d2d423667d1b4698a167e10293e4aa5cfede5e63be1507be7"
Jul 26 16:51:05.362031 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:51:05.362011    2559 scope.go:117] "RemoveContainer" containerID="87c60ea9fd862f05ace37ca79e16ed7e003ba2f99cf9e25cf95aec437590fd0c"
Jul 26 16:52:17.978723 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:52:17.978686    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:52:18.080399 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:52:18.080342    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:52:22.362853 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:52:22.362817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:53:05.167844 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:53:05.167770    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:53:05.173680 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:53:05.173658    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:54:10.099536 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:10.099497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:54:10.958655 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:10.958624    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"]
Jul 26 16:54:10.983932 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:10.983904    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:54:25.293153 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:25.293091    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:54:25.978005 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:25.977962    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq" podUID="fad8437b-c1a9-4aa6-8a22-e24fb46a02d8" containerName="main" containerID="cri-o://6a94af4ff97526e55efafea309ceb11952e405cbf6217ed03ebeb71f01fa514c" gracePeriod=45
Jul 26 16:54:26.236776 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.236706    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:54:26.405386 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.405352    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-home\") pod \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") "
Jul 26 16:54:26.405870 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.405407    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwknx\" (UniqueName: \"kubernetes.io/projected/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-kube-api-access-wwknx\") pod \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") "
Jul 26 16:54:26.405870 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.405449    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-tmp-dir\") pod \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") "
Jul 26 16:54:26.405870 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.405491    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-tls-certs\") pod \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") "
Jul 26 16:54:26.405870 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.405514    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-dshm\") pod \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") "
Jul 26 16:54:26.405870 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.405552    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-model-cache\") pod \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\" (UID: \"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8\") "
Jul 26 16:54:26.405870 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.405722    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-home" (OuterVolumeSpecName: "home") pod "fad8437b-c1a9-4aa6-8a22-e24fb46a02d8" (UID: "fad8437b-c1a9-4aa6-8a22-e24fb46a02d8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:54:26.405870 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.405735    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fad8437b-c1a9-4aa6-8a22-e24fb46a02d8" (UID: "fad8437b-c1a9-4aa6-8a22-e24fb46a02d8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:54:26.405870 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.405816    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-home\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:54:26.406207 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.405937    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-model-cache" (OuterVolumeSpecName: "model-cache") pod "fad8437b-c1a9-4aa6-8a22-e24fb46a02d8" (UID: "fad8437b-c1a9-4aa6-8a22-e24fb46a02d8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:54:26.407763 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.407715    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-dshm" (OuterVolumeSpecName: "dshm") pod "fad8437b-c1a9-4aa6-8a22-e24fb46a02d8" (UID: "fad8437b-c1a9-4aa6-8a22-e24fb46a02d8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:54:26.407763 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.407749    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fad8437b-c1a9-4aa6-8a22-e24fb46a02d8" (UID: "fad8437b-c1a9-4aa6-8a22-e24fb46a02d8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:54:26.407905 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.407784    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-kube-api-access-wwknx" (OuterVolumeSpecName: "kube-api-access-wwknx") pod "fad8437b-c1a9-4aa6-8a22-e24fb46a02d8" (UID: "fad8437b-c1a9-4aa6-8a22-e24fb46a02d8"). InnerVolumeSpecName "kube-api-access-wwknx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:54:26.507279 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.507202    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwknx\" (UniqueName: \"kubernetes.io/projected/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-kube-api-access-wwknx\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:54:26.507279 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.507231    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-tmp-dir\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:54:26.507279 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.507240    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-tls-certs\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:54:26.507279 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.507251    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-dshm\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:54:26.507279 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.507261    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8-model-cache\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:54:26.956492 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.956455    2559 generic.go:356] "Generic (PLEG): container finished" podID="fad8437b-c1a9-4aa6-8a22-e24fb46a02d8" containerID="6a94af4ff97526e55efafea309ceb11952e405cbf6217ed03ebeb71f01fa514c" exitCode=0
Jul 26 16:54:26.956665 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.956568    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"
Jul 26 16:54:26.957859 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.957830    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq" event={"ID":"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8","Type":"ContainerDied","Data":"6a94af4ff97526e55efafea309ceb11952e405cbf6217ed03ebeb71f01fa514c"}
Jul 26 16:54:26.957970 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.957875    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq" event={"ID":"fad8437b-c1a9-4aa6-8a22-e24fb46a02d8","Type":"ContainerDied","Data":"11480797bc59e83459baf0e067be137ef88304ab92dc479c1464a9afc5b96bc2"}
Jul 26 16:54:26.957970 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.957902    2559 scope.go:117] "RemoveContainer" containerID="6a94af4ff97526e55efafea309ceb11952e405cbf6217ed03ebeb71f01fa514c"
Jul 26 16:54:26.968800 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.968781    2559 scope.go:117] "RemoveContainer" containerID="6a94af4ff97526e55efafea309ceb11952e405cbf6217ed03ebeb71f01fa514c"
Jul 26 16:54:26.969064 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:54:26.969046    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a94af4ff97526e55efafea309ceb11952e405cbf6217ed03ebeb71f01fa514c\": container with ID starting with 6a94af4ff97526e55efafea309ceb11952e405cbf6217ed03ebeb71f01fa514c not found: ID does not exist" containerID="6a94af4ff97526e55efafea309ceb11952e405cbf6217ed03ebeb71f01fa514c"
Jul 26 16:54:26.969116 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.969074    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a94af4ff97526e55efafea309ceb11952e405cbf6217ed03ebeb71f01fa514c"} err="failed to get container status \"6a94af4ff97526e55efafea309ceb11952e405cbf6217ed03ebeb71f01fa514c\": rpc error: code = NotFound desc = could not find container \"6a94af4ff97526e55efafea309ceb11952e405cbf6217ed03ebeb71f01fa514c\": container with ID starting with 6a94af4ff97526e55efafea309ceb11952e405cbf6217ed03ebeb71f01fa514c not found: ID does not exist"
Jul 26 16:54:26.983199 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.983176    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"]
Jul 26 16:54:26.986340 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:26.986320    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a06722/auth-test-model-a06722-kserve-8677744d59-4hnvq"]
Jul 26 16:54:28.955853 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:28.955821    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fad8437b-c1a9-4aa6-8a22-e24fb46a02d8" path="/var/lib/kubelet/pods/fad8437b-c1a9-4aa6-8a22-e24fb46a02d8/volumes"
Jul 26 16:54:41.041653 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:54:41.041600    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:55:36.757833 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:55:36.757790    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:56:27.398592 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:56:27.398555    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:56:28.565791 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:56:28.565754    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:56:36.195063 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:56:36.195000    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:56:37.203138 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:56:37.203095    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:57:03.817652 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:57:03.817619    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:57:35.651788 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:57:35.651685    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:57:37.095009 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:57:37.094978    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:57:44.227453 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:57:44.227419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:57:44.418043 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:57:44.418010    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:58:05.199872 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:05.199843    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:58:05.206294 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:05.206275    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 16:58:10.038533 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:10.038483    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:58:55.501195 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:55.501152    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:58:56.340215 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:56.340186    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:58:57.227829 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:57.227753    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7391-139635694144944"]
Jul 26 16:58:57.228205 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:57.228191    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fad8437b-c1a9-4aa6-8a22-e24fb46a02d8" containerName="main"
Jul 26 16:58:57.228205 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:57.228206    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fad8437b-c1a9-4aa6-8a22-e24fb46a02d8" containerName="main"
Jul 26 16:58:57.228286 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:57.228266    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fad8437b-c1a9-4aa6-8a22-e24fb46a02d8" containerName="main"
Jul 26 16:58:57.231329 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:57.231312    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635694144944"
Jul 26 16:58:57.233881 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:57.233861    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4rt52\""
Jul 26 16:58:57.239323 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:57.239296    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7391-139635694144944"]
Jul 26 16:58:57.286751 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:57.286717    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knstf\" (UniqueName: \"kubernetes.io/projected/370ba517-d0d8-4f68-a627-6646c3e4eb9d-kube-api-access-knstf\") pod \"test-curl-7391-139635694144944\" (UID: \"370ba517-d0d8-4f68-a627-6646c3e4eb9d\") " pod="opendatahub/test-curl-7391-139635694144944"
Jul 26 16:58:57.387890 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:57.387846    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knstf\" (UniqueName: \"kubernetes.io/projected/370ba517-d0d8-4f68-a627-6646c3e4eb9d-kube-api-access-knstf\") pod \"test-curl-7391-139635694144944\" (UID: \"370ba517-d0d8-4f68-a627-6646c3e4eb9d\") " pod="opendatahub/test-curl-7391-139635694144944"
Jul 26 16:58:57.398614 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:57.398585    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knstf\" (UniqueName: \"kubernetes.io/projected/370ba517-d0d8-4f68-a627-6646c3e4eb9d-kube-api-access-knstf\") pod \"test-curl-7391-139635694144944\" (UID: \"370ba517-d0d8-4f68-a627-6646c3e4eb9d\") " pod="opendatahub/test-curl-7391-139635694144944"
Jul 26 16:58:57.542731 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:57.542652    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635694144944"
Jul 26 16:58:57.679099 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:57.679068    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7391-139635694144944"]
Jul 26 16:58:57.680743 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:58:57.680712    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod370ba517_d0d8_4f68_a627_6646c3e4eb9d.slice/crio-8fc7268643764eae5b7fcd30fd5565d78072f743205743aff27723e67b33d0cf WatchSource:0}: Error finding container 8fc7268643764eae5b7fcd30fd5565d78072f743205743aff27723e67b33d0cf: Status 404 returned error can't find the container with id 8fc7268643764eae5b7fcd30fd5565d78072f743205743aff27723e67b33d0cf
Jul 26 16:58:57.682067 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:57.682048    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 16:58:58.349528 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:58.349478    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7391-139635694144944" event={"ID":"370ba517-d0d8-4f68-a627-6646c3e4eb9d","Type":"ContainerStarted","Data":"8fc7268643764eae5b7fcd30fd5565d78072f743205743aff27723e67b33d0cf"}
Jul 26 16:58:59.356396 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:59.356359    2559 generic.go:356] "Generic (PLEG): container finished" podID="370ba517-d0d8-4f68-a627-6646c3e4eb9d" containerID="b2a83cf4746971bb794591dc2e8b06d6ea007aad4c107028bbba067e4a591d0f" exitCode=0
Jul 26 16:58:59.356811 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:58:59.356420    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7391-139635694144944" event={"ID":"370ba517-d0d8-4f68-a627-6646c3e4eb9d","Type":"ContainerDied","Data":"b2a83cf4746971bb794591dc2e8b06d6ea007aad4c107028bbba067e4a591d0f"}
Jul 26 16:59:00.502450 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.502426    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635694144944"
Jul 26 16:59:00.543384 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.543352    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7391-139635694144944_370ba517-d0d8-4f68-a627-6646c3e4eb9d/test-curl-7391-139635694144944/0.log"
Jul 26 16:59:00.567764 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.567738    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7391-139635694144944"]
Jul 26 16:59:00.571932 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.571908    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7391-139635694144944"]
Jul 26 16:59:00.616418 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.616348    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knstf\" (UniqueName: \"kubernetes.io/projected/370ba517-d0d8-4f68-a627-6646c3e4eb9d-kube-api-access-knstf\") pod \"370ba517-d0d8-4f68-a627-6646c3e4eb9d\" (UID: \"370ba517-d0d8-4f68-a627-6646c3e4eb9d\") "
Jul 26 16:59:00.618458 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.618426    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/370ba517-d0d8-4f68-a627-6646c3e4eb9d-kube-api-access-knstf" (OuterVolumeSpecName: "kube-api-access-knstf") pod "370ba517-d0d8-4f68-a627-6646c3e4eb9d" (UID: "370ba517-d0d8-4f68-a627-6646c3e4eb9d"). InnerVolumeSpecName "kube-api-access-knstf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:59:00.694685 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.694654    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7391-139635694133296"]
Jul 26 16:59:00.695094 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.695080    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="370ba517-d0d8-4f68-a627-6646c3e4eb9d" containerName="test-curl-7391-139635694144944"
Jul 26 16:59:00.695094 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.695095    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="370ba517-d0d8-4f68-a627-6646c3e4eb9d" containerName="test-curl-7391-139635694144944"
Jul 26 16:59:00.695222 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.695185    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="370ba517-d0d8-4f68-a627-6646c3e4eb9d" containerName="test-curl-7391-139635694144944"
Jul 26 16:59:00.698303 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.698288    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635694133296"
Jul 26 16:59:00.706603 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.706578    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7391-139635694133296"]
Jul 26 16:59:00.717366 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.717343    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knstf\" (UniqueName: \"kubernetes.io/projected/370ba517-d0d8-4f68-a627-6646c3e4eb9d-kube-api-access-knstf\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:59:00.817967 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.817933    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjdqh\" (UniqueName: \"kubernetes.io/projected/efc74ffa-8370-472b-a4a2-293974293eed-kube-api-access-fjdqh\") pod \"test-curl-7391-139635694133296\" (UID: \"efc74ffa-8370-472b-a4a2-293974293eed\") " pod="opendatahub/test-curl-7391-139635694133296"
Jul 26 16:59:00.919077 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.918994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjdqh\" (UniqueName: \"kubernetes.io/projected/efc74ffa-8370-472b-a4a2-293974293eed-kube-api-access-fjdqh\") pod \"test-curl-7391-139635694133296\" (UID: \"efc74ffa-8370-472b-a4a2-293974293eed\") " pod="opendatahub/test-curl-7391-139635694133296"
Jul 26 16:59:00.927692 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.927669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjdqh\" (UniqueName: \"kubernetes.io/projected/efc74ffa-8370-472b-a4a2-293974293eed-kube-api-access-fjdqh\") pod \"test-curl-7391-139635694133296\" (UID: \"efc74ffa-8370-472b-a4a2-293974293eed\") " pod="opendatahub/test-curl-7391-139635694133296"
Jul 26 16:59:00.955730 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:00.955703    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="370ba517-d0d8-4f68-a627-6646c3e4eb9d" path="/var/lib/kubelet/pods/370ba517-d0d8-4f68-a627-6646c3e4eb9d/volumes"
Jul 26 16:59:01.008574 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:01.008551    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635694133296"
Jul 26 16:59:01.152949 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:01.152927    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7391-139635694133296"]
Jul 26 16:59:01.154572 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:59:01.154543    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefc74ffa_8370_472b_a4a2_293974293eed.slice/crio-280f642ab3061a2366245a9f11e6a20b9310dec272b7fbd67c87c054654637a2 WatchSource:0}: Error finding container 280f642ab3061a2366245a9f11e6a20b9310dec272b7fbd67c87c054654637a2: Status 404 returned error can't find the container with id 280f642ab3061a2366245a9f11e6a20b9310dec272b7fbd67c87c054654637a2
Jul 26 16:59:01.369673 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:01.369649    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635694144944"
Jul 26 16:59:01.369843 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:01.369685    2559 scope.go:117] "RemoveContainer" containerID="b2a83cf4746971bb794591dc2e8b06d6ea007aad4c107028bbba067e4a591d0f"
Jul 26 16:59:01.371050 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:01.370902    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7391-139635694133296" event={"ID":"efc74ffa-8370-472b-a4a2-293974293eed","Type":"ContainerStarted","Data":"280f642ab3061a2366245a9f11e6a20b9310dec272b7fbd67c87c054654637a2"}
Jul 26 16:59:02.385466 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:02.385418    2559 generic.go:356] "Generic (PLEG): container finished" podID="efc74ffa-8370-472b-a4a2-293974293eed" containerID="a59e600dc6f311dc0f818f97cbfc7abc99859727c5f21ae6542815ce71515cc9" exitCode=0
Jul 26 16:59:02.385853 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:02.385484    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7391-139635694133296" event={"ID":"efc74ffa-8370-472b-a4a2-293974293eed","Type":"ContainerDied","Data":"a59e600dc6f311dc0f818f97cbfc7abc99859727c5f21ae6542815ce71515cc9"}
Jul 26 16:59:03.534245 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.534223    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635694133296"
Jul 26 16:59:03.559720 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.559694    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7391-139635694133296_efc74ffa-8370-472b-a4a2-293974293eed/test-curl-7391-139635694133296/0.log"
Jul 26 16:59:03.584659 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.584634    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7391-139635694133296"]
Jul 26 16:59:03.589444 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.589421    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7391-139635694133296"]
Jul 26 16:59:03.645503 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.645440    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjdqh\" (UniqueName: \"kubernetes.io/projected/efc74ffa-8370-472b-a4a2-293974293eed-kube-api-access-fjdqh\") pod \"efc74ffa-8370-472b-a4a2-293974293eed\" (UID: \"efc74ffa-8370-472b-a4a2-293974293eed\") "
Jul 26 16:59:03.647439 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.647418    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc74ffa-8370-472b-a4a2-293974293eed-kube-api-access-fjdqh" (OuterVolumeSpecName: "kube-api-access-fjdqh") pod "efc74ffa-8370-472b-a4a2-293974293eed" (UID: "efc74ffa-8370-472b-a4a2-293974293eed"). InnerVolumeSpecName "kube-api-access-fjdqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:59:03.746876 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.746850    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjdqh\" (UniqueName: \"kubernetes.io/projected/efc74ffa-8370-472b-a4a2-293974293eed-kube-api-access-fjdqh\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:59:03.754386 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.754360    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7391-139635688560512"]
Jul 26 16:59:03.754821 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.754807    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc74ffa-8370-472b-a4a2-293974293eed" containerName="test-curl-7391-139635694133296"
Jul 26 16:59:03.754865 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.754822    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc74ffa-8370-472b-a4a2-293974293eed" containerName="test-curl-7391-139635694133296"
Jul 26 16:59:03.754917 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.754907    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc74ffa-8370-472b-a4a2-293974293eed" containerName="test-curl-7391-139635694133296"
Jul 26 16:59:03.758009 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.757996    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:03.765789 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.765770    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7391-139635688560512"]
Jul 26 16:59:03.848246 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.848216    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j6v9\" (UniqueName: \"kubernetes.io/projected/fab1b369-1be0-4357-a16a-ba367c29b392-kube-api-access-8j6v9\") pod \"test-curl-7391-139635688560512\" (UID: \"fab1b369-1be0-4357-a16a-ba367c29b392\") " pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:03.949168 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.949143    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j6v9\" (UniqueName: \"kubernetes.io/projected/fab1b369-1be0-4357-a16a-ba367c29b392-kube-api-access-8j6v9\") pod \"test-curl-7391-139635688560512\" (UID: \"fab1b369-1be0-4357-a16a-ba367c29b392\") " pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:03.957783 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:03.957752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j6v9\" (UniqueName: \"kubernetes.io/projected/fab1b369-1be0-4357-a16a-ba367c29b392-kube-api-access-8j6v9\") pod \"test-curl-7391-139635688560512\" (UID: \"fab1b369-1be0-4357-a16a-ba367c29b392\") " pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:04.067056 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:04.067016    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:04.200344 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:04.200319    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7391-139635688560512"]
Jul 26 16:59:04.202258 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:59:04.202232    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfab1b369_1be0_4357_a16a_ba367c29b392.slice/crio-93109fafa49fade42827ce16bd12970e2af7be9e4a6056accdc13a5b05a06bf0 WatchSource:0}: Error finding container 93109fafa49fade42827ce16bd12970e2af7be9e4a6056accdc13a5b05a06bf0: Status 404 returned error can't find the container with id 93109fafa49fade42827ce16bd12970e2af7be9e4a6056accdc13a5b05a06bf0
Jul 26 16:59:04.396353 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:04.396332    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635694133296"
Jul 26 16:59:04.396501 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:04.396379    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="280f642ab3061a2366245a9f11e6a20b9310dec272b7fbd67c87c054654637a2"
Jul 26 16:59:04.397575 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:04.397548    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7391-139635688560512" event={"ID":"fab1b369-1be0-4357-a16a-ba367c29b392","Type":"ContainerStarted","Data":"93109fafa49fade42827ce16bd12970e2af7be9e4a6056accdc13a5b05a06bf0"}
Jul 26 16:59:04.407206 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:59:04.407178    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7391-139635694133296\" is forbidden: User \"system:node:ip-10-0-131-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-99.ec2.internal' and this object" podUID="efc74ffa-8370-472b-a4a2-293974293eed" pod="opendatahub/test-curl-7391-139635694133296"
Jul 26 16:59:04.953370 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:59:04.953331    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7391-139635694133296\" is forbidden: User \"system:node:ip-10-0-131-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-99.ec2.internal' and this object" podUID="efc74ffa-8370-472b-a4a2-293974293eed" pod="opendatahub/test-curl-7391-139635694133296"
Jul 26 16:59:04.955430 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:04.955407    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efc74ffa-8370-472b-a4a2-293974293eed" path="/var/lib/kubelet/pods/efc74ffa-8370-472b-a4a2-293974293eed/volumes"
Jul 26 16:59:05.404082 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:05.403994    2559 generic.go:356] "Generic (PLEG): container finished" podID="fab1b369-1be0-4357-a16a-ba367c29b392" containerID="33d264037eff62d3bcc0b63aa305415d237f6835d6c564d1336d0517d6e8a367" exitCode=0
Jul 26 16:59:05.404256 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:05.404078    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7391-139635688560512" event={"ID":"fab1b369-1be0-4357-a16a-ba367c29b392","Type":"ContainerDied","Data":"33d264037eff62d3bcc0b63aa305415d237f6835d6c564d1336d0517d6e8a367"}
Jul 26 16:59:06.553229 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.553204    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:06.575914 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.575891    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7391-139635688560512_fab1b369-1be0-4357-a16a-ba367c29b392/test-curl-7391-139635688560512/0.log"
Jul 26 16:59:06.603173 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.603150    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7391-139635688560512"]
Jul 26 16:59:06.605631 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.605612    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7391-139635688560512"]
Jul 26 16:59:06.672474 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.672422    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8j6v9\" (UniqueName: \"kubernetes.io/projected/fab1b369-1be0-4357-a16a-ba367c29b392-kube-api-access-8j6v9\") pod \"fab1b369-1be0-4357-a16a-ba367c29b392\" (UID: \"fab1b369-1be0-4357-a16a-ba367c29b392\") "
Jul 26 16:59:06.674343 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.674323    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fab1b369-1be0-4357-a16a-ba367c29b392-kube-api-access-8j6v9" (OuterVolumeSpecName: "kube-api-access-8j6v9") pod "fab1b369-1be0-4357-a16a-ba367c29b392" (UID: "fab1b369-1be0-4357-a16a-ba367c29b392"). InnerVolumeSpecName "kube-api-access-8j6v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:59:06.728390 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.728365    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7391-139635688560512"]
Jul 26 16:59:06.728774 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.728761    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fab1b369-1be0-4357-a16a-ba367c29b392" containerName="test-curl-7391-139635688560512"
Jul 26 16:59:06.728817 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.728776    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fab1b369-1be0-4357-a16a-ba367c29b392" containerName="test-curl-7391-139635688560512"
Jul 26 16:59:06.728855 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.728838    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fab1b369-1be0-4357-a16a-ba367c29b392" containerName="test-curl-7391-139635688560512"
Jul 26 16:59:06.731804 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.731791    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:06.738788 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.738540    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7391-139635688560512"]
Jul 26 16:59:06.773890 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.773870    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j6v9\" (UniqueName: \"kubernetes.io/projected/fab1b369-1be0-4357-a16a-ba367c29b392-kube-api-access-8j6v9\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:59:06.874404 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.874380    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8487c\" (UniqueName: \"kubernetes.io/projected/2c78b329-bfda-40e6-9a89-2e57db36d51b-kube-api-access-8487c\") pod \"test-curl-7391-139635688560512\" (UID: \"2c78b329-bfda-40e6-9a89-2e57db36d51b\") " pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:06.962233 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.962202    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fab1b369-1be0-4357-a16a-ba367c29b392" path="/var/lib/kubelet/pods/fab1b369-1be0-4357-a16a-ba367c29b392/volumes"
Jul 26 16:59:06.975697 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.975673    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8487c\" (UniqueName: \"kubernetes.io/projected/2c78b329-bfda-40e6-9a89-2e57db36d51b-kube-api-access-8487c\") pod \"test-curl-7391-139635688560512\" (UID: \"2c78b329-bfda-40e6-9a89-2e57db36d51b\") " pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:06.984467 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:06.984443    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8487c\" (UniqueName: \"kubernetes.io/projected/2c78b329-bfda-40e6-9a89-2e57db36d51b-kube-api-access-8487c\") pod \"test-curl-7391-139635688560512\" (UID: \"2c78b329-bfda-40e6-9a89-2e57db36d51b\") " pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:07.041394 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:07.041358    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:07.207079 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:07.207053    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7391-139635688560512"]
Jul 26 16:59:07.208977 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:59:07.208948    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c78b329_bfda_40e6_9a89_2e57db36d51b.slice/crio-36b92970f5039fc68de7bf99b7cca372332b6a8099f45b6723396b2a7b0465f1 WatchSource:0}: Error finding container 36b92970f5039fc68de7bf99b7cca372332b6a8099f45b6723396b2a7b0465f1: Status 404 returned error can't find the container with id 36b92970f5039fc68de7bf99b7cca372332b6a8099f45b6723396b2a7b0465f1
Jul 26 16:59:07.417549 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:07.417516    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7391-139635688560512" event={"ID":"2c78b329-bfda-40e6-9a89-2e57db36d51b","Type":"ContainerStarted","Data":"36b92970f5039fc68de7bf99b7cca372332b6a8099f45b6723396b2a7b0465f1"}
Jul 26 16:59:07.418849 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:07.418828    2559 scope.go:117] "RemoveContainer" containerID="33d264037eff62d3bcc0b63aa305415d237f6835d6c564d1336d0517d6e8a367"
Jul 26 16:59:07.418973 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:07.418853    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:08.426489 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:08.426455    2559 generic.go:356] "Generic (PLEG): container finished" podID="2c78b329-bfda-40e6-9a89-2e57db36d51b" containerID="bc7e3b49ae8c83a58576981500cfcfdaeffc00f5547d1f4475eb42de55f24a7b" exitCode=0
Jul 26 16:59:08.426877 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:08.426512    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7391-139635688560512" event={"ID":"2c78b329-bfda-40e6-9a89-2e57db36d51b","Type":"ContainerDied","Data":"bc7e3b49ae8c83a58576981500cfcfdaeffc00f5547d1f4475eb42de55f24a7b"}
Jul 26 16:59:09.570360 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:09.570337    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:09.591712 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:09.591689    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7391-139635688560512_2c78b329-bfda-40e6-9a89-2e57db36d51b/test-curl-7391-139635688560512/0.log"
Jul 26 16:59:09.621163 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:09.621139    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7391-139635688560512"]
Jul 26 16:59:09.627028 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:09.627004    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7391-139635688560512"]
Jul 26 16:59:09.700911 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:09.700891    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8487c\" (UniqueName: \"kubernetes.io/projected/2c78b329-bfda-40e6-9a89-2e57db36d51b-kube-api-access-8487c\") pod \"2c78b329-bfda-40e6-9a89-2e57db36d51b\" (UID: \"2c78b329-bfda-40e6-9a89-2e57db36d51b\") "
Jul 26 16:59:09.702909 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:09.702889    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c78b329-bfda-40e6-9a89-2e57db36d51b-kube-api-access-8487c" (OuterVolumeSpecName: "kube-api-access-8487c") pod "2c78b329-bfda-40e6-9a89-2e57db36d51b" (UID: "2c78b329-bfda-40e6-9a89-2e57db36d51b"). InnerVolumeSpecName "kube-api-access-8487c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:59:09.749793 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:09.749759    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7391-139635694012000"]
Jul 26 16:59:09.750207 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:09.750194    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c78b329-bfda-40e6-9a89-2e57db36d51b" containerName="test-curl-7391-139635688560512"
Jul 26 16:59:09.750254 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:09.750209    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c78b329-bfda-40e6-9a89-2e57db36d51b" containerName="test-curl-7391-139635688560512"
Jul 26 16:59:09.750290 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:09.750278    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c78b329-bfda-40e6-9a89-2e57db36d51b" containerName="test-curl-7391-139635688560512"
Jul 26 16:59:09.753415 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:09.753400    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635694012000"
Jul 26 16:59:09.762400 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:09.762378    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7391-139635694012000"]
Jul 26 16:59:09.801760 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:09.801741    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8487c\" (UniqueName: \"kubernetes.io/projected/2c78b329-bfda-40e6-9a89-2e57db36d51b-kube-api-access-8487c\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:59:09.902331 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:09.902304    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntknk\" (UniqueName: \"kubernetes.io/projected/23d440bd-967f-4598-8d58-4a48a175ffd9-kube-api-access-ntknk\") pod \"test-curl-7391-139635694012000\" (UID: \"23d440bd-967f-4598-8d58-4a48a175ffd9\") " pod="opendatahub/test-curl-7391-139635694012000"
Jul 26 16:59:10.003061 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:10.002997    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntknk\" (UniqueName: \"kubernetes.io/projected/23d440bd-967f-4598-8d58-4a48a175ffd9-kube-api-access-ntknk\") pod \"test-curl-7391-139635694012000\" (UID: \"23d440bd-967f-4598-8d58-4a48a175ffd9\") " pod="opendatahub/test-curl-7391-139635694012000"
Jul 26 16:59:10.012681 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:10.012656    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntknk\" (UniqueName: \"kubernetes.io/projected/23d440bd-967f-4598-8d58-4a48a175ffd9-kube-api-access-ntknk\") pod \"test-curl-7391-139635694012000\" (UID: \"23d440bd-967f-4598-8d58-4a48a175ffd9\") " pod="opendatahub/test-curl-7391-139635694012000"
Jul 26 16:59:10.063057 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:10.063033    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635694012000"
Jul 26 16:59:10.221299 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:10.221275    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7391-139635694012000"]
Jul 26 16:59:10.223781 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:59:10.223751    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23d440bd_967f_4598_8d58_4a48a175ffd9.slice/crio-337e4b3ec9010abf92162744b0b61027eb2fa2069434b6de4ce924bd193c1f14 WatchSource:0}: Error finding container 337e4b3ec9010abf92162744b0b61027eb2fa2069434b6de4ce924bd193c1f14: Status 404 returned error can't find the container with id 337e4b3ec9010abf92162744b0b61027eb2fa2069434b6de4ce924bd193c1f14
Jul 26 16:59:10.440198 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:10.440159    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7391-139635694012000" event={"ID":"23d440bd-967f-4598-8d58-4a48a175ffd9","Type":"ContainerStarted","Data":"337e4b3ec9010abf92162744b0b61027eb2fa2069434b6de4ce924bd193c1f14"}
Jul 26 16:59:10.441379 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:10.441356    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36b92970f5039fc68de7bf99b7cca372332b6a8099f45b6723396b2a7b0465f1"
Jul 26 16:59:10.441379 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:10.441365    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:10.451814 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:59:10.451790    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7391-139635688560512\" is forbidden: User \"system:node:ip-10-0-131-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-99.ec2.internal' and this object" podUID="2c78b329-bfda-40e6-9a89-2e57db36d51b" pod="opendatahub/test-curl-7391-139635688560512"
Jul 26 16:59:10.956012 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:10.955982    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c78b329-bfda-40e6-9a89-2e57db36d51b" path="/var/lib/kubelet/pods/2c78b329-bfda-40e6-9a89-2e57db36d51b/volumes"
Jul 26 16:59:11.448388 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:11.448353    2559 generic.go:356] "Generic (PLEG): container finished" podID="23d440bd-967f-4598-8d58-4a48a175ffd9" containerID="e805763e50142539e1c5bb0b51f9a786d6e6702d84f4e4999bad5be5d14c82b5" exitCode=0
Jul 26 16:59:11.448632 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:11.448441    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7391-139635694012000" event={"ID":"23d440bd-967f-4598-8d58-4a48a175ffd9","Type":"ContainerDied","Data":"e805763e50142539e1c5bb0b51f9a786d6e6702d84f4e4999bad5be5d14c82b5"}
Jul 26 16:59:12.591301 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:12.591277    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635694012000"
Jul 26 16:59:12.625821 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:12.625788    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7391-139635694012000_23d440bd-967f-4598-8d58-4a48a175ffd9/test-curl-7391-139635694012000/0.log"
Jul 26 16:59:12.657774 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:12.657746    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7391-139635694012000"]
Jul 26 16:59:12.663033 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:12.663011    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7391-139635694012000"]
Jul 26 16:59:12.726901 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:12.726833    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntknk\" (UniqueName: \"kubernetes.io/projected/23d440bd-967f-4598-8d58-4a48a175ffd9-kube-api-access-ntknk\") pod \"23d440bd-967f-4598-8d58-4a48a175ffd9\" (UID: \"23d440bd-967f-4598-8d58-4a48a175ffd9\") "
Jul 26 16:59:12.728824 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:12.728798    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23d440bd-967f-4598-8d58-4a48a175ffd9-kube-api-access-ntknk" (OuterVolumeSpecName: "kube-api-access-ntknk") pod "23d440bd-967f-4598-8d58-4a48a175ffd9" (UID: "23d440bd-967f-4598-8d58-4a48a175ffd9"). InnerVolumeSpecName "kube-api-access-ntknk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:59:12.827998 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:12.827968    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntknk\" (UniqueName: \"kubernetes.io/projected/23d440bd-967f-4598-8d58-4a48a175ffd9-kube-api-access-ntknk\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 16:59:12.954674 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:12.954640    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23d440bd-967f-4598-8d58-4a48a175ffd9" path="/var/lib/kubelet/pods/23d440bd-967f-4598-8d58-4a48a175ffd9/volumes"
Jul 26 16:59:13.459886 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:13.459856    2559 scope.go:117] "RemoveContainer" containerID="e805763e50142539e1c5bb0b51f9a786d6e6702d84f4e4999bad5be5d14c82b5"
Jul 26 16:59:13.459886 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:13.459884    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7391-139635694012000"
Jul 26 16:59:16.654042 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:16.654008    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:16.984990 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:16.984952    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:17.085157 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:17.085105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:20.200188 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:20.200148    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:20.294985 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:20.294903    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:21.598535 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.598504    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"]
Jul 26 16:59:21.599766 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.599735    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23d440bd-967f-4598-8d58-4a48a175ffd9" containerName="test-curl-7391-139635694012000"
Jul 26 16:59:21.599766 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.599763    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="23d440bd-967f-4598-8d58-4a48a175ffd9" containerName="test-curl-7391-139635694012000"
Jul 26 16:59:21.599963 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.599861    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="23d440bd-967f-4598-8d58-4a48a175ffd9" containerName="test-curl-7391-139635694012000"
Jul 26 16:59:21.605153 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.605108    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 16:59:21.608794 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.608774    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-50e630-serving-cert\""
Jul 26 16:59:21.618999 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.618975    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"]
Jul 26 16:59:21.657084 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.657058    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:21.714411 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.714384    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl\" (UID: \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 16:59:21.714540 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.714422    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl\" (UID: \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 16:59:21.714605 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.714569    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnqrd\" (UniqueName: \"kubernetes.io/projected/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-kube-api-access-dnqrd\") pod \"maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl\" (UID: \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 16:59:21.815651 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.815619    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnqrd\" (UniqueName: \"kubernetes.io/projected/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-kube-api-access-dnqrd\") pod \"maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl\" (UID: \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 16:59:21.815781 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.815666    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl\" (UID: \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 16:59:21.815781 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.815686    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl\" (UID: \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 16:59:21.815905 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:59:21.815782    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-serving-cert: secret "maas-api-e2e-ipp-a-50e630-serving-cert" not found
Jul 26 16:59:21.815905 ip-10-0-131-99 kubenswrapper[2559]: E0726 16:59:21.815840    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-maas-api-tls podName:789f2f67-ce0c-4e60-a262-d62b99ddc4c1 nodeName:}" failed. No retries permitted until 2026-07-26 16:59:22.315823948 +0000 UTC m=+3077.850523201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-maas-api-tls") pod "maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl" (UID: "789f2f67-ce0c-4e60-a262-d62b99ddc4c1") : secret "maas-api-e2e-ipp-a-50e630-serving-cert" not found
Jul 26 16:59:21.816308 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.816290    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl\" (UID: \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 16:59:21.833884 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:21.833860    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnqrd\" (UniqueName: \"kubernetes.io/projected/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-kube-api-access-dnqrd\") pod \"maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl\" (UID: \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 16:59:22.089880 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.089836    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:22.319537 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.319507    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl\" (UID: \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 16:59:22.321852 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.321825    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl\" (UID: \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 16:59:22.359102 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.359034    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:22.458893 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.458855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:22.516853 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.516824    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 16:59:22.555337 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.555309    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"]
Jul 26 16:59:22.560390 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.560366    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"
Jul 26 16:59:22.562955 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.562934    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-50e630-dockercfg-zpdpg\""
Jul 26 16:59:22.563310 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.563289    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-50e630\""
Jul 26 16:59:22.571225 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.570923    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"]
Jul 26 16:59:22.670384 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.670358    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"]
Jul 26 16:59:22.672916 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:59:22.672889    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod789f2f67_ce0c_4e60_a262_d62b99ddc4c1.slice/crio-0c170203ffcdd1735bd566c3f8922198675097f66058dc1f0fec34254d820323 WatchSource:0}: Error finding container 0c170203ffcdd1735bd566c3f8922198675097f66058dc1f0fec34254d820323: Status 404 returned error can't find the container with id 0c170203ffcdd1735bd566c3f8922198675097f66058dc1f0fec34254d820323
Jul 26 16:59:22.726330 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.726299    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01cf1e6c-8f35-457c-9212-cc4f97962ab0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x\" (UID: \"01cf1e6c-8f35-457c-9212-cc4f97962ab0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"
Jul 26 16:59:22.726452 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.726361    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78w9l\" (UniqueName: \"kubernetes.io/projected/01cf1e6c-8f35-457c-9212-cc4f97962ab0-kube-api-access-78w9l\") pod \"payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x\" (UID: \"01cf1e6c-8f35-457c-9212-cc4f97962ab0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"
Jul 26 16:59:22.827743 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.827708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01cf1e6c-8f35-457c-9212-cc4f97962ab0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x\" (UID: \"01cf1e6c-8f35-457c-9212-cc4f97962ab0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"
Jul 26 16:59:22.827899 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.827777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78w9l\" (UniqueName: \"kubernetes.io/projected/01cf1e6c-8f35-457c-9212-cc4f97962ab0-kube-api-access-78w9l\") pod \"payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x\" (UID: \"01cf1e6c-8f35-457c-9212-cc4f97962ab0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"
Jul 26 16:59:22.828455 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.828433    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01cf1e6c-8f35-457c-9212-cc4f97962ab0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x\" (UID: \"01cf1e6c-8f35-457c-9212-cc4f97962ab0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"
Jul 26 16:59:22.839871 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.839843    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78w9l\" (UniqueName: \"kubernetes.io/projected/01cf1e6c-8f35-457c-9212-cc4f97962ab0-kube-api-access-78w9l\") pod \"payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x\" (UID: \"01cf1e6c-8f35-457c-9212-cc4f97962ab0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"
Jul 26 16:59:22.878422 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:22.878360    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"
Jul 26 16:59:23.238422 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:23.238400    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"]
Jul 26 16:59:23.240306 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:59:23.240279    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01cf1e6c_8f35_457c_9212_cc4f97962ab0.slice/crio-20a012cb8ced3a8c05afcc4a1cc722ce7213dd6f9e783479e0000b45306d6689 WatchSource:0}: Error finding container 20a012cb8ced3a8c05afcc4a1cc722ce7213dd6f9e783479e0000b45306d6689: Status 404 returned error can't find the container with id 20a012cb8ced3a8c05afcc4a1cc722ce7213dd6f9e783479e0000b45306d6689
Jul 26 16:59:23.514429 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:23.514333    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl" event={"ID":"789f2f67-ce0c-4e60-a262-d62b99ddc4c1","Type":"ContainerStarted","Data":"1982ed67b7584c87817ce258facb43ff74b8edc4c757f8062a66a4d8b3a34f3f"}
Jul 26 16:59:23.514429 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:23.514397    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl" event={"ID":"789f2f67-ce0c-4e60-a262-d62b99ddc4c1","Type":"ContainerStarted","Data":"0c170203ffcdd1735bd566c3f8922198675097f66058dc1f0fec34254d820323"}
Jul 26 16:59:23.514648 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:23.514520    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 16:59:23.515919 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:23.515893    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x" event={"ID":"01cf1e6c-8f35-457c-9212-cc4f97962ab0","Type":"ContainerStarted","Data":"7fa533977b458d3e9167b74c4a94b3c714e6fdf0197bb7101382a1e4bbb61a54"}
Jul 26 16:59:23.516044 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:23.515930    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x" event={"ID":"01cf1e6c-8f35-457c-9212-cc4f97962ab0","Type":"ContainerStarted","Data":"20a012cb8ced3a8c05afcc4a1cc722ce7213dd6f9e783479e0000b45306d6689"}
Jul 26 16:59:23.516044 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:23.515949    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"
Jul 26 16:59:23.539089 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:23.539051    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl" podStartSLOduration=1.8723102520000001 podStartE2EDuration="2.539039105s" totalImagesPullingTime="666.728853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:59:23.537941077 +0000 UTC m=+3079.072640353" watchObservedRunningTime="2026-07-26 16:59:23.539039105 +0000 UTC m=+3079.073738379"
Jul 26 16:59:23.560110 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:23.560074    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x" podStartSLOduration=1.5600613939999999 podStartE2EDuration="1.560061394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:59:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:59:23.559963558 +0000 UTC m=+3079.094662832" watchObservedRunningTime="2026-07-26 16:59:23.560061394 +0000 UTC m=+3079.094760692"
Jul 26 16:59:24.617726 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:24.617693    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:29.527497 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:29.527467    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 16:59:34.524324 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:34.524294    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"
Jul 26 16:59:40.659830 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.659795    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:40.934423 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.934393    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"]
Jul 26 16:59:40.939238 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.939219    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:40.941613 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.941596    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-930b99-openshift-default-dockercfg-5w9fm\""
Jul 26 16:59:40.956809 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.956788    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"]
Jul 26 16:59:40.966561 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.966539    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:40.982771 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.982746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-data\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:40.982896 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.982793    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istiod-ca-cert\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:40.982896 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.982815    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-token\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:40.982896 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.982871    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-credential-socket\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:40.983086 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.982937    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfcrq\" (UniqueName: \"kubernetes.io/projected/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-kube-api-access-nfcrq\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:40.983086 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.982967    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-workload-certs\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:40.983086 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.982990    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-podinfo\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:40.983086 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.983019    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-envoy\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:40.983086 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:40.983067    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-workload-socket\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.083825 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.083790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-podinfo\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.084018 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.083837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-envoy\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.084018 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.083855    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-workload-socket\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.084018 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.083903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-data\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.084018 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.083957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istiod-ca-cert\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.084018 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.083988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-token\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.084347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.084021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-credential-socket\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.084347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.084069    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfcrq\" (UniqueName: \"kubernetes.io/projected/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-kube-api-access-nfcrq\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.084347 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.084149    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-workload-certs\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.084521 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.084384    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-workload-socket\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.084521 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.084426    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-credential-socket\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.084521 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.084514    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-workload-certs\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.084685 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.084632    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-data\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.084908 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.084887    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istiod-ca-cert\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.086163 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.086111    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-envoy\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.086424 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.086405    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-podinfo\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.091960 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.091936    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-token\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.092420 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.092398    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfcrq\" (UniqueName: \"kubernetes.io/projected/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-kube-api-access-nfcrq\") pod \"e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") " pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.116650 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.116621    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:41.252182 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.252098    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:41.606907 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.606879    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"]
Jul 26 16:59:41.607983 ip-10-0-131-99 kubenswrapper[2559]: W0726 16:59:41.607959    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3297a7f5_cde7_4f0b_86f5_4d54cd81c669.slice/crio-da4769cdf968aae4fe61e93b34d1c3f81b22951407e6fcd5e584a57a9a68f005 WatchSource:0}: Error finding container da4769cdf968aae4fe61e93b34d1c3f81b22951407e6fcd5e584a57a9a68f005: Status 404 returned error can't find the container with id da4769cdf968aae4fe61e93b34d1c3f81b22951407e6fcd5e584a57a9a68f005
Jul 26 16:59:41.610734 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.610703    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:59:41.610814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.610763    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:59:41.610814 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.610794    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:59:41.618441 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:41.618419    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs" event={"ID":"3297a7f5-cde7-4f0b-86f5-4d54cd81c669","Type":"ContainerStarted","Data":"da4769cdf968aae4fe61e93b34d1c3f81b22951407e6fcd5e584a57a9a68f005"}
Jul 26 16:59:42.624946 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:42.624909    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs" event={"ID":"3297a7f5-cde7-4f0b-86f5-4d54cd81c669","Type":"ContainerStarted","Data":"1c21f5df4fde8d2bf7c03627e561e32a0b74254086583398173f19639ad09a50"}
Jul 26 16:59:42.646136 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:42.646081    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs" podStartSLOduration=2.646066761 podStartE2EDuration="2.646066761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:59:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:59:42.644293957 +0000 UTC m=+3098.178993264" watchObservedRunningTime="2026-07-26 16:59:42.646066761 +0000 UTC m=+3098.180766037"
Jul 26 16:59:43.253227 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:43.253184    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:43.258811 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:43.258783    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:43.632175 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:43.631984    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:43.638366 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:43.638336    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 16:59:44.574541 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:44.574508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:44.671731 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:44.671697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:46.385223 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:46.385183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:46.484050 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:46.484024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:46.845266 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:46.845233    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:46.946025 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:46.945991    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 16:59:49.041414 ip-10-0-131-99 kubenswrapper[2559]: I0726 16:59:49.041383    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:00:02.736402 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:02.736315    2559 generic.go:356] "Generic (PLEG): container finished" podID="3297a7f5-cde7-4f0b-86f5-4d54cd81c669" containerID="1c21f5df4fde8d2bf7c03627e561e32a0b74254086583398173f19639ad09a50" exitCode=0
Jul 26 17:00:02.736402 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:02.736386    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs" event={"ID":"3297a7f5-cde7-4f0b-86f5-4d54cd81c669","Type":"ContainerDied","Data":"1c21f5df4fde8d2bf7c03627e561e32a0b74254086583398173f19639ad09a50"}
Jul 26 17:00:02.736828 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:02.736811    2559 scope.go:117] "RemoveContainer" containerID="1c21f5df4fde8d2bf7c03627e561e32a0b74254086583398173f19639ad09a50"
Jul 26 17:00:02.737862 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:02.737834    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 17:00:02.737931 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:02.737917    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 17:00:02.737968 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:02.737958    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 17:00:03.747049 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:03.747009    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs" event={"ID":"3297a7f5-cde7-4f0b-86f5-4d54cd81c669","Type":"ContainerStarted","Data":"6d470f4e0d75f3e22753d965e389d8cbc6b62876b209c23c9d007c1a168bdbe8"}
Jul 26 17:00:04.252554 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:04.252489    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 17:00:04.252935 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:04.252906    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Jul 26 17:00:04.253017 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:04.252960    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs" podUID="3297a7f5-cde7-4f0b-86f5-4d54cd81c669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Jul 26 17:00:05.253952 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:05.253503    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Jul 26 17:00:05.253952 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:05.253570    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs" podUID="3297a7f5-cde7-4f0b-86f5-4d54cd81c669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Jul 26 17:00:06.253374 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:06.253330    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Jul 26 17:00:06.253581 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:06.253405    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs" podUID="3297a7f5-cde7-4f0b-86f5-4d54cd81c669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Jul 26 17:00:07.255712 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:07.255678    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Jul 26 17:00:07.256281 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:07.256247    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs" podUID="3297a7f5-cde7-4f0b-86f5-4d54cd81c669" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Jul 26 17:00:08.255911 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:08.255880    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 17:00:08.256411 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:08.256318    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 17:00:08.257097 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:08.257074    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 17:00:11.221187 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:11.221146    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tzt22_d62e39a9-9c8e-4d8f-b329-7c47fb0daccc/payload-processing/0.log"
Jul 26 17:00:14.482475 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:14.482434    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:00:15.493874 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:15.493836    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8bbj7"]
Jul 26 17:00:15.498977 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:15.498958    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8bbj7"
Jul 26 17:00:15.506355 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:15.506318    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8bbj7"]
Jul 26 17:00:15.530326 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:15.530298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kfvb\" (UniqueName: \"kubernetes.io/projected/2da7447f-8b28-4448-8977-08682269a9b6-kube-api-access-7kfvb\") pod \"kuadrant-operator-catalog-8bbj7\" (UID: \"2da7447f-8b28-4448-8977-08682269a9b6\") " pod="kuadrant-system/kuadrant-operator-catalog-8bbj7"
Jul 26 17:00:15.631785 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:15.631747    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kfvb\" (UniqueName: \"kubernetes.io/projected/2da7447f-8b28-4448-8977-08682269a9b6-kube-api-access-7kfvb\") pod \"kuadrant-operator-catalog-8bbj7\" (UID: \"2da7447f-8b28-4448-8977-08682269a9b6\") " pod="kuadrant-system/kuadrant-operator-catalog-8bbj7"
Jul 26 17:00:15.639981 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:15.639944    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kfvb\" (UniqueName: \"kubernetes.io/projected/2da7447f-8b28-4448-8977-08682269a9b6-kube-api-access-7kfvb\") pod \"kuadrant-operator-catalog-8bbj7\" (UID: \"2da7447f-8b28-4448-8977-08682269a9b6\") " pod="kuadrant-system/kuadrant-operator-catalog-8bbj7"
Jul 26 17:00:15.810323 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:15.810229    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8bbj7"
Jul 26 17:00:15.951566 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:15.951536    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8bbj7"]
Jul 26 17:00:15.953517 ip-10-0-131-99 kubenswrapper[2559]: W0726 17:00:15.953491    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da7447f_8b28_4448_8977_08682269a9b6.slice/crio-8d7e167cfc41a37321986cf4bdc6979128b10abcf74d96486ec963ce5b6f4dc2 WatchSource:0}: Error finding container 8d7e167cfc41a37321986cf4bdc6979128b10abcf74d96486ec963ce5b6f4dc2: Status 404 returned error can't find the container with id 8d7e167cfc41a37321986cf4bdc6979128b10abcf74d96486ec963ce5b6f4dc2
Jul 26 17:00:16.825690 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:16.825600    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8bbj7" event={"ID":"2da7447f-8b28-4448-8977-08682269a9b6","Type":"ContainerStarted","Data":"024f00924e8a5b10ca203e27baa954ec12216c84fd632b3e4a19130358fc3689"}
Jul 26 17:00:16.825690 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:16.825650    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8bbj7" event={"ID":"2da7447f-8b28-4448-8977-08682269a9b6","Type":"ContainerStarted","Data":"8d7e167cfc41a37321986cf4bdc6979128b10abcf74d96486ec963ce5b6f4dc2"}
Jul 26 17:00:16.842471 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:16.842422    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8bbj7" podStartSLOduration=1.328133595 podStartE2EDuration="1.84240687s" totalImagesPullingTime="514.273275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:00:16.840170952 +0000 UTC m=+3132.374870230" watchObservedRunningTime="2026-07-26 17:00:16.84240687 +0000 UTC m=+3132.377106145"
Jul 26 17:00:25.813075 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:25.813037    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8bbj7"
Jul 26 17:00:25.813589 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:25.813104    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8bbj7"
Jul 26 17:00:25.836688 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:25.836665    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8bbj7"
Jul 26 17:00:25.894421 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:25.894395    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8bbj7"
Jul 26 17:00:26.066117 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:26.066038    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8bbj7"]
Jul 26 17:00:27.883425 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:27.883342    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8bbj7" podUID="2da7447f-8b28-4448-8977-08682269a9b6" containerName="registry-server" containerID="cri-o://024f00924e8a5b10ca203e27baa954ec12216c84fd632b3e4a19130358fc3689" gracePeriod=2
Jul 26 17:00:28.141762 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:28.141692    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8bbj7"
Jul 26 17:00:28.248189 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:28.248154    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kfvb\" (UniqueName: \"kubernetes.io/projected/2da7447f-8b28-4448-8977-08682269a9b6-kube-api-access-7kfvb\") pod \"2da7447f-8b28-4448-8977-08682269a9b6\" (UID: \"2da7447f-8b28-4448-8977-08682269a9b6\") "
Jul 26 17:00:28.250110 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:28.250084    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2da7447f-8b28-4448-8977-08682269a9b6-kube-api-access-7kfvb" (OuterVolumeSpecName: "kube-api-access-7kfvb") pod "2da7447f-8b28-4448-8977-08682269a9b6" (UID: "2da7447f-8b28-4448-8977-08682269a9b6"). InnerVolumeSpecName "kube-api-access-7kfvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 17:00:28.349619 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:28.349591    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kfvb\" (UniqueName: \"kubernetes.io/projected/2da7447f-8b28-4448-8977-08682269a9b6-kube-api-access-7kfvb\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:00:28.890069 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:28.890033    2559 generic.go:356] "Generic (PLEG): container finished" podID="2da7447f-8b28-4448-8977-08682269a9b6" containerID="024f00924e8a5b10ca203e27baa954ec12216c84fd632b3e4a19130358fc3689" exitCode=0
Jul 26 17:00:28.890554 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:28.890073    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8bbj7" event={"ID":"2da7447f-8b28-4448-8977-08682269a9b6","Type":"ContainerDied","Data":"024f00924e8a5b10ca203e27baa954ec12216c84fd632b3e4a19130358fc3689"}
Jul 26 17:00:28.890554 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:28.890090    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8bbj7"
Jul 26 17:00:28.890554 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:28.890150    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8bbj7" event={"ID":"2da7447f-8b28-4448-8977-08682269a9b6","Type":"ContainerDied","Data":"8d7e167cfc41a37321986cf4bdc6979128b10abcf74d96486ec963ce5b6f4dc2"}
Jul 26 17:00:28.890554 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:28.890182    2559 scope.go:117] "RemoveContainer" containerID="024f00924e8a5b10ca203e27baa954ec12216c84fd632b3e4a19130358fc3689"
Jul 26 17:00:28.899723 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:28.899707    2559 scope.go:117] "RemoveContainer" containerID="024f00924e8a5b10ca203e27baa954ec12216c84fd632b3e4a19130358fc3689"
Jul 26 17:00:28.899973 ip-10-0-131-99 kubenswrapper[2559]: E0726 17:00:28.899953    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"024f00924e8a5b10ca203e27baa954ec12216c84fd632b3e4a19130358fc3689\": container with ID starting with 024f00924e8a5b10ca203e27baa954ec12216c84fd632b3e4a19130358fc3689 not found: ID does not exist" containerID="024f00924e8a5b10ca203e27baa954ec12216c84fd632b3e4a19130358fc3689"
Jul 26 17:00:28.900034 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:28.899986    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"024f00924e8a5b10ca203e27baa954ec12216c84fd632b3e4a19130358fc3689"} err="failed to get container status \"024f00924e8a5b10ca203e27baa954ec12216c84fd632b3e4a19130358fc3689\": rpc error: code = NotFound desc = could not find container \"024f00924e8a5b10ca203e27baa954ec12216c84fd632b3e4a19130358fc3689\": container with ID starting with 024f00924e8a5b10ca203e27baa954ec12216c84fd632b3e4a19130358fc3689 not found: ID does not exist"
Jul 26 17:00:28.909989 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:28.909970    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8bbj7"]
Jul 26 17:00:28.913740 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:28.913718    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8bbj7"]
Jul 26 17:00:28.955514 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:28.955486    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2da7447f-8b28-4448-8977-08682269a9b6" path="/var/lib/kubelet/pods/2da7447f-8b28-4448-8977-08682269a9b6/volumes"
Jul 26 17:00:56.185963 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:56.185926    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tzt22_d62e39a9-9c8e-4d8f-b329-7c47fb0daccc/payload-processing/0.log"
Jul 26 17:00:56.577688 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:56.577588    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:00:56.894038 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:56.893932    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:00:57.179224 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:57.179139    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:00:59.632311 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:59.632276    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:00:59.734181 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:00:59.734095    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:01:02.119237 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:01:02.119201    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:01:02.563027 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:01:02.563000    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:01:02.663565 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:01:02.663520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:01:02.843047 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:01:02.842930    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:01:04.111882 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:01:04.111809    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:01:11.627305 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:01:11.627269    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:01:28.892735 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:01:28.892696    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:01:30.090296 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:01:30.090241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:01:30.211716 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:01:30.211687    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:01:30.510229 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:01:30.510196    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:01:36.860708 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:01:36.860673    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:01:36.961520 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:01:36.961492    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:01:37.137249 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:01:37.137145    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:01:37.343444 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:01:37.343370    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:02:01.155452 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.155370    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"]
Jul 26 17:02:01.156042 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.155590    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl" podUID="789f2f67-ce0c-4e60-a262-d62b99ddc4c1" containerName="maas-api" containerID="cri-o://1982ed67b7584c87817ce258facb43ff74b8edc4c757f8062a66a4d8b3a34f3f" gracePeriod=30
Jul 26 17:02:01.193252 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.193212    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:02:01.228344 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.228313    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"]
Jul 26 17:02:01.228582 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.228551    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x" podUID="01cf1e6c-8f35-457c-9212-cc4f97962ab0" containerName="payload-pre-processing" containerID="cri-o://7fa533977b458d3e9167b74c4a94b3c714e6fdf0197bb7101382a1e4bbb61a54" gracePeriod=30
Jul 26 17:02:01.292038 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.292010    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:02:01.389492 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.389454    2559 generic.go:356] "Generic (PLEG): container finished" podID="789f2f67-ce0c-4e60-a262-d62b99ddc4c1" containerID="1982ed67b7584c87817ce258facb43ff74b8edc4c757f8062a66a4d8b3a34f3f" exitCode=0
Jul 26 17:02:01.390606 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.389533    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl" event={"ID":"789f2f67-ce0c-4e60-a262-d62b99ddc4c1","Type":"ContainerDied","Data":"1982ed67b7584c87817ce258facb43ff74b8edc4c757f8062a66a4d8b3a34f3f"}
Jul 26 17:02:01.391720 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.391690    2559 generic.go:356] "Generic (PLEG): container finished" podID="01cf1e6c-8f35-457c-9212-cc4f97962ab0" containerID="7fa533977b458d3e9167b74c4a94b3c714e6fdf0197bb7101382a1e4bbb61a54" exitCode=0
Jul 26 17:02:01.392010 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.391767    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x" event={"ID":"01cf1e6c-8f35-457c-9212-cc4f97962ab0","Type":"ContainerDied","Data":"7fa533977b458d3e9167b74c4a94b3c714e6fdf0197bb7101382a1e4bbb61a54"}
Jul 26 17:02:01.392010 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.391815    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:02:01.496593 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.496569    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 17:02:01.524357 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.524328    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"
Jul 26 17:02:01.580524 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.580490    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnqrd\" (UniqueName: \"kubernetes.io/projected/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-kube-api-access-dnqrd\") pod \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\" (UID: \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\") "
Jul 26 17:02:01.580716 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.580534    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-maas-api-tls\") pod \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\" (UID: \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\") "
Jul 26 17:02:01.580716 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.580552    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01cf1e6c-8f35-457c-9212-cc4f97962ab0-plugins-config-volume\") pod \"01cf1e6c-8f35-457c-9212-cc4f97962ab0\" (UID: \"01cf1e6c-8f35-457c-9212-cc4f97962ab0\") "
Jul 26 17:02:01.580716 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.580579    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-openshift-service-ca\") pod \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\" (UID: \"789f2f67-ce0c-4e60-a262-d62b99ddc4c1\") "
Jul 26 17:02:01.580716 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.580601    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78w9l\" (UniqueName: \"kubernetes.io/projected/01cf1e6c-8f35-457c-9212-cc4f97962ab0-kube-api-access-78w9l\") pod \"01cf1e6c-8f35-457c-9212-cc4f97962ab0\" (UID: \"01cf1e6c-8f35-457c-9212-cc4f97962ab0\") "
Jul 26 17:02:01.580943 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.580885    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01cf1e6c-8f35-457c-9212-cc4f97962ab0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "01cf1e6c-8f35-457c-9212-cc4f97962ab0" (UID: "01cf1e6c-8f35-457c-9212-cc4f97962ab0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 17:02:01.580943 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.580927    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "789f2f67-ce0c-4e60-a262-d62b99ddc4c1" (UID: "789f2f67-ce0c-4e60-a262-d62b99ddc4c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 17:02:01.582663 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.582638    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "789f2f67-ce0c-4e60-a262-d62b99ddc4c1" (UID: "789f2f67-ce0c-4e60-a262-d62b99ddc4c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 17:02:01.582770 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.582660    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01cf1e6c-8f35-457c-9212-cc4f97962ab0-kube-api-access-78w9l" (OuterVolumeSpecName: "kube-api-access-78w9l") pod "01cf1e6c-8f35-457c-9212-cc4f97962ab0" (UID: "01cf1e6c-8f35-457c-9212-cc4f97962ab0"). InnerVolumeSpecName "kube-api-access-78w9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 17:02:01.582770 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.582707    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-kube-api-access-dnqrd" (OuterVolumeSpecName: "kube-api-access-dnqrd") pod "789f2f67-ce0c-4e60-a262-d62b99ddc4c1" (UID: "789f2f67-ce0c-4e60-a262-d62b99ddc4c1"). InnerVolumeSpecName "kube-api-access-dnqrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 17:02:01.681866 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.681779    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-openshift-service-ca\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:02:01.681866 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.681809    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78w9l\" (UniqueName: \"kubernetes.io/projected/01cf1e6c-8f35-457c-9212-cc4f97962ab0-kube-api-access-78w9l\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:02:01.681866 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.681830    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnqrd\" (UniqueName: \"kubernetes.io/projected/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-kube-api-access-dnqrd\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:02:01.681866 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.681840    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/789f2f67-ce0c-4e60-a262-d62b99ddc4c1-maas-api-tls\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:02:01.681866 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:01.681848    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01cf1e6c-8f35-457c-9212-cc4f97962ab0-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:02:02.398295 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:02.398262    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"
Jul 26 17:02:02.398733 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:02.398298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl" event={"ID":"789f2f67-ce0c-4e60-a262-d62b99ddc4c1","Type":"ContainerDied","Data":"0c170203ffcdd1735bd566c3f8922198675097f66058dc1f0fec34254d820323"}
Jul 26 17:02:02.398733 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:02.398365    2559 scope.go:117] "RemoveContainer" containerID="1982ed67b7584c87817ce258facb43ff74b8edc4c757f8062a66a4d8b3a34f3f"
Jul 26 17:02:02.399784 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:02.399697    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"
Jul 26 17:02:02.399784 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:02.399670    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x" event={"ID":"01cf1e6c-8f35-457c-9212-cc4f97962ab0","Type":"ContainerDied","Data":"20a012cb8ced3a8c05afcc4a1cc722ce7213dd6f9e783479e0000b45306d6689"}
Jul 26 17:02:02.409073 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:02.409054    2559 scope.go:117] "RemoveContainer" containerID="7fa533977b458d3e9167b74c4a94b3c714e6fdf0197bb7101382a1e4bbb61a54"
Jul 26 17:02:02.426436 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:02.426387    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"]
Jul 26 17:02:02.429629 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:02.429609    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-50e630-59c48785f8-ltjgl"]
Jul 26 17:02:02.440267 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:02.440247    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"]
Jul 26 17:02:02.444013 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:02.443994    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-50e630-69cbbb7864-kns6x"]
Jul 26 17:02:02.955321 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:02.955281    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01cf1e6c-8f35-457c-9212-cc4f97962ab0" path="/var/lib/kubelet/pods/01cf1e6c-8f35-457c-9212-cc4f97962ab0/volumes"
Jul 26 17:02:02.955772 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:02.955752    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="789f2f67-ce0c-4e60-a262-d62b99ddc4c1" path="/var/lib/kubelet/pods/789f2f67-ce0c-4e60-a262-d62b99ddc4c1/volumes"
Jul 26 17:02:05.838856 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:05.838772    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:02:06.222539 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:06.222504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:02:07.000375 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:07.000341    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:02:11.255867 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:11.255830    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:02:48.590053 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:48.590005    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:02:48.954021 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:48.953989    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:02:54.595497 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:02:54.595466    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:05.234831 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:05.234804    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 17:03:05.241337 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:05.241314    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 17:03:09.571806 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:09.571769    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:09.670639 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:09.670605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:09.859528 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:09.859433    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:10.077752 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:10.077723    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:21.410896 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:21.410861    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:21.617892 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:21.617857    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:21.718414 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:21.718377    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:25.271571 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:25.271540    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:25.659399 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:25.659313    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:31.739727 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:31.739648    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:31.840502 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:31.840471    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:31.990332 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:31.990249    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"]
Jul 26 17:03:31.990529 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:31.990497    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs" podUID="3297a7f5-cde7-4f0b-86f5-4d54cd81c669" containerName="istio-proxy" containerID="cri-o://6d470f4e0d75f3e22753d965e389d8cbc6b62876b209c23c9d007c1a168bdbe8" gracePeriod=30
Jul 26 17:03:32.000248 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:32.000222    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:32.239570 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:32.239540    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:37.269918 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.269846    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 17:03:37.369209 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.369174    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfcrq\" (UniqueName: \"kubernetes.io/projected/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-kube-api-access-nfcrq\") pod \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") "
Jul 26 17:03:37.369209 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.369216    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-workload-certs\") pod \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") "
Jul 26 17:03:37.369487 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.369268    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-workload-socket\") pod \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") "
Jul 26 17:03:37.369487 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.369318    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-podinfo\") pod \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") "
Jul 26 17:03:37.369487 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.369367    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-envoy\") pod \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") "
Jul 26 17:03:37.369487 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.369395    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-token\") pod \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") "
Jul 26 17:03:37.369487 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.369426    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-data\") pod \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") "
Jul 26 17:03:37.369810 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.369490    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istiod-ca-cert\") pod \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") "
Jul 26 17:03:37.369810 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.369514    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-credential-socket\") pod \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\" (UID: \"3297a7f5-cde7-4f0b-86f5-4d54cd81c669\") "
Jul 26 17:03:37.369810 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.369607    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3297a7f5-cde7-4f0b-86f5-4d54cd81c669" (UID: "3297a7f5-cde7-4f0b-86f5-4d54cd81c669"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 17:03:37.369810 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.369623    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3297a7f5-cde7-4f0b-86f5-4d54cd81c669" (UID: "3297a7f5-cde7-4f0b-86f5-4d54cd81c669"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 17:03:37.370061 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.369864    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-workload-certs\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:03:37.370061 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.369908    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-workload-socket\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:03:37.370061 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.369925    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3297a7f5-cde7-4f0b-86f5-4d54cd81c669" (UID: "3297a7f5-cde7-4f0b-86f5-4d54cd81c669"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 17:03:37.370243 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.370141    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3297a7f5-cde7-4f0b-86f5-4d54cd81c669" (UID: "3297a7f5-cde7-4f0b-86f5-4d54cd81c669"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 17:03:37.370477 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.370449    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-data" (OuterVolumeSpecName: "istio-data") pod "3297a7f5-cde7-4f0b-86f5-4d54cd81c669" (UID: "3297a7f5-cde7-4f0b-86f5-4d54cd81c669"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 17:03:37.371909 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.371876    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-kube-api-access-nfcrq" (OuterVolumeSpecName: "kube-api-access-nfcrq") pod "3297a7f5-cde7-4f0b-86f5-4d54cd81c669" (UID: "3297a7f5-cde7-4f0b-86f5-4d54cd81c669"). InnerVolumeSpecName "kube-api-access-nfcrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 17:03:37.372147 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.372105    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3297a7f5-cde7-4f0b-86f5-4d54cd81c669" (UID: "3297a7f5-cde7-4f0b-86f5-4d54cd81c669"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 17:03:37.372436 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.372411    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3297a7f5-cde7-4f0b-86f5-4d54cd81c669" (UID: "3297a7f5-cde7-4f0b-86f5-4d54cd81c669"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 17:03:37.372529 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.372411    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-token" (OuterVolumeSpecName: "istio-token") pod "3297a7f5-cde7-4f0b-86f5-4d54cd81c669" (UID: "3297a7f5-cde7-4f0b-86f5-4d54cd81c669"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 17:03:37.471038 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.471009    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istiod-ca-cert\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:03:37.471038 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.471034    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-credential-socket\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:03:37.471038 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.471043    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfcrq\" (UniqueName: \"kubernetes.io/projected/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-kube-api-access-nfcrq\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:03:37.471289 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.471052    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-podinfo\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:03:37.471289 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.471060    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-envoy\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:03:37.471289 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.471068    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-token\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:03:37.471289 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.471075    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3297a7f5-cde7-4f0b-86f5-4d54cd81c669-istio-data\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:03:37.906475 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.906439    2559 generic.go:356] "Generic (PLEG): container finished" podID="3297a7f5-cde7-4f0b-86f5-4d54cd81c669" containerID="6d470f4e0d75f3e22753d965e389d8cbc6b62876b209c23c9d007c1a168bdbe8" exitCode=0
Jul 26 17:03:37.906676 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.906486    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"
Jul 26 17:03:37.906676 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.906526    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs" event={"ID":"3297a7f5-cde7-4f0b-86f5-4d54cd81c669","Type":"ContainerDied","Data":"6d470f4e0d75f3e22753d965e389d8cbc6b62876b209c23c9d007c1a168bdbe8"}
Jul 26 17:03:37.906676 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.906617    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs" event={"ID":"3297a7f5-cde7-4f0b-86f5-4d54cd81c669","Type":"ContainerDied","Data":"da4769cdf968aae4fe61e93b34d1c3f81b22951407e6fcd5e584a57a9a68f005"}
Jul 26 17:03:37.906676 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.906650    2559 scope.go:117] "RemoveContainer" containerID="6d470f4e0d75f3e22753d965e389d8cbc6b62876b209c23c9d007c1a168bdbe8"
Jul 26 17:03:37.916330 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.916314    2559 scope.go:117] "RemoveContainer" containerID="1c21f5df4fde8d2bf7c03627e561e32a0b74254086583398173f19639ad09a50"
Jul 26 17:03:37.924671 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.924655    2559 scope.go:117] "RemoveContainer" containerID="6d470f4e0d75f3e22753d965e389d8cbc6b62876b209c23c9d007c1a168bdbe8"
Jul 26 17:03:37.924901 ip-10-0-131-99 kubenswrapper[2559]: E0726 17:03:37.924880    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d470f4e0d75f3e22753d965e389d8cbc6b62876b209c23c9d007c1a168bdbe8\": container with ID starting with 6d470f4e0d75f3e22753d965e389d8cbc6b62876b209c23c9d007c1a168bdbe8 not found: ID does not exist" containerID="6d470f4e0d75f3e22753d965e389d8cbc6b62876b209c23c9d007c1a168bdbe8"
Jul 26 17:03:37.924975 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.924912    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d470f4e0d75f3e22753d965e389d8cbc6b62876b209c23c9d007c1a168bdbe8"} err="failed to get container status \"6d470f4e0d75f3e22753d965e389d8cbc6b62876b209c23c9d007c1a168bdbe8\": rpc error: code = NotFound desc = could not find container \"6d470f4e0d75f3e22753d965e389d8cbc6b62876b209c23c9d007c1a168bdbe8\": container with ID starting with 6d470f4e0d75f3e22753d965e389d8cbc6b62876b209c23c9d007c1a168bdbe8 not found: ID does not exist"
Jul 26 17:03:37.924975 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.924937    2559 scope.go:117] "RemoveContainer" containerID="1c21f5df4fde8d2bf7c03627e561e32a0b74254086583398173f19639ad09a50"
Jul 26 17:03:37.925205 ip-10-0-131-99 kubenswrapper[2559]: E0726 17:03:37.925176    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c21f5df4fde8d2bf7c03627e561e32a0b74254086583398173f19639ad09a50\": container with ID starting with 1c21f5df4fde8d2bf7c03627e561e32a0b74254086583398173f19639ad09a50 not found: ID does not exist" containerID="1c21f5df4fde8d2bf7c03627e561e32a0b74254086583398173f19639ad09a50"
Jul 26 17:03:37.925274 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.925205    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c21f5df4fde8d2bf7c03627e561e32a0b74254086583398173f19639ad09a50"} err="failed to get container status \"1c21f5df4fde8d2bf7c03627e561e32a0b74254086583398173f19639ad09a50\": rpc error: code = NotFound desc = could not find container \"1c21f5df4fde8d2bf7c03627e561e32a0b74254086583398173f19639ad09a50\": container with ID starting with 1c21f5df4fde8d2bf7c03627e561e32a0b74254086583398173f19639ad09a50 not found: ID does not exist"
Jul 26 17:03:37.928253 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.928232    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"]
Jul 26 17:03:37.934060 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:37.934041    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-930b99-openshift-default-6f66654bdd-khvhs"]
Jul 26 17:03:38.955697 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:38.955666    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3297a7f5-cde7-4f0b-86f5-4d54cd81c669" path="/var/lib/kubelet/pods/3297a7f5-cde7-4f0b-86f5-4d54cd81c669/volumes"
Jul 26 17:03:43.931961 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:43.931921    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"]
Jul 26 17:03:43.932429 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:43.932192    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm" podUID="b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6" containerName="maas-api" containerID="cri-o://83e29612c2e3a4336e56747d3c93f2f89117e67cd217a7068a8784415ef8bb68" gracePeriod=30
Jul 26 17:03:43.960474 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:43.960451    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:43.999988 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:43.999961    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"]
Jul 26 17:03:44.000217 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.000188    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv" podUID="4bcaca0f-465a-4810-b596-4dd74e7eb270" containerName="payload-pre-processing" containerID="cri-o://89e12dc2c4ed891e1837323b5b54e75206d7c41d9a54e44b0141877a306ad211" gracePeriod=30
Jul 26 17:03:44.059085 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.059054    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:44.106691 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.106641    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm" podUID="b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.83:8443/health\": dial tcp 10.132.0.83:8443: connect: connection refused"
Jul 26 17:03:44.161330 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.161290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:44.276904 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.276876    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 17:03:44.280888 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.280865    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"
Jul 26 17:03:44.435666 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.435632    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrdq5\" (UniqueName: \"kubernetes.io/projected/4bcaca0f-465a-4810-b596-4dd74e7eb270-kube-api-access-qrdq5\") pod \"4bcaca0f-465a-4810-b596-4dd74e7eb270\" (UID: \"4bcaca0f-465a-4810-b596-4dd74e7eb270\") "
Jul 26 17:03:44.435872 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.435678    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bcaca0f-465a-4810-b596-4dd74e7eb270-plugins-config-volume\") pod \"4bcaca0f-465a-4810-b596-4dd74e7eb270\" (UID: \"4bcaca0f-465a-4810-b596-4dd74e7eb270\") "
Jul 26 17:03:44.435872 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.435696    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-openshift-service-ca\") pod \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\" (UID: \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\") "
Jul 26 17:03:44.435872 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.435732    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-maas-api-tls\") pod \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\" (UID: \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\") "
Jul 26 17:03:44.435872 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.435769    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4frm4\" (UniqueName: \"kubernetes.io/projected/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-kube-api-access-4frm4\") pod \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\" (UID: \"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6\") "
Jul 26 17:03:44.436191 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.436158    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6" (UID: "b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 17:03:44.436317 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.436222    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bcaca0f-465a-4810-b596-4dd74e7eb270-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4bcaca0f-465a-4810-b596-4dd74e7eb270" (UID: "4bcaca0f-465a-4810-b596-4dd74e7eb270"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 17:03:44.437845 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.437787    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-kube-api-access-4frm4" (OuterVolumeSpecName: "kube-api-access-4frm4") pod "b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6" (UID: "b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6"). InnerVolumeSpecName "kube-api-access-4frm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 17:03:44.438275 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.438245    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bcaca0f-465a-4810-b596-4dd74e7eb270-kube-api-access-qrdq5" (OuterVolumeSpecName: "kube-api-access-qrdq5") pod "4bcaca0f-465a-4810-b596-4dd74e7eb270" (UID: "4bcaca0f-465a-4810-b596-4dd74e7eb270"). InnerVolumeSpecName "kube-api-access-qrdq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 17:03:44.438275 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.438239    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6" (UID: "b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 17:03:44.536865 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.536833    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrdq5\" (UniqueName: \"kubernetes.io/projected/4bcaca0f-465a-4810-b596-4dd74e7eb270-kube-api-access-qrdq5\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:03:44.536865 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.536864    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bcaca0f-465a-4810-b596-4dd74e7eb270-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:03:44.536865 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.536875    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-openshift-service-ca\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:03:44.537111 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.536885    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-maas-api-tls\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:03:44.537111 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.536896    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4frm4\" (UniqueName: \"kubernetes.io/projected/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6-kube-api-access-4frm4\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:03:44.947713 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.947680    2559 generic.go:356] "Generic (PLEG): container finished" podID="b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6" containerID="83e29612c2e3a4336e56747d3c93f2f89117e67cd217a7068a8784415ef8bb68" exitCode=0
Jul 26 17:03:44.948104 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.947729    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"
Jul 26 17:03:44.948104 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.947769    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm" event={"ID":"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6","Type":"ContainerDied","Data":"83e29612c2e3a4336e56747d3c93f2f89117e67cd217a7068a8784415ef8bb68"}
Jul 26 17:03:44.948104 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.947827    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm" event={"ID":"b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6","Type":"ContainerDied","Data":"70e37675d7212ed64bd3a40b843c55a6d4391b12571fea3d1a2a3031e9796c3a"}
Jul 26 17:03:44.948104 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.947857    2559 scope.go:117] "RemoveContainer" containerID="83e29612c2e3a4336e56747d3c93f2f89117e67cd217a7068a8784415ef8bb68"
Jul 26 17:03:44.949735 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.949708    2559 generic.go:356] "Generic (PLEG): container finished" podID="4bcaca0f-465a-4810-b596-4dd74e7eb270" containerID="89e12dc2c4ed891e1837323b5b54e75206d7c41d9a54e44b0141877a306ad211" exitCode=0
Jul 26 17:03:44.949845 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.949806    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"
Jul 26 17:03:44.956769 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.956741    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv" event={"ID":"4bcaca0f-465a-4810-b596-4dd74e7eb270","Type":"ContainerDied","Data":"89e12dc2c4ed891e1837323b5b54e75206d7c41d9a54e44b0141877a306ad211"}
Jul 26 17:03:44.956890 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.956795    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv" event={"ID":"4bcaca0f-465a-4810-b596-4dd74e7eb270","Type":"ContainerDied","Data":"fd2e3f599ec88b8476aa75ae33d28c4b2c97aaaca60a9be39da84ebb5f9fbc1a"}
Jul 26 17:03:44.961589 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.961571    2559 scope.go:117] "RemoveContainer" containerID="83e29612c2e3a4336e56747d3c93f2f89117e67cd217a7068a8784415ef8bb68"
Jul 26 17:03:44.961899 ip-10-0-131-99 kubenswrapper[2559]: E0726 17:03:44.961873    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83e29612c2e3a4336e56747d3c93f2f89117e67cd217a7068a8784415ef8bb68\": container with ID starting with 83e29612c2e3a4336e56747d3c93f2f89117e67cd217a7068a8784415ef8bb68 not found: ID does not exist" containerID="83e29612c2e3a4336e56747d3c93f2f89117e67cd217a7068a8784415ef8bb68"
Jul 26 17:03:44.961993 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.961907    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83e29612c2e3a4336e56747d3c93f2f89117e67cd217a7068a8784415ef8bb68"} err="failed to get container status \"83e29612c2e3a4336e56747d3c93f2f89117e67cd217a7068a8784415ef8bb68\": rpc error: code = NotFound desc = could not find container \"83e29612c2e3a4336e56747d3c93f2f89117e67cd217a7068a8784415ef8bb68\": container with ID starting with 83e29612c2e3a4336e56747d3c93f2f89117e67cd217a7068a8784415ef8bb68 not found: ID does not exist"
Jul 26 17:03:44.961993 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.961926    2559 scope.go:117] "RemoveContainer" containerID="89e12dc2c4ed891e1837323b5b54e75206d7c41d9a54e44b0141877a306ad211"
Jul 26 17:03:44.970452 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.970433    2559 scope.go:117] "RemoveContainer" containerID="89e12dc2c4ed891e1837323b5b54e75206d7c41d9a54e44b0141877a306ad211"
Jul 26 17:03:44.970680 ip-10-0-131-99 kubenswrapper[2559]: E0726 17:03:44.970663    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89e12dc2c4ed891e1837323b5b54e75206d7c41d9a54e44b0141877a306ad211\": container with ID starting with 89e12dc2c4ed891e1837323b5b54e75206d7c41d9a54e44b0141877a306ad211 not found: ID does not exist" containerID="89e12dc2c4ed891e1837323b5b54e75206d7c41d9a54e44b0141877a306ad211"
Jul 26 17:03:44.970750 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.970690    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e12dc2c4ed891e1837323b5b54e75206d7c41d9a54e44b0141877a306ad211"} err="failed to get container status \"89e12dc2c4ed891e1837323b5b54e75206d7c41d9a54e44b0141877a306ad211\": rpc error: code = NotFound desc = could not find container \"89e12dc2c4ed891e1837323b5b54e75206d7c41d9a54e44b0141877a306ad211\": container with ID starting with 89e12dc2c4ed891e1837323b5b54e75206d7c41d9a54e44b0141877a306ad211 not found: ID does not exist"
Jul 26 17:03:44.975954 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.975933    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"]
Jul 26 17:03:44.979605 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.979585    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1b2072-76ccfd8d5f-2l2gm"]
Jul 26 17:03:44.988550 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.988531    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"]
Jul 26 17:03:44.994781 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:44.994762    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-1b2072-59b84dcf7b-lhwbv"]
Jul 26 17:03:46.956406 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:46.956368    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bcaca0f-465a-4810-b596-4dd74e7eb270" path="/var/lib/kubelet/pods/4bcaca0f-465a-4810-b596-4dd74e7eb270/volumes"
Jul 26 17:03:46.956961 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:46.956935    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6" path="/var/lib/kubelet/pods/b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6/volumes"
Jul 26 17:03:47.485254 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:47.485217    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:47.878197 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:47.878101    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:54.251462 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:54.251424    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:54.351940 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:54.351903    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:54.514412 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:54.514332    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:03:54.740575 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:03:54.740546    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:04:03.875998 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:03.875960    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:04:05.658913 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:05.658879    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:04:05.681860 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:05.681834    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"]
Jul 26 17:04:05.682080 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:05.682052    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj" podUID="b6d23cdc-1d6c-4a37-adba-addc6da631b9" containerName="payload-processing" containerID="cri-o://c542143f64ba48b4dd2877b7a1dc860f32ed5a52617879ad02b2e92ac34ce70a" gracePeriod=30
Jul 26 17:04:05.689797 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:05.689713    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"]
Jul 26 17:04:05.689990 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:05.689929    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk" podUID="4b0f1b5e-fbb9-4c6a-9031-0b096577c746" containerName="payload-pre-processing" containerID="cri-o://91d6d81c6ae809496cf0cb1428f4bfcc149bf4e600d12fd8d33154f7ff72b281" gracePeriod=30
Jul 26 17:04:05.726329 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:05.726303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:04:05.828481 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:05.828449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:04:05.942753 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:05.942726    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"
Jul 26 17:04:05.980472 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:05.980449    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"
Jul 26 17:04:06.028886 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.028854    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6d23cdc-1d6c-4a37-adba-addc6da631b9-plugins-config-volume\") pod \"b6d23cdc-1d6c-4a37-adba-addc6da631b9\" (UID: \"b6d23cdc-1d6c-4a37-adba-addc6da631b9\") "
Jul 26 17:04:06.029041 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.028904    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dpfh\" (UniqueName: \"kubernetes.io/projected/4b0f1b5e-fbb9-4c6a-9031-0b096577c746-kube-api-access-7dpfh\") pod \"4b0f1b5e-fbb9-4c6a-9031-0b096577c746\" (UID: \"4b0f1b5e-fbb9-4c6a-9031-0b096577c746\") "
Jul 26 17:04:06.029041 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.029024    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b0f1b5e-fbb9-4c6a-9031-0b096577c746-plugins-config-volume\") pod \"4b0f1b5e-fbb9-4c6a-9031-0b096577c746\" (UID: \"4b0f1b5e-fbb9-4c6a-9031-0b096577c746\") "
Jul 26 17:04:06.029168 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.029058    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvx8x\" (UniqueName: \"kubernetes.io/projected/b6d23cdc-1d6c-4a37-adba-addc6da631b9-kube-api-access-fvx8x\") pod \"b6d23cdc-1d6c-4a37-adba-addc6da631b9\" (UID: \"b6d23cdc-1d6c-4a37-adba-addc6da631b9\") "
Jul 26 17:04:06.029412 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.029382    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6d23cdc-1d6c-4a37-adba-addc6da631b9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b6d23cdc-1d6c-4a37-adba-addc6da631b9" (UID: "b6d23cdc-1d6c-4a37-adba-addc6da631b9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 17:04:06.029501 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.029422    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b0f1b5e-fbb9-4c6a-9031-0b096577c746-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4b0f1b5e-fbb9-4c6a-9031-0b096577c746" (UID: "4b0f1b5e-fbb9-4c6a-9031-0b096577c746"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 17:04:06.029553 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.029500    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b0f1b5e-fbb9-4c6a-9031-0b096577c746-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:04:06.029553 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.029516    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6d23cdc-1d6c-4a37-adba-addc6da631b9-plugins-config-volume\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:04:06.031090 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.031064    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6d23cdc-1d6c-4a37-adba-addc6da631b9-kube-api-access-fvx8x" (OuterVolumeSpecName: "kube-api-access-fvx8x") pod "b6d23cdc-1d6c-4a37-adba-addc6da631b9" (UID: "b6d23cdc-1d6c-4a37-adba-addc6da631b9"). InnerVolumeSpecName "kube-api-access-fvx8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 17:04:06.031216 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.031114    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b0f1b5e-fbb9-4c6a-9031-0b096577c746-kube-api-access-7dpfh" (OuterVolumeSpecName: "kube-api-access-7dpfh") pod "4b0f1b5e-fbb9-4c6a-9031-0b096577c746" (UID: "4b0f1b5e-fbb9-4c6a-9031-0b096577c746"). InnerVolumeSpecName "kube-api-access-7dpfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 17:04:06.059912 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.059833    2559 generic.go:356] "Generic (PLEG): container finished" podID="b6d23cdc-1d6c-4a37-adba-addc6da631b9" containerID="c542143f64ba48b4dd2877b7a1dc860f32ed5a52617879ad02b2e92ac34ce70a" exitCode=0
Jul 26 17:04:06.059912 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.059880    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"
Jul 26 17:04:06.060110 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.059932    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj" event={"ID":"b6d23cdc-1d6c-4a37-adba-addc6da631b9","Type":"ContainerDied","Data":"c542143f64ba48b4dd2877b7a1dc860f32ed5a52617879ad02b2e92ac34ce70a"}
Jul 26 17:04:06.060110 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.059992    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj" event={"ID":"b6d23cdc-1d6c-4a37-adba-addc6da631b9","Type":"ContainerDied","Data":"a51d0cab469fc7b44cbb73a279106a1e22295e17e958f7998c130fda607ca0b3"}
Jul 26 17:04:06.060110 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.060021    2559 scope.go:117] "RemoveContainer" containerID="c542143f64ba48b4dd2877b7a1dc860f32ed5a52617879ad02b2e92ac34ce70a"
Jul 26 17:04:06.061724 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.061700    2559 generic.go:356] "Generic (PLEG): container finished" podID="4b0f1b5e-fbb9-4c6a-9031-0b096577c746" containerID="91d6d81c6ae809496cf0cb1428f4bfcc149bf4e600d12fd8d33154f7ff72b281" exitCode=0
Jul 26 17:04:06.061833 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.061736    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"
Jul 26 17:04:06.061833 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.061783    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk" event={"ID":"4b0f1b5e-fbb9-4c6a-9031-0b096577c746","Type":"ContainerDied","Data":"91d6d81c6ae809496cf0cb1428f4bfcc149bf4e600d12fd8d33154f7ff72b281"}
Jul 26 17:04:06.061956 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.061837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk" event={"ID":"4b0f1b5e-fbb9-4c6a-9031-0b096577c746","Type":"ContainerDied","Data":"f5c490884e935952a360800c1bb34a9ff8c2d21b6a5ccce1c2265723d7696743"}
Jul 26 17:04:06.069714 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.069612    2559 scope.go:117] "RemoveContainer" containerID="c542143f64ba48b4dd2877b7a1dc860f32ed5a52617879ad02b2e92ac34ce70a"
Jul 26 17:04:06.069951 ip-10-0-131-99 kubenswrapper[2559]: E0726 17:04:06.069928    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c542143f64ba48b4dd2877b7a1dc860f32ed5a52617879ad02b2e92ac34ce70a\": container with ID starting with c542143f64ba48b4dd2877b7a1dc860f32ed5a52617879ad02b2e92ac34ce70a not found: ID does not exist" containerID="c542143f64ba48b4dd2877b7a1dc860f32ed5a52617879ad02b2e92ac34ce70a"
Jul 26 17:04:06.070029 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.069958    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c542143f64ba48b4dd2877b7a1dc860f32ed5a52617879ad02b2e92ac34ce70a"} err="failed to get container status \"c542143f64ba48b4dd2877b7a1dc860f32ed5a52617879ad02b2e92ac34ce70a\": rpc error: code = NotFound desc = could not find container \"c542143f64ba48b4dd2877b7a1dc860f32ed5a52617879ad02b2e92ac34ce70a\": container with ID starting with c542143f64ba48b4dd2877b7a1dc860f32ed5a52617879ad02b2e92ac34ce70a not found: ID does not exist"
Jul 26 17:04:06.070029 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.069974    2559 scope.go:117] "RemoveContainer" containerID="91d6d81c6ae809496cf0cb1428f4bfcc149bf4e600d12fd8d33154f7ff72b281"
Jul 26 17:04:06.077881 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.077864    2559 scope.go:117] "RemoveContainer" containerID="91d6d81c6ae809496cf0cb1428f4bfcc149bf4e600d12fd8d33154f7ff72b281"
Jul 26 17:04:06.078138 ip-10-0-131-99 kubenswrapper[2559]: E0726 17:04:06.078106    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91d6d81c6ae809496cf0cb1428f4bfcc149bf4e600d12fd8d33154f7ff72b281\": container with ID starting with 91d6d81c6ae809496cf0cb1428f4bfcc149bf4e600d12fd8d33154f7ff72b281 not found: ID does not exist" containerID="91d6d81c6ae809496cf0cb1428f4bfcc149bf4e600d12fd8d33154f7ff72b281"
Jul 26 17:04:06.078250 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.078229    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91d6d81c6ae809496cf0cb1428f4bfcc149bf4e600d12fd8d33154f7ff72b281"} err="failed to get container status \"91d6d81c6ae809496cf0cb1428f4bfcc149bf4e600d12fd8d33154f7ff72b281\": rpc error: code = NotFound desc = could not find container \"91d6d81c6ae809496cf0cb1428f4bfcc149bf4e600d12fd8d33154f7ff72b281\": container with ID starting with 91d6d81c6ae809496cf0cb1428f4bfcc149bf4e600d12fd8d33154f7ff72b281 not found: ID does not exist"
Jul 26 17:04:06.084542 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.084522    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"]
Jul 26 17:04:06.087959 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.087941    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a06722-7fdcdb44f6-g6jwk"]
Jul 26 17:04:06.096942 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.096923    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"]
Jul 26 17:04:06.101052 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.101033    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-a06722-965bcbcdb-kqwxj"]
Jul 26 17:04:06.130042 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.130025    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dpfh\" (UniqueName: \"kubernetes.io/projected/4b0f1b5e-fbb9-4c6a-9031-0b096577c746-kube-api-access-7dpfh\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:04:06.130111 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.130043    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvx8x\" (UniqueName: \"kubernetes.io/projected/b6d23cdc-1d6c-4a37-adba-addc6da631b9-kube-api-access-fvx8x\") on node \"ip-10-0-131-99.ec2.internal\" DevicePath \"\""
Jul 26 17:04:06.955923 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.955843    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b0f1b5e-fbb9-4c6a-9031-0b096577c746" path="/var/lib/kubelet/pods/4b0f1b5e-fbb9-4c6a-9031-0b096577c746/volumes"
Jul 26 17:04:06.956273 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:06.956228    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6d23cdc-1d6c-4a37-adba-addc6da631b9" path="/var/lib/kubelet/pods/b6d23cdc-1d6c-4a37-adba-addc6da631b9/volumes"
Jul 26 17:04:09.931166 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:09.931117    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:04:10.319551 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:10.319520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:04:16.109788 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:16.109750    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:04:16.168736 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:16.168703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:04:16.367987 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:16.367880    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:04:16.603305 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:16.603273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:04:22.221254 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:22.221229    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8t26j_8156b810-a774-4b2a-8cb3-92003838c0a7/manager/0.log"
Jul 26 17:04:22.587263 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:22.587183    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-mczbl_6b5f62b4-cbc0-43b1-8e39-ff053ef4c392/server/0.log"
Jul 26 17:04:22.703843 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:22.703811    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jrmqn_f98a39dd-5919-43c5-8ce6-9f90b20fa92a/manager/0.log"
Jul 26 17:04:22.819350 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:22.819292    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bd4986cdb-g4hhm_87d59085-2ddc-4e68-bcc1-e9d100dd24c2/copy-manifests/0.log"
Jul 26 17:04:22.825729 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:22.825708    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bd4986cdb-g4hhm_87d59085-2ddc-4e68-bcc1-e9d100dd24c2/manager/0.log"
Jul 26 17:04:23.524747 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:23.524719    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29751390-fxss5_40ff82f3-aaee-4f6f-b1fa-b8d28fc58147/cleanup/0.log"
Jul 26 17:04:23.857689 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:23.857615    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-s7v4v_b24e3e6b-baa1-4910-9471-c7333b38d00e/postgres/0.log"
Jul 26 17:04:25.226059 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:25.226027    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-trqkk_dd4d6f54-b128-4549-9330-a4ce7a5e63fd/manager/0.log"
Jul 26 17:04:25.338622 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:25.338586    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dgq2k_1de5e7e5-a455-4326-b244-769090503f22/manager/0.log"
Jul 26 17:04:25.448590 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:25.448562    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-b6ggp_cd65ffc6-a847-47ba-8250-33b5dd136bc7/kuadrant-console-plugin/0.log"
Jul 26 17:04:25.561436 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:25.561362    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8xst5_179c3af6-d835-495d-903c-360effb03056/registry-server/0.log"
Jul 26 17:04:25.896414 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:25.896316    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vdzn4_666e33ce-b441-4eca-a978-7527a1222328/manager/0.log"
Jul 26 17:04:26.575695 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:26.575622    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff4cb76d8-nbhzm_7afe94df-ac8d-4d8a-8e17-f24a6f05c6db/kube-auth-proxy/0.log"
Jul 26 17:04:26.691139 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:26.691097    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-85dpz_c9bb9915-63d0-4798-805e-c3351f4a529a/istio-proxy/1.log"
Jul 26 17:04:26.803222 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:26.803197    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tnfmc_d021cdfb-bbff-4e0a-9493-28c7e8483e2b/payload-pre-processing/0.log"
Jul 26 17:04:26.922426 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:26.922326    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tzt22_d62e39a9-9c8e-4d8f-b329-7c47fb0daccc/payload-processing/0.log"
Jul 26 17:04:27.035113 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:27.035078    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64c4699495-5f5tt_976d4655-f3a5-48e1-bc28-64652772d878/router/0.log"
Jul 26 17:04:27.372182 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:27.372154    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-dsbmb_e506d497-3cea-46e4-8e67-8408b0f3ecb7/main/0.log"
Jul 26 17:04:27.715437 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:27.715411    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwk8ph_5d359aca-d52c-4ec3-82d3-a8a220c1f49e/main/0.log"
Jul 26 17:04:33.408729 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.408699    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bnlmg/must-gather-dw5tn"]
Jul 26 17:04:33.409137 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409108    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da7447f-8b28-4448-8977-08682269a9b6" containerName="registry-server"
Jul 26 17:04:33.409137 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409135    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da7447f-8b28-4448-8977-08682269a9b6" containerName="registry-server"
Jul 26 17:04:33.409231 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409144    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3297a7f5-cde7-4f0b-86f5-4d54cd81c669" containerName="istio-proxy"
Jul 26 17:04:33.409231 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409150    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3297a7f5-cde7-4f0b-86f5-4d54cd81c669" containerName="istio-proxy"
Jul 26 17:04:33.409231 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409175    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b0f1b5e-fbb9-4c6a-9031-0b096577c746" containerName="payload-pre-processing"
Jul 26 17:04:33.409231 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409184    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b0f1b5e-fbb9-4c6a-9031-0b096577c746" containerName="payload-pre-processing"
Jul 26 17:04:33.409231 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409195    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01cf1e6c-8f35-457c-9212-cc4f97962ab0" containerName="payload-pre-processing"
Jul 26 17:04:33.409231 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409200    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="01cf1e6c-8f35-457c-9212-cc4f97962ab0" containerName="payload-pre-processing"
Jul 26 17:04:33.409231 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409208    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="789f2f67-ce0c-4e60-a262-d62b99ddc4c1" containerName="maas-api"
Jul 26 17:04:33.409231 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409213    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="789f2f67-ce0c-4e60-a262-d62b99ddc4c1" containerName="maas-api"
Jul 26 17:04:33.409231 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409220    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6d23cdc-1d6c-4a37-adba-addc6da631b9" containerName="payload-processing"
Jul 26 17:04:33.409231 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409226    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6d23cdc-1d6c-4a37-adba-addc6da631b9" containerName="payload-processing"
Jul 26 17:04:33.409231 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409233    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6" containerName="maas-api"
Jul 26 17:04:33.409562 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409239    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6" containerName="maas-api"
Jul 26 17:04:33.409562 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409245    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bcaca0f-465a-4810-b596-4dd74e7eb270" containerName="payload-pre-processing"
Jul 26 17:04:33.409562 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409250    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bcaca0f-465a-4810-b596-4dd74e7eb270" containerName="payload-pre-processing"
Jul 26 17:04:33.409562 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409312    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b460cd5b-9bc6-41a4-bba6-ea97ba8f97a6" containerName="maas-api"
Jul 26 17:04:33.409562 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409322    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b0f1b5e-fbb9-4c6a-9031-0b096577c746" containerName="payload-pre-processing"
Jul 26 17:04:33.409562 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409329    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="789f2f67-ce0c-4e60-a262-d62b99ddc4c1" containerName="maas-api"
Jul 26 17:04:33.409562 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409336    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6d23cdc-1d6c-4a37-adba-addc6da631b9" containerName="payload-processing"
Jul 26 17:04:33.409562 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409346    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="01cf1e6c-8f35-457c-9212-cc4f97962ab0" containerName="payload-pre-processing"
Jul 26 17:04:33.409562 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409354    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3297a7f5-cde7-4f0b-86f5-4d54cd81c669" containerName="istio-proxy"
Jul 26 17:04:33.409562 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409359    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3297a7f5-cde7-4f0b-86f5-4d54cd81c669" containerName="istio-proxy"
Jul 26 17:04:33.409562 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409366    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2da7447f-8b28-4448-8977-08682269a9b6" containerName="registry-server"
Jul 26 17:04:33.409562 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409372    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bcaca0f-465a-4810-b596-4dd74e7eb270" containerName="payload-pre-processing"
Jul 26 17:04:33.409562 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409454    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3297a7f5-cde7-4f0b-86f5-4d54cd81c669" containerName="istio-proxy"
Jul 26 17:04:33.409562 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.409460    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3297a7f5-cde7-4f0b-86f5-4d54cd81c669" containerName="istio-proxy"
Jul 26 17:04:33.412827 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.412807    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bnlmg/must-gather-dw5tn"
Jul 26 17:04:33.415250 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.415231    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bnlmg\"/\"default-dockercfg-g2bhf\""
Jul 26 17:04:33.415494 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.415477    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bnlmg\"/\"openshift-service-ca.crt\""
Jul 26 17:04:33.416046 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.416032    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bnlmg\"/\"kube-root-ca.crt\""
Jul 26 17:04:33.420236 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.420193    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:04:33.422276 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.422249    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bnlmg/must-gather-dw5tn"]
Jul 26 17:04:33.519317 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.519287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log" limit=1024
Jul 26 17:04:33.575495 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.575466    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccxzv\" (UniqueName: \"kubernetes.io/projected/9941d356-db06-4b4a-946f-97cdb7631a2d-kube-api-access-ccxzv\") pod \"must-gather-dw5tn\" (UID: \"9941d356-db06-4b4a-946f-97cdb7631a2d\") " pod="openshift-must-gather-bnlmg/must-gather-dw5tn"
Jul 26 17:04:33.575601 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.575549    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9941d356-db06-4b4a-946f-97cdb7631a2d-must-gather-output\") pod \"must-gather-dw5tn\" (UID: \"9941d356-db06-4b4a-946f-97cdb7631a2d\") " pod="openshift-must-gather-bnlmg/must-gather-dw5tn"
Jul 26 17:04:33.676578 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.676503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9941d356-db06-4b4a-946f-97cdb7631a2d-must-gather-output\") pod \"must-gather-dw5tn\" (UID: \"9941d356-db06-4b4a-946f-97cdb7631a2d\") " pod="openshift-must-gather-bnlmg/must-gather-dw5tn"
Jul 26 17:04:33.676578 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.676565    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccxzv\" (UniqueName: \"kubernetes.io/projected/9941d356-db06-4b4a-946f-97cdb7631a2d-kube-api-access-ccxzv\") pod \"must-gather-dw5tn\" (UID: \"9941d356-db06-4b4a-946f-97cdb7631a2d\") " pod="openshift-must-gather-bnlmg/must-gather-dw5tn"
Jul 26 17:04:33.676846 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.676831    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9941d356-db06-4b4a-946f-97cdb7631a2d-must-gather-output\") pod \"must-gather-dw5tn\" (UID: \"9941d356-db06-4b4a-946f-97cdb7631a2d\") " pod="openshift-must-gather-bnlmg/must-gather-dw5tn"
Jul 26 17:04:33.685749 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.685719    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccxzv\" (UniqueName: \"kubernetes.io/projected/9941d356-db06-4b4a-946f-97cdb7631a2d-kube-api-access-ccxzv\") pod \"must-gather-dw5tn\" (UID: \"9941d356-db06-4b4a-946f-97cdb7631a2d\") " pod="openshift-must-gather-bnlmg/must-gather-dw5tn"
Jul 26 17:04:33.723819 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.723795    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bnlmg/must-gather-dw5tn"
Jul 26 17:04:33.859804 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.859769    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bnlmg/must-gather-dw5tn"]
Jul 26 17:04:33.862304 ip-10-0-131-99 kubenswrapper[2559]: W0726 17:04:33.862273    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9941d356_db06_4b4a_946f_97cdb7631a2d.slice/crio-9b30b585e07b9809be6379bdeec4efea791ae7da98029a9447d442d037b00efb WatchSource:0}: Error finding container 9b30b585e07b9809be6379bdeec4efea791ae7da98029a9447d442d037b00efb: Status 404 returned error can't find the container with id 9b30b585e07b9809be6379bdeec4efea791ae7da98029a9447d442d037b00efb
Jul 26 17:04:33.864510 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:33.864490    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 17:04:34.204290 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:34.204253    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bnlmg/must-gather-dw5tn" event={"ID":"9941d356-db06-4b4a-946f-97cdb7631a2d","Type":"ContainerStarted","Data":"9b30b585e07b9809be6379bdeec4efea791ae7da98029a9447d442d037b00efb"}
Jul 26 17:04:35.214953 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:35.214911    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bnlmg/must-gather-dw5tn" event={"ID":"9941d356-db06-4b4a-946f-97cdb7631a2d","Type":"ContainerStarted","Data":"d51c1b25d97a4948727b4e858bb9afd023669e40fcb2481285b303a6839bce15"}
Jul 26 17:04:35.215512 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:35.214967    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bnlmg/must-gather-dw5tn" event={"ID":"9941d356-db06-4b4a-946f-97cdb7631a2d","Type":"ContainerStarted","Data":"970fb73518dcafb74bdf534bb68b25ae7d45d3da0f4049d806396629690df437"}
Jul 26 17:04:35.232509 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:35.232459    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bnlmg/must-gather-dw5tn" podStartSLOduration=1.442153329 podStartE2EDuration="2.232444387s" totalImagesPullingTime="790.291058ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:04:35.229734308 +0000 UTC m=+3390.764433604" watchObservedRunningTime="2026-07-26 17:04:35.232444387 +0000 UTC m=+3390.767143662"
Jul 26 17:04:36.248469 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:36.248441    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z5w5l_3287a3ce-5acd-45cc-99ca-a0b6bdf6d868/global-pull-secret-syncer/0.log"
Jul 26 17:04:36.314333 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:36.314299    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2s5df_a05de7a3-da4b-4350-8d8b-a509ffc0b45d/konnectivity-agent/0.log"
Jul 26 17:04:36.425447 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:36.425415    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-99.ec2.internal_8adaacd782e93dbe1035567c610a881f/haproxy/0.log"
Jul 26 17:04:41.323715 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:41.323637    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-trqkk_dd4d6f54-b128-4549-9330-a4ce7a5e63fd/manager/0.log"
Jul 26 17:04:41.354664 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:41.354635    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dgq2k_1de5e7e5-a455-4326-b244-769090503f22/manager/0.log"
Jul 26 17:04:41.379911 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:41.379755    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-b6ggp_cd65ffc6-a847-47ba-8250-33b5dd136bc7/kuadrant-console-plugin/0.log"
Jul 26 17:04:41.449006 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:41.448970    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8xst5_179c3af6-d835-495d-903c-360effb03056/registry-server/0.log"
Jul 26 17:04:41.749722 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:41.749690    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vdzn4_666e33ce-b441-4eca-a978-7527a1222328/manager/0.log"
Jul 26 17:04:43.688350 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:43.688303    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-5vwjk_0d800c32-37d3-421d-80a3-d0223dc36ca2/cluster-monitoring-operator/0.log"
Jul 26 17:04:43.879533 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:43.879444    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8jkzj_f7458ad5-0758-46c1-99b3-92163e6b04c0/node-exporter/0.log"
Jul 26 17:04:43.908271 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:43.908242    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8jkzj_f7458ad5-0758-46c1-99b3-92163e6b04c0/kube-rbac-proxy/0.log"
Jul 26 17:04:43.936764 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:43.936736    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8jkzj_f7458ad5-0758-46c1-99b3-92163e6b04c0/init-textfile/0.log"
Jul 26 17:04:45.802802 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:45.802771    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-p69hj_56aba15a-d885-40f5-ba06-0b5bdec50734/networking-console-plugin/0.log"
Jul 26 17:04:46.072197 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.072095    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"]
Jul 26 17:04:46.081532 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.081499    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.103407 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.103373    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"]
Jul 26 17:04:46.122152 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.122101    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62a40557-e236-480f-9d30-9d594b602459-podres\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.122494 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.122471    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62a40557-e236-480f-9d30-9d594b602459-proc\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.122662 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.122644    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swh75\" (UniqueName: \"kubernetes.io/projected/62a40557-e236-480f-9d30-9d594b602459-kube-api-access-swh75\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.122795 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.122780    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62a40557-e236-480f-9d30-9d594b602459-lib-modules\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.123050 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.123031    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62a40557-e236-480f-9d30-9d594b602459-sys\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.224110 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.224072    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62a40557-e236-480f-9d30-9d594b602459-sys\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.224494 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.224470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62a40557-e236-480f-9d30-9d594b602459-podres\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.224640 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.224624    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62a40557-e236-480f-9d30-9d594b602459-proc\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.224745 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.224731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swh75\" (UniqueName: \"kubernetes.io/projected/62a40557-e236-480f-9d30-9d594b602459-kube-api-access-swh75\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.224862 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.224848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62a40557-e236-480f-9d30-9d594b602459-lib-modules\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.225256 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.225232    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62a40557-e236-480f-9d30-9d594b602459-lib-modules\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.225389 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.224319    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62a40557-e236-480f-9d30-9d594b602459-sys\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.225563 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.225547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62a40557-e236-480f-9d30-9d594b602459-podres\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.225696 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.225683    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62a40557-e236-480f-9d30-9d594b602459-proc\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.235002 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.234967    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swh75\" (UniqueName: \"kubernetes.io/projected/62a40557-e236-480f-9d30-9d594b602459-kube-api-access-swh75\") pod \"perf-node-gather-daemonset-pm9hl\" (UID: \"62a40557-e236-480f-9d30-9d594b602459\") " pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.395539 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.395453    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:46.588475 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.588418    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/1.log"
Jul 26 17:04:46.595152 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.595112    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-44t9x_083e4170-cde7-406a-887b-54540eb55bf5/console-operator/2.log"
Jul 26 17:04:46.603145 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:46.603104    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"]
Jul 26 17:04:46.607072 ip-10-0-131-99 kubenswrapper[2559]: W0726 17:04:46.607043    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod62a40557_e236_480f_9d30_9d594b602459.slice/crio-2ef95b9d825662e75392c396f4b99cb40c253736daffc172403f978d11d8faaf WatchSource:0}: Error finding container 2ef95b9d825662e75392c396f4b99cb40c253736daffc172403f978d11d8faaf: Status 404 returned error can't find the container with id 2ef95b9d825662e75392c396f4b99cb40c253736daffc172403f978d11d8faaf
Jul 26 17:04:47.184035 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:47.183991    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-d78q7_a03e4347-94d0-49b5-90f6-306a15aea353/download-server/0.log"
Jul 26 17:04:47.309812 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:47.309769    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl" event={"ID":"62a40557-e236-480f-9d30-9d594b602459","Type":"ContainerStarted","Data":"77a2ed3ba77fbe09b5e31f35ca60ef9f63993ec852dea021d10cc33373274f49"}
Jul 26 17:04:47.310013 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:47.309835    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl" event={"ID":"62a40557-e236-480f-9d30-9d594b602459","Type":"ContainerStarted","Data":"2ef95b9d825662e75392c396f4b99cb40c253736daffc172403f978d11d8faaf"}
Jul 26 17:04:47.310013 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:47.309920    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:47.334145 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:47.329286    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl" podStartSLOduration=1.329264744 podStartE2EDuration="1.329264744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:04:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:04:47.324960815 +0000 UTC m=+3402.859660091" watchObservedRunningTime="2026-07-26 17:04:47.329264744 +0000 UTC m=+3402.863964021"
Jul 26 17:04:47.854546 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:47.854515    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-xc8ts_a08982fd-5a26-492b-8ff0-164b509a1f93/volume-data-source-validator/0.log"
Jul 26 17:04:48.975524 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:48.975495    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wdzsq_599cd3cc-a2cc-4359-9dfd-2215960c847b/dns/0.log"
Jul 26 17:04:48.997756 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:48.997713    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wdzsq_599cd3cc-a2cc-4359-9dfd-2215960c847b/kube-rbac-proxy/0.log"
Jul 26 17:04:49.076479 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:49.076449    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gvssk_86e0c73c-e33c-4ae9-930b-6b2ab5ba9dd5/dns-node-resolver/0.log"
Jul 26 17:04:49.694369 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:49.694334    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z66qt_7253b8f8-7797-434e-9789-b796950e4959/node-ca/0.log"
Jul 26 17:04:50.897482 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:50.897441    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff4cb76d8-nbhzm_7afe94df-ac8d-4d8a-8e17-f24a6f05c6db/kube-auth-proxy/0.log"
Jul 26 17:04:50.926881 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:50.926855    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-85dpz_c9bb9915-63d0-4798-805e-c3351f4a529a/istio-proxy/0.log"
Jul 26 17:04:50.962347 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:50.962319    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-85dpz_c9bb9915-63d0-4798-805e-c3351f4a529a/istio-proxy/1.log"
Jul 26 17:04:50.996235 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:50.996208    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tnfmc_d021cdfb-bbff-4e0a-9493-28c7e8483e2b/payload-pre-processing/0.log"
Jul 26 17:04:51.027791 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:51.027759    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tzt22_d62e39a9-9c8e-4d8f-b329-7c47fb0daccc/payload-processing/0.log"
Jul 26 17:04:51.050373 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:51.050349    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64c4699495-5f5tt_976d4655-f3a5-48e1-bc28-64652772d878/router/0.log"
Jul 26 17:04:51.866210 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:51.866184    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6t79p_e52083e7-dd87-4733-870d-1b83e1f134ae/serve-healthcheck-canary/0.log"
Jul 26 17:04:52.425170 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:52.425114    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-qvvws_a6c5fb98-fd57-4375-bfd8-9b3007965d80/insights-operator/0.log"
Jul 26 17:04:52.429076 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:52.429047    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-qvvws_a6c5fb98-fd57-4375-bfd8-9b3007965d80/insights-operator/1.log"
Jul 26 17:04:52.520473 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:52.520447    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5ndjt_908b6598-c0d3-452f-a3b2-222478faa1f1/kube-rbac-proxy/0.log"
Jul 26 17:04:52.541723 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:52.541695    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5ndjt_908b6598-c0d3-452f-a3b2-222478faa1f1/exporter/0.log"
Jul 26 17:04:52.564226 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:52.564202    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5ndjt_908b6598-c0d3-452f-a3b2-222478faa1f1/extractor/0.log"
Jul 26 17:04:53.326885 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:53.326861    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bnlmg/perf-node-gather-daemonset-pm9hl"
Jul 26 17:04:54.858473 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:54.858390    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8t26j_8156b810-a774-4b2a-8cb3-92003838c0a7/manager/0.log"
Jul 26 17:04:55.357901 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:55.357865    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-mczbl_6b5f62b4-cbc0-43b1-8e39-ff053ef4c392/server/0.log"
Jul 26 17:04:55.476048 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:55.475975    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jrmqn_f98a39dd-5919-43c5-8ce6-9f90b20fa92a/manager/0.log"
Jul 26 17:04:55.507644 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:55.507616    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bd4986cdb-g4hhm_87d59085-2ddc-4e68-bcc1-e9d100dd24c2/manager/0.log"
Jul 26 17:04:55.535479 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:55.535389    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bd4986cdb-g4hhm_87d59085-2ddc-4e68-bcc1-e9d100dd24c2/copy-manifests/0.log"
Jul 26 17:04:56.830954 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:56.830922    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff4cb76d8-nbhzm_7afe94df-ac8d-4d8a-8e17-f24a6f05c6db/kube-auth-proxy/0.log"
Jul 26 17:04:56.854035 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:56.854004    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-85dpz_c9bb9915-63d0-4798-805e-c3351f4a529a/istio-proxy/0.log"
Jul 26 17:04:56.901074 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:56.901040    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-85dpz_c9bb9915-63d0-4798-805e-c3351f4a529a/istio-proxy/1.log"
Jul 26 17:04:56.928052 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:56.928019    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tnfmc_d021cdfb-bbff-4e0a-9493-28c7e8483e2b/payload-pre-processing/0.log"
Jul 26 17:04:56.957178 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:56.957144    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tzt22_d62e39a9-9c8e-4d8f-b329-7c47fb0daccc/payload-processing/0.log"
Jul 26 17:04:56.973992 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:56.973963    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64c4699495-5f5tt_976d4655-f3a5-48e1-bc28-64652772d878/router/0.log"
Jul 26 17:04:58.567760 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:58.567728    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff4cb76d8-nbhzm_7afe94df-ac8d-4d8a-8e17-f24a6f05c6db/kube-auth-proxy/0.log"
Jul 26 17:04:58.586246 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:58.586215    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-85dpz_c9bb9915-63d0-4798-805e-c3351f4a529a/istio-proxy/0.log"
Jul 26 17:04:58.622050 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:58.622017    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-85dpz_c9bb9915-63d0-4798-805e-c3351f4a529a/istio-proxy/1.log"
Jul 26 17:04:58.645498 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:58.645467    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-tnfmc_d021cdfb-bbff-4e0a-9493-28c7e8483e2b/payload-pre-processing/0.log"
Jul 26 17:04:58.670959 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:58.670929    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tzt22_d62e39a9-9c8e-4d8f-b329-7c47fb0daccc/payload-processing/0.log"
Jul 26 17:04:58.685347 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:04:58.685325    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64c4699495-5f5tt_976d4655-f3a5-48e1-bc28-64652772d878/router/0.log"
Jul 26 17:05:02.188013 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:05:02.187986    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-p94pf_36b2fcbc-91ef-4c79-9442-65eb2fd60104/migrator/0.log"
Jul 26 17:05:02.210465 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:05:02.210438    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-p94pf_36b2fcbc-91ef-4c79-9442-65eb2fd60104/graceful-termination/0.log"
Jul 26 17:05:02.560314 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:05:02.560174    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25_864a4462-7451-4c85-8863-6a4ec9140c77/kube-storage-version-migrator-operator/1.log"
Jul 26 17:05:02.583837 ip-10-0-131-99 kubenswrapper[2559]: I0726 17:05:02.561547    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-cqc25_864a4462-7451-4c85-8863-6a4ec9140c77/kube-storage-version-migrator-operator/0.log"